-- Logs begin at Thu 2022-08-04 01:15:35 UTC, end at Thu 2022-08-04 04:04:13 UTC. -- Aug 04 03:30:25.329131 dv-cinder-733062-32-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 04 03:30:25.338531 dv-cinder-733062-32-iscsi devstack@n-api.service[104898]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 04 03:30:25.340516 dv-cinder-733062-32-iscsi devstack@n-api.service[104898]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Aug 4 03:30:25 2022] *** Aug 04 03:30:25.340516 dv-cinder-733062-32-iscsi devstack@n-api.service[104898]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 04 03:30:25.340516 dv-cinder-733062-32-iscsi devstack@n-api.service[104898]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 04 03:30:25.340516 dv-cinder-733062-32-iscsi devstack@n-api.service[104898]: nodename: dv-cinder-733062-32-iscsi Aug 04 03:30:25.340516 dv-cinder-733062-32-iscsi devstack@n-api.service[104898]: machine: x86_64 Aug 04 03:30:25.340516 dv-cinder-733062-32-iscsi devstack@n-api.service[104898]: clock source: unix Aug 04 03:30:25.340516 dv-cinder-733062-32-iscsi devstack@n-api.service[104898]: pcre jit disabled Aug 04 03:30:25.340516 dv-cinder-733062-32-iscsi devstack@n-api.service[104898]: detected number of CPU cores: 4 Aug 04 03:30:25.340516 dv-cinder-733062-32-iscsi devstack@n-api.service[104898]: current working directory: / Aug 04 03:30:25.340516 dv-cinder-733062-32-iscsi devstack@n-api.service[104898]: detected binary path: /usr/bin/uwsgi-core Aug 04 03:30:25.340516 dv-cinder-733062-32-iscsi devstack@n-api.service[104898]: your processes number limit is 47680 Aug 04 03:30:25.340516 dv-cinder-733062-32-iscsi devstack@n-api.service[104898]: your memory page size is 4096 bytes Aug 04 03:30:25.340516 dv-cinder-733062-32-iscsi devstack@n-api.service[104898]: detected max file descriptor number: 2048 Aug 04 03:30:25.340516 dv-cinder-733062-32-iscsi devstack@n-api.service[104898]: lock engine: pthread robust mutexes Aug 04 03:30:25.342272 dv-cinder-733062-32-iscsi devstack@n-api.service[104898]: thunder lock: enabled Aug 04 03:30:25.342272 dv-cinder-733062-32-iscsi devstack@n-api.service[104898]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 04 03:30:25.342272 dv-cinder-733062-32-iscsi devstack@n-api.service[104898]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 04 03:30:25.380707 dv-cinder-733062-32-iscsi devstack@n-api.service[104898]: Python main interpreter initialized at 0x558771d6e9c0 Aug 04 03:30:25.380707 dv-cinder-733062-32-iscsi devstack@n-api.service[104898]: python threads support enabled Aug 04 03:30:25.380707 dv-cinder-733062-32-iscsi devstack@n-api.service[104898]: your server socket listen backlog is limited to 100 connections Aug 04 03:30:25.380707 dv-cinder-733062-32-iscsi devstack@n-api.service[104898]: your mercy for graceful operations on workers is 90 seconds Aug 04 03:30:25.381093 dv-cinder-733062-32-iscsi devstack@n-api.service[104898]: mapped 403077 bytes (393 KB) for 2 cores Aug 04 03:30:25.381157 dv-cinder-733062-32-iscsi devstack@n-api.service[104898]: *** Operational MODE: preforking *** Aug 04 03:30:25.381401 dv-cinder-733062-32-iscsi devstack@n-api.service[104898]: *** uWSGI is running in multiple interpreter mode *** Aug 04 03:30:25.381401 dv-cinder-733062-32-iscsi devstack@n-api.service[104898]: spawned uWSGI master process (pid: 104898) Aug 04 03:30:25.381603 dv-cinder-733062-32-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 04 03:30:25.385242 dv-cinder-733062-32-iscsi devstack@n-api.service[104898]: spawned uWSGI worker 1 (pid: 104903, cores: 1) Aug 04 03:30:25.385242 dv-cinder-733062-32-iscsi devstack@n-api.service[104898]: spawned uWSGI worker 2 (pid: 104904, cores: 1) Aug 04 03:30:25.385242 dv-cinder-733062-32-iscsi devstack@n-api.service[104898]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 04 03:30:26.036536 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 04 03:30:26.054638 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 04 03:30:27.128077 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 04 03:30:27.128077 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: from cryptography.utils import int_from_bytes Aug 04 03:30:27.128761 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 04 03:30:27.128761 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: from cryptography.utils import int_from_bytes Aug 04 03:30:27.140725 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 04 03:30:27.140725 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: from cryptography.utils import int_from_bytes Aug 04 03:30:27.141159 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 04 03:30:27.141159 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: from cryptography.utils import int_from_bytes Aug 04 03:30:29.635270 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 04 03:30:29.635803 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 04 03:30:29.636031 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 04 03:30:29.636386 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 04 03:30:29.636639 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 04 03:30:29.637021 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.637367 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.637686 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.638018 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.638325 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.638470 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 04 03:30:29.638835 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.638927 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 04 03:30:29.639011 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.639233 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 04 03:30:29.639335 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.639552 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.639662 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 04 03:30:29.639815 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.639965 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 04 03:30:29.640122 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.640225 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.640441 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-733062-32-iscsi {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.640536 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.640764 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.640852 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.641064 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.641159 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.641394 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.641525 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.641705 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.641833 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.642001 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.642137 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.642311 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.642437 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.642621 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.642747 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.642875 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.643108 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.643540 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.643540 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-733062-32-iscsi {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.643751 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.643873 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.643990 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.644096 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.644205 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.644344 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.644464 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.645422 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.645576 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.645773 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.645950 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.646086 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.646284 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.646410 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.646593 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.646721 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.646976 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.647114 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.647366 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-733062-32-iscsi {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.647495 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.647674 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.647798 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.647977 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.648109 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.648284 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.648422 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.648606 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.648732 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.648912 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.649048 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.649246 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.649376 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.649552 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.649678 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.649874 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.649999 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.650178 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.650305 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.650495 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.650595 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-733062-32-iscsi {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.650812 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.650900 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.651122 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.651222 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.651433 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.651520 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.651728 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.651835 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.652031 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.652141 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.652335 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.652432 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.652646 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.652733 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.652943 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.653029 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.653262 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.653372 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.653507 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.653668 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.653807 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.653980 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.654120 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.654291 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.654433 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.654602 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.654746 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.654897 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.654983 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.655198 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.655291 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.655498 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.655586 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.655807 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.655895 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.656105 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.656201 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.656401 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.656486 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.656644 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.656737 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.656942 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.657036 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.657274 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.657363 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.657590 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.657682 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.657888 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.657990 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.658153 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.658253 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.658371 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.658545 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.658709 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.658850 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.659001 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.659140 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.659282 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.659418 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.659562 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.659700 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.659836 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.660038 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.66 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.660192 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.660396 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.66 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.660561 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.660723 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.661066 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.661291 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.661439 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.661671 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.661815 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.661957 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.662100 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.662243 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.662379 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.662524 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.662669 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.662825 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.662975 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.663111 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.663253 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.663397 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.663541 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.663677 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.66 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.663812 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.663947 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.66 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.664088 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.664242 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.664380 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.664523 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.664681 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.664818 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.664962 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.665099 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.665267 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.665411 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.665547 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.665689 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.665838 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.665984 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.666122 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.666256 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.666406 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.666560 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.666705 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.666841 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.666984 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.667121 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.667256 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.667390 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.667533 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.667727 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.667865 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.667999 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.668160 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.668315 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.668471 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.668608 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.668745 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.668879 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.669014 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.669157 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.669321 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.669469 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.669605 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.669739 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.669874 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.670018 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.670186 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.670324 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.670459 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.670602 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.670739 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.670881 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.671018 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.671174 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.671321 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.671457 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.671592 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.671734 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.671870 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.672024 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.672162 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.672298 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.672441 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.672589 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.672726 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.672867 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.673008 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.673143 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.673304 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.673458 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.673602 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.673751 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.673910 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.674047 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.674182 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.674333 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.674479 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.674615 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.674749 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.674883 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.675018 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.675160 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.675303 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.675447 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.675584 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.675729 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.675892 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.676033 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.676248 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.676416 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.676689 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.676833 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.676978 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.677132 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.677308 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.677457 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.677596 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.677738 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.677895 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.678032 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.678175 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.678311 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.678480 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.678624 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.678769 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.678906 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.679064 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.679206 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.679354 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.679503 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.679660 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.679798 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.679940 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.680077 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.680227 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.680372 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.680510 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.680654 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.680791 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.680926 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.681068 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.681265 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.681413 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.681562 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.681700 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.681869 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.682023 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.682172 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.682310 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:30:29.682480 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.682639 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.682777 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.682922 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.683065 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.683208 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.683355 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.683491 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.683669 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.683821 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.683993 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.684146 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.684304 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.684446 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.684615 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.684774 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.684920 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.685056 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.685254 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.685505 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.685656 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.685806 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.685946 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.686089 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.686226 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.686369 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.686513 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.686663 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.686800 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.686937 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.687080 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.687216 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.687372 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.687520 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.687657 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.687818 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.687963 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.688109 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.688259 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.688397 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.688565 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.688709 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.688867 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.689010 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.689170 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.689348 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.689488 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.689623 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.689808 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.689950 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.690118 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.690273 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.690419 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.690557 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.690718 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.690874 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.691019 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.691168 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.691304 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.691930 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.692211 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.692401 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.692653 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.692900 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.693039 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.693223 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.693372 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.693564 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.693710 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.693874 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.694029 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.694166 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.694310 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.694455 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.694593 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.694765 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.694909 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.695068 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.695219 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.695365 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.695502 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.695637 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.695771 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.695945 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.696101 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.696240 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.696376 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.696547 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.696691 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.696870 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.697029 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.697168 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.697337 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.697512 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.697667 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.697816 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.697961 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.698106 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.698242 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.698379 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.698515 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.698686 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.698842 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.698987 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.699124 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.699280 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.699423 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.699569 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.699716 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.699852 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.699987 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.700173 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.700324 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.700470 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.700608 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.700750 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.700893 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.701066 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.701263 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.701420 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.701566 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.701714 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.701850 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.702012 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.702243 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.702417 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.702559 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.702697 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.702832 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.702967 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.703110 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.703248 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.703384 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.703519 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.703666 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.703804 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.703951 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.704094 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.704230 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.704366 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.704501 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.704644 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.704794 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.704940 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.705075 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.705230 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.705396 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.705536 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.705680 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.705818 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.705954 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.706096 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.706233 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.706403 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.706548 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.706720 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.706872 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.707010 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.707724 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.708099 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.708262 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.708410 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.708548 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.708689 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.708846 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.709001 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.709147 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.709330 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.709491 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.709636 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.709773 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.709917 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.710067 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.710203 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.710338 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.710473 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.710683 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.710822 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.711270 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.711410 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.711546 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.711691 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.711838 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.711975 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.712120 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.712281 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.712419 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.712555 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.712699 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.712836 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.712972 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.713106 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.713273 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.713425 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.713572 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.713711 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.713853 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.714000 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.714137 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.714282 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.714419 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.714554 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.714696 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.714834 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.714969 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.715123 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.715263 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.715263 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.715539 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.715688 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.715837 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.715989 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.716127 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.716270 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.716415 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.716558 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.716694 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.716838 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.716975 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.717111 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.717287 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.717434 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.717599 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.717766 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.717904 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.718040 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.718182 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.718319 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.718491 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.718652 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.718813 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.718955 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.719091 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.719234 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.719379 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.719518 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.719686 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.719831 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.719991 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.720142 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.720309 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.720460 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.720655 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.720806 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.720943 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.721077 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.721288 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.721452 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.721590 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.721737 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.721872 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.722017 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.722161 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.722301 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.722470 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.722615 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.722840 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.722991 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.723199 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.723406 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.723585 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.723812 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.723966 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.724116 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.724254 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.724416 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.724560 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.724724 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.724868 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.725033 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.725178 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.725373 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.725518 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.725682 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.725848 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.725988 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.726123 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.726288 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.726438 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.726605 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.726761 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.726899 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.727035 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.727208 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.727350 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.727506 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.727660 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.727809 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.727945 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.728080 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.728215 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.728383 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.728536 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.728673 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.728808 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.728951 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.729087 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.729295 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.729452 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.729598 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.729780 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.729926 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.730095 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.730248 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.730385 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.730529 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.730671 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.730815 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.730980 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.731140 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.731292 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.731436 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.731578 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.731732 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.731876 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.732029 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.732180 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.732331 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.732482 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.732636 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.732787 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.732943 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.733090 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.733256 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.733407 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.733562 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.733717 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.733869 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.734013 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.734156 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.734305 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.734450 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.734600 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.734744 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.734888 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.735030 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.735172 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.735315 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.735476 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.735623 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.735766 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.735908 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.736090 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.736236 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.736391 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.736537 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.736679 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.736821 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.736963 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.737114 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.737316 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.737479 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.737622 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.737765 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.737907 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.738097 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.738247 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.738391 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.738541 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.738692 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.738692 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.739036 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.739183 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.739334 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.739498 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.739650 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.739801 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.739952 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.740104 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.740248 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.740416 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.740575 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.740754 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.740906 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.741070 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.741246 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.741408 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.741565 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.741718 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.741870 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.742050 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.742200 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.742351 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.742503 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.742674 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.742833 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.742977 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.743128 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.743271 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.743424 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.743576 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.743728 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.743873 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.744015 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.744156 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.744299 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.744441 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.744597 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.744750 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.744892 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.745044 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.745188 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.745382 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.745783 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.745936 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.746078 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.746219 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.746362 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.746512 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.746658 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.746801 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.746944 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.747086 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.747228 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.747378 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.747537 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.747689 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.747844 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.747997 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.748153 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.748297 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.748448 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.748592 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.748743 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.748888 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.749031 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.749172 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.749385 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.749539 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.749696 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.749841 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.749991 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.750142 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.750142 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.750429 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.750572 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.750714 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.750857 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.751009 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.751153 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.751306 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.751450 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.751600 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.751745 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.751895 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.752040 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.752182 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.752324 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.752473 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.752627 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.752779 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.752924 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.753075 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.753248 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.753411 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.753555 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.753706 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.753850 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.754566 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.754751 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.754906 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.754906 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.755197 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.755341 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.755483 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.755626 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.755626 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.755933 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.756079 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.756223 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.756366 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.756509 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.756651 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.756802 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.756947 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.757091 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.757279 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.757432 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.757587 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.757746 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.757892 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.758034 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.758176 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.758320 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.758471 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.758615 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.758757 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.758937 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.759085 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.759228 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.759381 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.759543 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.759695 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.759838 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.759980 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.760122 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.760277 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.760422 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.760565 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.760707 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.760856 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.761007 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.761159 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.761326 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.761482 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.761625 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.761767 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.761921 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.762065 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.762218 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.762362 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.762504 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.762646 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.762866 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.763021 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.763169 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.763312 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.763467 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.763610 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.763761 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.763906 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.764048 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.764190 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.764333 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.764486 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.764645 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.764790 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.764933 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.765075 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.765285 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.765450 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.765598 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.765748 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.765898 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.766041 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.766190 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.766343 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.766487 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.766630 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.766773 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.766914 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.767056 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.767219 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.767364 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.767513 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.767701 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.767851 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.767995 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.768146 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.768289 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.768438 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.768588 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.768731 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.768883 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.769027 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.769188 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.769360 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.769519 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.769726 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.769881 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.770025 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.770201 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.770358 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.770520 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.770672 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.770672 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.770958 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.771108 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.771274 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.771419 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.771561 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.771713 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.771858 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.771858 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.772128 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.772270 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.772422 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.772566 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.772708 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.772708 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.772995 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.773154 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.773359 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.773359 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.773651 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.773802 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.773946 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.774089 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.774242 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.774242 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.774514 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.774514 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.774792 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.774792 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.775085 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.775231 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.775380 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.775531 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.775681 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.775834 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.775977 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.776121 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.776262 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.776405 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.776546 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.776696 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.776851 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.776994 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.777138 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.777307 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.777463 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.777617 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.777767 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.777911 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.778053 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.778196 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.778345 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.778497 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.778649 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.778804 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.778947 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.779089 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.779231 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.779383 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.779527 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.779669 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.779811 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.779953 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.780108 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.780253 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.780395 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.780536 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.780688 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.780839 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.780991 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.781135 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.781326 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.781470 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.781613 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.781613 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.781895 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.782045 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.782188 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.782332 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.782484 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.782635 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.782787 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.782945 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.783100 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.783244 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.783393 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.783549 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.783699 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.783842 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.783984 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.784125 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.784267 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.784428 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.784582 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.784727 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.784868 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.785010 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.785152 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.785862 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.786015 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.786159 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.786326 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.786326 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.786676 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.786830 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.786987 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.787145 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.787296 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.787439 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.787591 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.787736 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.787736 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.788017 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.788161 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.788302 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.788457 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.788601 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.788601 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.788888 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.789032 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.789175 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.789361 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.789507 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.789649 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.789792 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.789935 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.790090 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.790233 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.790384 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.790534 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.790689 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.790834 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.791049 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.791202 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.791347 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.791490 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.791632 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.791776 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.791931 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.792075 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.792217 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.792360 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.792503 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.792655 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.792808 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.792960 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.793111 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.793307 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.793462 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.793610 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.793766 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.793912 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.794062 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.794207 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.794349 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.794500 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.794676 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.794829 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.794986 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.795129 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.795272 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.795414 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.795557 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.795711 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.795856 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.796000 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.796143 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.796292 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.796454 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.796612 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.796757 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.796757 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.797030 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.797181 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.797352 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.797507 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.797653 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.797796 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.797938 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.798082 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.798224 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.798386 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.798531 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.798673 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.798816 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.798965 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.799119 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.799269 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.799413 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.799555 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.799698 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.799847 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.799999 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.800144 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.800305 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.800450 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.800592 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.800734 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.801546 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.801728 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.801873 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.802015 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.802159 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.802313 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.802459 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.802601 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.802745 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.802899 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.803043 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.803193 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.803339 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.803493 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.803638 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.803780 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.803923 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.804073 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.804225 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.804371 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.804522 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.804677 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.804821 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.804977 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.805130 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.805317 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.805464 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.805607 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.805766 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.805912 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.806055 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.806199 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.806342 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.806485 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.806648 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.806793 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.806943 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.807087 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.807229 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.807433 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.807592 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.807737 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.807888 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.808032 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.808175 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.808325 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.808478 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.808637 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.808782 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.808924 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.809067 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.809249 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.809402 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.809546 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.809691 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.809834 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.809977 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.810131 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.810277 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.810428 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.810584 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.810729 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.810873 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.811024 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.811170 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.811319 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.811463 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.811607 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.811751 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.811906 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.812051 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.812194 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.812348 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.812499 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.812653 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.812799 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.812942 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.813086 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.813282 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.813441 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.813598 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.813743 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.813899 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.814044 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.814186 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.814340 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.814497 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.814642 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.814786 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.814929 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.815079 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.815222 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.815378 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.815522 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.815672 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.815816 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.815960 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.816111 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.816266 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.816438 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.816680 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.816892 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.817068 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.817068 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.817392 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.817621 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.817779 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.817984 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.818210 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.818380 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.818587 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.818739 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.818905 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.819069 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.819343 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.819517 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.819672 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.819818 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.819961 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.820106 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.820262 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.820407 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.820551 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.820707 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.820943 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.821103 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.821292 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.821444 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.821611 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.821763 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.821908 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.822051 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.822226 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.822379 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.822530 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.822692 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.822839 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.822990 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.823135 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.823288 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.823441 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.823586 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.823736 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.823891 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.824042 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.824186 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.824330 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.824489 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.824641 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.824800 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.824945 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.825115 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.825352 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.825501 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.825658 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.825810 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.825954 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.826098 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.826241 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.826385 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.826555 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.826701 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.826844 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.826994 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.827139 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.827294 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.827449 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.827595 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.827739 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.827882 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.828033 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.828185 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.828342 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.828494 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.828645 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.828789 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.828933 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.829084 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.829258 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.829410 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.829563 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.829714 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.829934 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.830162 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.830321 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.830466 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.830610 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.830754 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.830905 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.831054 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.831198 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.831349 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.831501 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.831647 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.831803 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.831949 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.832123 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.832281 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.832426 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.832598 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.832761 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.832977 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.833128 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.833331 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.833440 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.833597 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.833700 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.833906 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.833998 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.834211 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.834319 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.834509 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.834603 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.834815 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.834904 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.835116 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.835204 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.835431 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.835638 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.835761 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.835979 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.836089 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.836291 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.836386 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.836608 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.836702 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.836929 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.837017 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.837263 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.837482 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.837570 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.837796 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.837893 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.838125 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.838221 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.838445 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.838538 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.838756 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.838851 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.839064 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.839160 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.839364 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.839469 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.839664 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.839752 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.839970 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.840064 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.840272 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.840366 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.840567 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.840654 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.840871 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.840966 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.841172 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.841286 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.841512 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.841599 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.841817 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.841906 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.842113 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.842200 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.842409 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.842495 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.842715 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.842822 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.843011 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.843234 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.843323 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.843577 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.843665 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.843876 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.843969 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.844184 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.844271 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.844484 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.844572 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.844786 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.844873 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.845083 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.845171 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.845413 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.845504 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.845714 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.845800 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.846013 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.846101 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.846311 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.846405 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.846611 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.846704 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.846909 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.847009 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.847206 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.847295 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.847509 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.847598 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.848337 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.848440 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.848750 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.848900 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.849062 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.849304 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.849399 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.849611 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.849723 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.849936 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.850036 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.850241 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.850545 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.850641 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.850846 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.850933 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.851152 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.851308 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.851452 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.851541 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.851750 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.851838 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.852049 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.852135 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.852345 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.852433 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.852652 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.852754 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.852953 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.853052 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.853273 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.853365 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.853573 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.853672 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.853875 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.853961 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.854170 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.854258 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.854472 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.854563 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.854775 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.854869 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.855081 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.855169 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.855375 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.855461 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.855674 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.855769 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.855976 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.856065 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.856278 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.856408 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.856580 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.856676 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.856882 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.856969 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.857184 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.857303 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.857514 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.857601 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.857841 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.857935 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.858151 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.858363 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.858458 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.858689 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.858777 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.859005 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.859091 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.859331 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.859525 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.859638 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.859744 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.859921 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.860010 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.860224 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.860330 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.860521 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.860607 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.860839 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.860926 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.861146 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.861289 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.861472 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.861562 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.861773 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.861881 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.862079 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.862195 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.862381 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.862510 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.862684 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.862824 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.862983 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.863128 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.863277 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.864036 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.864299 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.864403 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.864604 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.864806 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.864920 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.865120 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.865228 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.865458 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.865560 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.865767 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.865862 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.866074 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.866190 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.866386 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.866538 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.866722 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.866809 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.867039 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.867138 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.867351 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.867445 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.867658 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.867745 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.867967 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.868065 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.868270 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.868356 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.868570 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.868659 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.868869 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.868963 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.869170 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.869276 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.869491 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.869577 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.869792 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.869896 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.870091 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.870178 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.870389 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.870476 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.870947 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.871044 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.871245 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.871339 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.871542 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.871630 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.871843 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.871930 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.872147 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.872235 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.872445 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.872532 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.872742 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.872836 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.873044 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.873126 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.873363 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.873466 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.873661 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.873749 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.873956 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.874042 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.874255 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.874375 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.874551 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.874704 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.874875 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.875024 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.875202 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.875329 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.875512 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.875631 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.875826 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.875933 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.876132 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.876220 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.876446 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.876540 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.876752 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.876839 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.877067 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.877161 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.877411 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.877498 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.877714 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.877801 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.878010 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.878098 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.878307 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.878393 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.878605 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.878692 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.878904 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.878991 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.879260 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.879433 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.879651 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.879768 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.879961 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.880071 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.880265 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.880358 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.880586 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.880684 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.880908 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.880996 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.881219 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.881319 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.881538 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.881633 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.881837 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.881924 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.882137 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.882232 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.882434 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.882530 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.882732 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.882819 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.883030 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.883118 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.883347 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.883440 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.883652 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.883739 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.883955 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.884043 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.884258 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.884346 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.884560 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.884646 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.884870 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.884957 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.885173 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.885316 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.885518 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.885607 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.885835 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.885935 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.886147 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.886235 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.886454 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.886541 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.886777 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.886870 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.887078 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.887164 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.887384 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.887477 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.887689 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.887785 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.887993 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.888088 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.888297 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.888385 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.888600 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.888768 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.888921 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.889009 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.889309 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.889401 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.889567 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.889649 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.889866 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.889953 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.890108 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104903) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 04 03:30:29.890194 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.890494 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.890806 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.891110 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.891434 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.891741 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.892047 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.892352 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.892657 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.892961 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.893291 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.893599 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.893905 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.894215 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.894525 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.895262 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.895598 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.895907 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.896233 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.896558 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.896900 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.897270 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.897667 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.897999 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.898309 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.898617 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.898920 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:30:29.899159 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104904) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 04 03:30:30.044888 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: INFO dbcounter [None req-e03858b2-e3e6-4daf-baee-4a7efbc118be None None] Registered counter for database nova_api Aug 04 03:30:30.056051 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: INFO dbcounter [None req-eda97bbc-365d-4288-a9ae-66757631ad48 None None] Registered counter for database nova_api Aug 04 03:30:30.065884 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG oslo_db.sqlalchemy.engines [None req-e03858b2-e3e6-4daf-baee-4a7efbc118be None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104903) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 03:30:30.072441 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG dbcounter [-] [104903] Writer thread running {{(pid=104903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 03:30:30.081601 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG oslo_db.sqlalchemy.engines [None req-eda97bbc-365d-4288-a9ae-66757631ad48 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104904) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 03:30:30.088901 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG dbcounter [-] [104904] Writer thread running {{(pid=104904) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 03:30:30.127845 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.context [None req-e03858b2-e3e6-4daf-baee-4a7efbc118be None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),832e4e75-7d7f-4738-9a24-2466a2a2c834(cell1) {{(pid=104903) load_cells /opt/stack/nova/nova/context.py:464}} Aug 04 03:30:30.131808 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG oslo_concurrency.lockutils [None req-e03858b2-e3e6-4daf-baee-4a7efbc118be None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:30:30.133382 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG oslo_concurrency.lockutils [None req-e03858b2-e3e6-4daf-baee-4a7efbc118be None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:30:30.134172 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG oslo_concurrency.lockutils [None req-e03858b2-e3e6-4daf-baee-4a7efbc118be None None] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:30:30.136208 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG oslo_concurrency.lockutils [None req-e03858b2-e3e6-4daf-baee-4a7efbc118be None None] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104903) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:30:30.138155 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: INFO dbcounter [None req-e03858b2-e3e6-4daf-baee-4a7efbc118be None None] Registered counter for database nova_cell0 Aug 04 03:30:30.143587 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: INFO dbcounter [None req-e03858b2-e3e6-4daf-baee-4a7efbc118be None None] Registered counter for database nova_cell1 Aug 04 03:30:30.145958 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.context [None req-eda97bbc-365d-4288-a9ae-66757631ad48 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),832e4e75-7d7f-4738-9a24-2466a2a2c834(cell1) {{(pid=104904) load_cells /opt/stack/nova/nova/context.py:464}} Aug 04 03:30:30.150035 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG oslo_concurrency.lockutils [None req-eda97bbc-365d-4288-a9ae-66757631ad48 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104904) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:30:30.151566 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG oslo_db.sqlalchemy.engines [None req-e03858b2-e3e6-4daf-baee-4a7efbc118be None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104903) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 03:30:30.151693 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG oslo_concurrency.lockutils [None req-eda97bbc-365d-4288-a9ae-66757631ad48 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104904) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:30:30.152417 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG oslo_concurrency.lockutils [None req-eda97bbc-365d-4288-a9ae-66757631ad48 None None] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104904) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:30:30.153716 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG oslo_db.sqlalchemy.engines [None req-e03858b2-e3e6-4daf-baee-4a7efbc118be None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104903) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 03:30:30.154455 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG oslo_concurrency.lockutils [None req-eda97bbc-365d-4288-a9ae-66757631ad48 None None] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104904) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:30:30.156450 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: INFO dbcounter [None req-eda97bbc-365d-4288-a9ae-66757631ad48 None None] Registered counter for database nova_cell0 Aug 04 03:30:30.158190 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG dbcounter [-] [104903] Writer thread running {{(pid=104903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 03:30:30.163070 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: INFO dbcounter [None req-eda97bbc-365d-4288-a9ae-66757631ad48 None None] Registered counter for database nova_cell1 Aug 04 03:30:30.171972 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG oslo_db.sqlalchemy.engines [None req-eda97bbc-365d-4288-a9ae-66757631ad48 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104904) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 03:30:30.173733 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG oslo_db.sqlalchemy.engines [None req-eda97bbc-365d-4288-a9ae-66757631ad48 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104904) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 03:30:30.181055 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG dbcounter [-] [104904] Writer thread running {{(pid=104904) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 03:30:30.181413 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG dbcounter [-] [104904] Writer thread running {{(pid=104904) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 03:30:30.295801 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG dbcounter [-] [104903] Writer thread running {{(pid=104903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 03:30:30.305844 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: INFO dbcounter [None req-e03858b2-e3e6-4daf-baee-4a7efbc118be None None] Registered counter for database nova_cell0 Aug 04 03:30:30.314560 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG oslo_db.sqlalchemy.engines [None req-e03858b2-e3e6-4daf-baee-4a7efbc118be None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104903) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 03:30:30.319842 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG dbcounter [-] [104903] Writer thread running {{(pid=104903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 03:30:30.341001 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: INFO dbcounter [None req-eda97bbc-365d-4288-a9ae-66757631ad48 None None] Registered counter for database nova_cell0 Aug 04 03:30:30.348965 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG oslo_db.sqlalchemy.engines [None req-eda97bbc-365d-4288-a9ae-66757631ad48 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104904) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 03:30:30.353854 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG dbcounter [-] [104904] Writer thread running {{(pid=104904) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 03:30:30.798781 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: WARNING keystonemiddleware.auth_token [None req-eda97bbc-365d-4288-a9ae-66757631ad48 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 04 03:30:30.807876 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: WARNING keystonemiddleware.auth_token [None req-eda97bbc-365d-4288-a9ae-66757631ad48 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 04 03:30:30.825642 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: WARNING keystonemiddleware.auth_token [None req-e03858b2-e3e6-4daf-baee-4a7efbc118be None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 04 03:30:30.835759 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: WARNING keystonemiddleware.auth_token [None req-e03858b2-e3e6-4daf-baee-4a7efbc118be None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 04 03:30:31.165933 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: WARNING keystonemiddleware.auth_token [None req-eda97bbc-365d-4288-a9ae-66757631ad48 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 04 03:30:31.172312 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: WARNING keystonemiddleware.auth_token [None req-eda97bbc-365d-4288-a9ae-66757631ad48 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 04 03:30:31.177762 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x558771d6e9c0 pid: 104904 (default app) Aug 04 03:30:31.179788 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi [None req-eda97bbc-365d-4288-a9ae-66757631ad48 None None] Calling method '>' {{(pid=104904) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:30:31.180968 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: INFO nova.api.openstack.requestlog [None req-eda97bbc-365d-4288-a9ae-66757631ad48 None None] 10.222.0.66 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001744 Aug 04 03:30:31.181389 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: [pid: 104904|app: 0|req: 1/1] 10.222.0.66 () {50 vars in 788 bytes} [Thu Aug 4 03:30:31 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 03:30:31.214337 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: WARNING keystonemiddleware.auth_token [None req-e03858b2-e3e6-4daf-baee-4a7efbc118be None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 04 03:30:31.220340 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: WARNING keystonemiddleware.auth_token [None req-e03858b2-e3e6-4daf-baee-4a7efbc118be None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 04 03:30:31.225863 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x558771d6e9c0 pid: 104903 (default app) Aug 04 03:31:50.264697 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi [None req-eda97bbc-365d-4288-a9ae-66757631ad48 None None] Calling method '>' {{(pid=104904) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:31:50.266673 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: INFO nova.api.openstack.requestlog [None req-eda97bbc-365d-4288-a9ae-66757631ad48 None None] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002315 Aug 04 03:31:50.267720 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: [pid: 104904|app: 0|req: 2/2] 10.222.0.66 () {54 vars in 931 bytes} [Thu Aug 4 03:31:50 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 03:31:50.285193 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG dbcounter [-] [104903] Writing DB stats nova_api:SELECT=3 {{(pid=104903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:31:50.285193 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG dbcounter [-] [104903] Writing DB stats nova_cell0:SELECT=3 {{(pid=104903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:31:50.285193 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG dbcounter [-] [104903] Writing DB stats nova_cell1:SELECT=3 {{(pid=104903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:31:50.285193 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG dbcounter [-] [104903] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=104903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:31:51.171149 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi [None req-07632354-65f3-4109-b8e3-65fa4aacaafa admin admin] Calling method '>' {{(pid=104903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:31:51.203345 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: INFO nova.api.openstack.requestlog [None req-07632354-65f3-4109-b8e3-65fa4aacaafa admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.928766 Aug 04 03:31:51.204163 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: [pid: 104903|app: 0|req: 1/3] 10.222.0.66 () {60 vars in 1292 bytes} [Thu Aug 4 03:31:50 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:31:53.406025 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi [None req-eda97bbc-365d-4288-a9ae-66757631ad48 None None] Calling method '>' {{(pid=104904) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:31:53.407007 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: INFO nova.api.openstack.requestlog [None req-eda97bbc-365d-4288-a9ae-66757631ad48 None None] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001418 Aug 04 03:31:53.408112 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: [pid: 104904|app: 0|req: 3/4] 10.222.0.66 () {54 vars in 931 bytes} [Thu Aug 4 03:31:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 03:31:53.840491 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi [None req-fdb7a7fc-062c-48b2-81cc-e92b116e8a33 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "c1", "os-flavor-access:is_public": true, "ram": 256, "rxtx_factor": 1.0, "swap": 0, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "cirros256", "disk": 1}} {{(pid=104903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 03:31:53.861088 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 03:31:53.861088 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: warnings.warn(msg) Aug 04 03:31:53.943823 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: INFO nova.api.openstack.requestlog [None req-fdb7a7fc-062c-48b2-81cc-e92b116e8a33 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.530102 Aug 04 03:31:53.944585 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: [pid: 104903|app: 0|req: 2/5] 10.222.0.66 () {64 vars in 1283 bytes} [Thu Aug 4 03:31:53 2022] POST /compute/v2.1/flavors => generated 407 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 03:31:53.958696 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG dbcounter [-] [104904] Writing DB stats nova_api:SELECT=3 {{(pid=104904) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:31:53.959943 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG dbcounter [-] [104904] Writing DB stats nova_cell1:SELECT=3 {{(pid=104904) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:31:53.961043 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG dbcounter [-] [104904] Writing DB stats nova_cell0:SELECT=3 {{(pid=104904) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:31:53.961999 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG dbcounter [-] [104904] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=104904) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:31:54.167659 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi [None req-6fc2b9f1-3515-4811-bb62-e0f59b6181ed admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104904) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 03:31:54.172083 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 03:31:54.172083 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: warnings.warn(msg) Aug 04 03:31:54.309699 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: INFO nova.api.openstack.requestlog [None req-6fc2b9f1-3515-4811-bb62-e0f59b6181ed admin admin] 10.222.0.66 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.356170 Aug 04 03:31:54.310316 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: [pid: 104904|app: 0|req: 4/6] 10.222.0.66 () {64 vars in 1336 bytes} [Thu Aug 4 03:31:53 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:31:56.569453 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi [None req-fdb7a7fc-062c-48b2-81cc-e92b116e8a33 admin admin] Calling method '>' {{(pid=104903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:31:56.571135 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: INFO nova.api.openstack.requestlog [None req-fdb7a7fc-062c-48b2-81cc-e92b116e8a33 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002157 Aug 04 03:31:56.571739 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: [pid: 104903|app: 0|req: 3/7] 10.222.0.66 () {54 vars in 931 bytes} [Thu Aug 4 03:31:56 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 03:31:57.234638 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi [None req-789ece78-57a8-407e-92f8-13908cc4fb95 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "disk": 5, "name": "ds512M", "ram": 512, "id": "d1", "rxtx_factor": 1.0, "vcpus": 1, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=104904) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 03:31:57.253854 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 03:31:57.253854 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: warnings.warn(msg) Aug 04 03:31:57.357753 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: INFO nova.api.openstack.requestlog [None req-789ece78-57a8-407e-92f8-13908cc4fb95 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.779584 Aug 04 03:31:57.358561 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: [pid: 104904|app: 0|req: 5/8] 10.222.0.66 () {64 vars in 1283 bytes} [Thu Aug 4 03:31:56 2022] POST /compute/v2.1/flavors => generated 404 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 03:31:57.371344 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi [None req-e0857282-8816-4b6a-8ffb-8fb433d64f3d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 03:31:57.374274 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 03:31:57.374274 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: warnings.warn(msg) Aug 04 03:31:57.469316 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: INFO nova.api.openstack.requestlog [None req-e0857282-8816-4b6a-8ffb-8fb433d64f3d admin admin] 10.222.0.66 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.101909 Aug 04 03:31:57.470371 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: [pid: 104903|app: 0|req: 4/9] 10.222.0.66 () {64 vars in 1336 bytes} [Thu Aug 4 03:31:57 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:31:59.741620 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi [None req-789ece78-57a8-407e-92f8-13908cc4fb95 admin admin] Calling method '>' {{(pid=104904) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:31:59.742591 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: INFO nova.api.openstack.requestlog [None req-789ece78-57a8-407e-92f8-13908cc4fb95 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001697 Aug 04 03:31:59.742998 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: [pid: 104904|app: 0|req: 6/10] 10.222.0.66 () {54 vars in 931 bytes} [Thu Aug 4 03:31:59 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 03:32:00.157852 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi [None req-ee84bc46-7963-4752-84c7-2419425183bc admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "id": "d2", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "ds1G", "ram": 1024, "disk": 10, "os-flavor-access:is_public": true, "vcpus": 1}} {{(pid=104903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 03:32:00.225329 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: INFO nova.api.openstack.requestlog [None req-ee84bc46-7963-4752-84c7-2419425183bc admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.476124 Aug 04 03:32:00.225975 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: [pid: 104903|app: 0|req: 5/11] 10.222.0.66 () {64 vars in 1283 bytes} [Thu Aug 4 03:31:59 2022] POST /compute/v2.1/flavors => generated 404 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 03:32:00.239875 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi [None req-758acad5-fe47-46f5-b0ba-4fbd5918ae0d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104904) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 03:32:00.314562 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: INFO nova.api.openstack.requestlog [None req-758acad5-fe47-46f5-b0ba-4fbd5918ae0d admin admin] 10.222.0.66 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.079745 Aug 04 03:32:00.315057 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: [pid: 104904|app: 0|req: 7/12] 10.222.0.66 () {64 vars in 1336 bytes} [Thu Aug 4 03:32:00 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:32:02.524980 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi [None req-ee84bc46-7963-4752-84c7-2419425183bc admin admin] Calling method '>' {{(pid=104903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:32:02.526117 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: INFO nova.api.openstack.requestlog [None req-ee84bc46-7963-4752-84c7-2419425183bc admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001568 Aug 04 03:32:02.526520 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: [pid: 104903|app: 0|req: 6/13] 10.222.0.66 () {54 vars in 931 bytes} [Thu Aug 4 03:32:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 03:32:02.972287 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi [None req-1142fc53-bee4-40bf-af83-3550ea857ed5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d3", "disk": 10, "os-flavor-access:is_public": true, "vcpus": 2, "name": "ds2G", "rxtx_factor": 1.0, "swap": 0}} {{(pid=104904) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 03:32:03.048431 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: INFO nova.api.openstack.requestlog [None req-1142fc53-bee4-40bf-af83-3550ea857ed5 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.515971 Aug 04 03:32:03.049141 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: [pid: 104904|app: 0|req: 8/14] 10.222.0.66 () {64 vars in 1283 bytes} [Thu Aug 4 03:32:02 2022] POST /compute/v2.1/flavors => generated 404 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 03:32:03.062042 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi [None req-9a98fd5d-c478-488c-83ce-e62177a763c8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 03:32:03.161349 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: INFO nova.api.openstack.requestlog [None req-9a98fd5d-c478-488c-83ce-e62177a763c8 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.102926 Aug 04 03:32:03.174114 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: [pid: 104903|app: 0|req: 7/15] 10.222.0.66 () {64 vars in 1336 bytes} [Thu Aug 4 03:32:03 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:32:05.379109 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi [None req-1142fc53-bee4-40bf-af83-3550ea857ed5 admin admin] Calling method '>' {{(pid=104904) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:32:05.380745 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: INFO nova.api.openstack.requestlog [None req-1142fc53-bee4-40bf-af83-3550ea857ed5 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002069 Aug 04 03:32:05.381364 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: [pid: 104904|app: 0|req: 9/16] 10.222.0.66 () {54 vars in 931 bytes} [Thu Aug 4 03:32:05 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 03:32:05.816164 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi [None req-68576d1e-34cf-4fdd-ac74-d6cc2312961b admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "swap": 0, "rxtx_factor": 1.0, "name": "ds4G", "vcpus": 4, "id": "d4", "ram": 4096, "disk": 20}} {{(pid=104903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 03:32:05.894238 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: INFO nova.api.openstack.requestlog [None req-68576d1e-34cf-4fdd-ac74-d6cc2312961b admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.506943 Aug 04 03:32:05.894797 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: [pid: 104903|app: 0|req: 8/17] 10.222.0.66 () {64 vars in 1283 bytes} [Thu Aug 4 03:32:05 2022] POST /compute/v2.1/flavors => generated 404 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 03:32:05.906942 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi [None req-cbb30d13-5030-4469-97d6-a32afc42188d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104904) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 03:32:05.978155 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: INFO nova.api.openstack.requestlog [None req-cbb30d13-5030-4469-97d6-a32afc42188d admin admin] 10.222.0.66 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.074714 Aug 04 03:32:05.978763 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: [pid: 104904|app: 0|req: 10/18] 10.222.0.66 () {64 vars in 1336 bytes} [Thu Aug 4 03:32:05 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:32:08.192846 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi [None req-68576d1e-34cf-4fdd-ac74-d6cc2312961b admin admin] Calling method '>' {{(pid=104903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:32:08.193919 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: INFO nova.api.openstack.requestlog [None req-68576d1e-34cf-4fdd-ac74-d6cc2312961b admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002175 Aug 04 03:32:08.194176 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: [pid: 104903|app: 0|req: 9/19] 10.222.0.66 () {54 vars in 931 bytes} [Thu Aug 4 03:32:08 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 03:32:08.591897 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi [None req-97b38941-6714-4591-bf61-7c6df6be2a08 admin admin] Calling method '>' {{(pid=104904) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:32:08.616972 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: INFO nova.api.openstack.requestlog [None req-97b38941-6714-4591-bf61-7c6df6be2a08 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.416712 Aug 04 03:32:08.617549 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: [pid: 104904|app: 0|req: 11/20] 10.222.0.66 () {60 vars in 1292 bytes} [Thu Aug 4 03:32:08 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 03:32:11.191296 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi [None req-68576d1e-34cf-4fdd-ac74-d6cc2312961b admin admin] Calling method '>' {{(pid=104903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:32:11.192986 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: INFO nova.api.openstack.requestlog [None req-68576d1e-34cf-4fdd-ac74-d6cc2312961b admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002140 Aug 04 03:32:11.193502 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: [pid: 104903|app: 0|req: 10/21] 10.222.0.66 () {54 vars in 931 bytes} [Thu Aug 4 03:32:11 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 03:32:11.625616 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi [None req-476aa2e2-0a22-4a58-8bf9-2c42f7c3f511 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "disk": 1, "swap": 0, "os-flavor-access:is_public": true, "name": "m1.tiny", "ram": 512, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "1"}} {{(pid=104904) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 03:32:11.682436 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: INFO nova.api.openstack.requestlog [None req-476aa2e2-0a22-4a58-8bf9-2c42f7c3f511 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.482627 Aug 04 03:32:11.683007 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: [pid: 104904|app: 0|req: 12/22] 10.222.0.66 () {64 vars in 1283 bytes} [Thu Aug 4 03:32:11 2022] POST /compute/v2.1/flavors => generated 402 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 03:32:11.695745 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi [None req-7685dd68-3051-4ed5-9ab6-282de8912b66 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 03:32:11.778227 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: INFO nova.api.openstack.requestlog [None req-7685dd68-3051-4ed5-9ab6-282de8912b66 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.086536 Aug 04 03:32:11.778733 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: [pid: 104903|app: 0|req: 11/23] 10.222.0.66 () {64 vars in 1333 bytes} [Thu Aug 4 03:32:11 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:32:14.115132 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi [None req-476aa2e2-0a22-4a58-8bf9-2c42f7c3f511 admin admin] Calling method '>' {{(pid=104904) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:32:14.116185 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: INFO nova.api.openstack.requestlog [None req-476aa2e2-0a22-4a58-8bf9-2c42f7c3f511 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002236 Aug 04 03:32:14.116590 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: [pid: 104904|app: 0|req: 13/24] 10.222.0.66 () {54 vars in 931 bytes} [Thu Aug 4 03:32:14 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 03:32:14.513772 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi [None req-41d20851-0253-4760-b1b8-85d8ac2c67ce admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "name": "m1.small", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "2", "swap": 0, "vcpus": 1, "disk": 20, "ram": 2048}} {{(pid=104903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 03:32:14.591061 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: INFO nova.api.openstack.requestlog [None req-41d20851-0253-4760-b1b8-85d8ac2c67ce admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.468129 Aug 04 03:32:14.591540 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: [pid: 104903|app: 0|req: 12/25] 10.222.0.66 () {64 vars in 1283 bytes} [Thu Aug 4 03:32:14 2022] POST /compute/v2.1/flavors => generated 405 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 03:32:14.604383 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi [None req-8282e201-fd1d-463f-a164-6daf8bc0148b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104904) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 03:32:14.689875 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: INFO nova.api.openstack.requestlog [None req-8282e201-fd1d-463f-a164-6daf8bc0148b admin admin] 10.222.0.66 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.088832 Aug 04 03:32:14.690664 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: [pid: 104904|app: 0|req: 14/26] 10.222.0.66 () {64 vars in 1333 bytes} [Thu Aug 4 03:32:14 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:32:16.879226 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi [None req-41d20851-0253-4760-b1b8-85d8ac2c67ce admin admin] Calling method '>' {{(pid=104903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:32:16.880476 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: INFO nova.api.openstack.requestlog [None req-41d20851-0253-4760-b1b8-85d8ac2c67ce admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001717 Aug 04 03:32:16.880879 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: [pid: 104903|app: 0|req: 13/27] 10.222.0.66 () {54 vars in 931 bytes} [Thu Aug 4 03:32:16 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 03:32:17.255613 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi [None req-0109d429-2107-4b0c-aa61-0693ebec6964 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 40, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 4096, "id": "3", "swap": 0, "name": "m1.medium", "vcpus": 2}} {{(pid=104904) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 03:32:17.331890 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: INFO nova.api.openstack.requestlog [None req-0109d429-2107-4b0c-aa61-0693ebec6964 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.444664 Aug 04 03:32:17.333117 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: [pid: 104904|app: 0|req: 15/28] 10.222.0.66 () {64 vars in 1283 bytes} [Thu Aug 4 03:32:16 2022] POST /compute/v2.1/flavors => generated 406 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 03:32:17.345927 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi [None req-47fbf2ef-77dc-41a6-ad27-ba09cad6ef79 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 03:32:17.440717 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: INFO nova.api.openstack.requestlog [None req-47fbf2ef-77dc-41a6-ad27-ba09cad6ef79 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.099377 Aug 04 03:32:17.442420 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: [pid: 104903|app: 0|req: 14/29] 10.222.0.66 () {64 vars in 1333 bytes} [Thu Aug 4 03:32:17 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 03:32:19.704530 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi [None req-0109d429-2107-4b0c-aa61-0693ebec6964 admin admin] Calling method '>' {{(pid=104904) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:32:19.705192 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: INFO nova.api.openstack.requestlog [None req-0109d429-2107-4b0c-aa61-0693ebec6964 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Aug 04 03:32:19.706061 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: [pid: 104904|app: 0|req: 16/30] 10.222.0.66 () {54 vars in 931 bytes} [Thu Aug 4 03:32:19 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 03:32:20.228443 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi [None req-e63b783d-0efb-4bae-8bb6-6be18c57fff6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.large", "id": "4", "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 80, "ram": 8192, "os-flavor-access:is_public": true, "swap": 0, "rxtx_factor": 1.0}} {{(pid=104903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 03:32:20.296978 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: INFO nova.api.openstack.requestlog [None req-e63b783d-0efb-4bae-8bb6-6be18c57fff6 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.584012 Aug 04 03:32:20.297685 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: [pid: 104903|app: 0|req: 15/31] 10.222.0.66 () {64 vars in 1283 bytes} [Thu Aug 4 03:32:19 2022] POST /compute/v2.1/flavors => generated 405 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 03:32:20.310360 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi [None req-745ae711-8d89-4a17-bdc4-c539481f87ca admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104904) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 03:32:20.425109 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: INFO nova.api.openstack.requestlog [None req-745ae711-8d89-4a17-bdc4-c539481f87ca admin admin] 10.222.0.66 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.118469 Aug 04 03:32:20.425871 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: [pid: 104904|app: 0|req: 17/32] 10.222.0.66 () {64 vars in 1333 bytes} [Thu Aug 4 03:32:20 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:32:22.741063 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi [None req-e63b783d-0efb-4bae-8bb6-6be18c57fff6 admin admin] Calling method '>' {{(pid=104903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:32:22.742734 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: INFO nova.api.openstack.requestlog [None req-e63b783d-0efb-4bae-8bb6-6be18c57fff6 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002164 Aug 04 03:32:22.751748 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: [pid: 104903|app: 0|req: 16/33] 10.222.0.66 () {54 vars in 931 bytes} [Thu Aug 4 03:32:22 2022] GET /compute/v2.1 => generated 388 bytes in 11 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 03:32:23.308153 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi [None req-ce6d98b7-36a7-4ce4-8ab5-eba09e35bf8d admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 160, "swap": 0, "ram": 16384, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "name": "m1.xlarge", "id": "5", "vcpus": 8}} {{(pid=104904) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 03:32:23.380313 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: INFO nova.api.openstack.requestlog [None req-ce6d98b7-36a7-4ce4-8ab5-eba09e35bf8d admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.627525 Aug 04 03:32:23.380845 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: [pid: 104904|app: 0|req: 18/34] 10.222.0.66 () {64 vars in 1283 bytes} [Thu Aug 4 03:32:22 2022] POST /compute/v2.1/flavors => generated 408 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 04 03:32:23.393036 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi [None req-1a83ab49-7ffd-4eec-a67f-038d20ff7bdd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 03:32:23.401165 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG dbcounter [-] [104903] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=9,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=104903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:32:23.497585 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: INFO nova.api.openstack.requestlog [None req-1a83ab49-7ffd-4eec-a67f-038d20ff7bdd admin admin] 10.222.0.66 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.108152 Aug 04 03:32:23.498344 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: [pid: 104903|app: 0|req: 17/35] 10.222.0.66 () {64 vars in 1333 bytes} [Thu Aug 4 03:32:23 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:32:43.913027 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi [None req-ce6d98b7-36a7-4ce4-8ab5-eba09e35bf8d admin admin] Calling method '>' {{(pid=104904) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:32:43.914067 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: INFO nova.api.openstack.requestlog [None req-ce6d98b7-36a7-4ce4-8ab5-eba09e35bf8d admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 Aug 04 03:32:43.914465 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: [pid: 104904|app: 0|req: 19/36] 10.222.0.66 () {54 vars in 931 bytes} [Thu Aug 4 03:32:43 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 03:32:44.306625 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi [None req-16616752-2be3-4380-8f55-a7dbab93d9ac admin admin] Calling method '>' {{(pid=104903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:32:44.324582 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: INFO nova.api.openstack.requestlog [None req-16616752-2be3-4380-8f55-a7dbab93d9ac admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.404073 Aug 04 03:32:44.325058 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: [pid: 104903|app: 0|req: 18/37] 10.222.0.66 () {60 vars in 1292 bytes} [Thu Aug 4 03:32:43 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 03:32:45.384071 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi [None req-ce6d98b7-36a7-4ce4-8ab5-eba09e35bf8d admin admin] Calling method '>' {{(pid=104904) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:32:45.385114 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: INFO nova.api.openstack.requestlog [None req-ce6d98b7-36a7-4ce4-8ab5-eba09e35bf8d admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 Aug 04 03:32:45.385551 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: [pid: 104904|app: 0|req: 20/38] 10.222.0.66 () {56 vars in 1074 bytes} [Thu Aug 4 03:32:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 03:32:45.904377 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi [None req-baf70248-244b-4db1-8595-bffe8114fd3f admin admin] Calling method '>' {{(pid=104903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:32:45.909952 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: INFO nova.api.openstack.wsgi [None req-baf70248-244b-4db1-8595-bffe8114fd3f admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 04 03:32:45.913292 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi [None req-baf70248-244b-4db1-8595-bffe8114fd3f admin admin] Request method failure captured: Aug 04 03:32:45.913292 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 04 03:32:45.913292 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: Accept: application/json Aug 04 03:32:45.913292 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: Accept-Encoding: gzip, deflate Aug 04 03:32:45.913292 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: Connection: keep-alive Aug 04 03:32:45.913292 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: Content-Length: 0 Aug 04 03:32:45.913292 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: Host: 10.222.0.66 Aug 04 03:32:45.913292 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: Openstack-Api-Version: compute 2.90 Aug 04 03:32:45.913292 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: Openstack-System-Scope: None Aug 04 03:32:45.913292 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: User-Agent: python-novaclient Aug 04 03:32:45.913292 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: X-Auth-Token: gAAAAABi6z3d4Lv_UVmnkT-KLm5aMzBXYhbYKiSjJp9C4nBPCFcckvnDu4pWWYWmeWZ5hZVEFFOyvQu7bPK0XaOhNYzzF5oimk26iKP2lCo4np63Uo_JfXE4_07qlwHM1gpliiAGcGkql2nlFyoc5crJI6DU-Gdgd1SrSD-nKcryoU88oQ-0vzw Aug 04 03:32:45.913292 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: X-Domain-Id: None Aug 04 03:32:45.913292 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: X-Domain-Name: None Aug 04 03:32:45.913292 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: X-Identity-Status: Confirmed Aug 04 03:32:45.913292 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: X-Is-Admin-Project: True Aug 04 03:32:45.913292 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: X-Openstack-Nova-Api-Version: 2.90 Aug 04 03:32:45.913292 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: X-Project-Domain-Id: default Aug 04 03:32:45.913292 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: X-Project-Domain-Name: Default Aug 04 03:32:45.913292 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: X-Project-Id: 94f13981caf746e383601ed3304a94e7 Aug 04 03:32:45.913292 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: X-Project-Name: admin Aug 04 03:32:45.913292 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: X-Role: admin,member,reader Aug 04 03:32:45.913292 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: X-Roles: admin,member,reader Aug 04 03:32:45.914915 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/94f13981caf746e383601ed3304a94e7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/94f13981caf746e383601ed3304a94e7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/94f13981caf746e383601ed3304a94e7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_94f13981caf746e383601ed3304a94e7"}]}] Aug 04 03:32:45.914915 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: X-Tenant: admin Aug 04 03:32:45.914915 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: X-Tenant-Id: 94f13981caf746e383601ed3304a94e7 Aug 04 03:32:45.914915 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: X-Tenant-Name: admin Aug 04 03:32:45.914915 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: X-User: admin Aug 04 03:32:45.914915 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: X-User-Domain-Id: default Aug 04 03:32:45.914915 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: X-User-Domain-Name: Default Aug 04 03:32:45.914915 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: X-User-Id: 4d0f702c6dd04ac1a8cf16b1ca420f19 Aug 04 03:32:45.914915 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: X-User-Name: admin Aug 04 03:32:45.914915 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: method: > Aug 04 03:32:45.914915 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: exception: Flavor 42 could not be found. Aug 04 03:32:45.914915 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: action_args: {'id': '42'} Aug 04 03:32:45.914915 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: {{(pid=104903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 03:32:45.914915 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 03:32:45.915930 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 04 03:32:45.915930 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 04 03:32:45.915930 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 04 03:32:45.915930 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 04 03:32:45.915930 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 03:32:45.915930 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 03:32:45.915930 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 04 03:32:45.915930 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 04 03:32:45.915930 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 04 03:32:45.915930 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 03:32:45.915930 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 04 03:32:45.915930 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 04 03:32:45.915930 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 04 03:32:45.915930 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: ERROR nova.api.openstack.wsgi Aug 04 03:32:45.915930 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 03:32:45.915930 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: ERROR nova.api.openstack.wsgi Aug 04 03:32:45.915930 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 03:32:45.915930 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 03:32:45.915930 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 03:32:45.917422 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 03:32:45.917422 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 03:32:45.917422 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 03:32:45.917422 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 03:32:45.917422 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 04 03:32:45.917422 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 04 03:32:45.917422 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 04 03:32:45.917422 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: ERROR nova.api.openstack.wsgi Aug 04 03:32:45.917422 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 03:32:45.917422 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: ERROR nova.api.openstack.wsgi Aug 04 03:32:45.917422 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 03:32:45.917422 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 03:32:45.917422 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 03:32:45.917422 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 03:32:45.917422 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 03:32:45.917422 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 04 03:32:45.917422 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: ERROR nova.api.openstack.wsgi Aug 04 03:32:45.917422 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi [None req-baf70248-244b-4db1-8595-bffe8114fd3f admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=104903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 03:32:45.918687 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: INFO nova.api.openstack.requestlog [None req-baf70248-244b-4db1-8595-bffe8114fd3f admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.391279 Aug 04 03:32:45.918687 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: [pid: 104903|app: 0|req: 19/39] 10.222.0.66 () {60 vars in 1190 bytes} [Thu Aug 4 03:32:45 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 393 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 04 03:32:45.924412 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi [None req-4ef8aea2-252f-401e-94b8-c37e51d0fbf1 admin admin] Calling method '>' {{(pid=104904) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:32:45.929276 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG dbcounter [-] [104904] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=104904) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:32:45.947895 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: INFO nova.api.openstack.requestlog [None req-4ef8aea2-252f-401e-94b8-c37e51d0fbf1 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026993 Aug 04 03:32:45.948429 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: [pid: 104904|app: 0|req: 21/40] 10.222.0.66 () {60 vars in 1210 bytes} [Thu Aug 4 03:32:45 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 03:32:45.958164 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi [None req-7fa1aa8d-7896-4145-82d2-8141117b80a0 admin admin] Calling method '>' {{(pid=104903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:32:45.982316 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: INFO nova.api.openstack.requestlog [None req-7fa1aa8d-7896-4145-82d2-8141117b80a0 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027699 Aug 04 03:32:45.982874 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: [pid: 104903|app: 0|req: 20/41] 10.222.0.66 () {60 vars in 1210 bytes} [Thu Aug 4 03:32:45 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 03:32:45.992747 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi [None req-ddca2037-2725-4312-9fac-e52653ef54c9 admin admin] Calling method '>' {{(pid=104904) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:32:45.998941 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: INFO nova.api.openstack.wsgi [None req-ddca2037-2725-4312-9fac-e52653ef54c9 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 04 03:32:46.002163 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi [None req-ddca2037-2725-4312-9fac-e52653ef54c9 admin admin] Request method failure captured: Aug 04 03:32:46.002163 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 04 03:32:46.002163 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: Accept: application/json Aug 04 03:32:46.002163 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: Accept-Encoding: gzip, deflate Aug 04 03:32:46.002163 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: Connection: keep-alive Aug 04 03:32:46.002163 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: Content-Length: 0 Aug 04 03:32:46.002163 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: Host: 10.222.0.66 Aug 04 03:32:46.002163 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: Openstack-Api-Version: compute 2.90 Aug 04 03:32:46.002163 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: Openstack-System-Scope: None Aug 04 03:32:46.002163 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: User-Agent: python-novaclient Aug 04 03:32:46.002163 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: X-Auth-Token: gAAAAABi6z3d4Lv_UVmnkT-KLm5aMzBXYhbYKiSjJp9C4nBPCFcckvnDu4pWWYWmeWZ5hZVEFFOyvQu7bPK0XaOhNYzzF5oimk26iKP2lCo4np63Uo_JfXE4_07qlwHM1gpliiAGcGkql2nlFyoc5crJI6DU-Gdgd1SrSD-nKcryoU88oQ-0vzw Aug 04 03:32:46.002163 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: X-Domain-Id: None Aug 04 03:32:46.002163 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: X-Domain-Name: None Aug 04 03:32:46.002163 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: X-Identity-Status: Confirmed Aug 04 03:32:46.002163 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: X-Is-Admin-Project: True Aug 04 03:32:46.002163 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: X-Openstack-Nova-Api-Version: 2.90 Aug 04 03:32:46.002163 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: X-Project-Domain-Id: default Aug 04 03:32:46.002163 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: X-Project-Domain-Name: Default Aug 04 03:32:46.002163 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: X-Project-Id: 94f13981caf746e383601ed3304a94e7 Aug 04 03:32:46.002163 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: X-Project-Name: admin Aug 04 03:32:46.002163 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: X-Role: admin,member,reader Aug 04 03:32:46.002163 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: X-Roles: admin,member,reader Aug 04 03:32:46.003642 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/94f13981caf746e383601ed3304a94e7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/94f13981caf746e383601ed3304a94e7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/94f13981caf746e383601ed3304a94e7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_94f13981caf746e383601ed3304a94e7"}]}] Aug 04 03:32:46.003642 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: X-Tenant: admin Aug 04 03:32:46.003642 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: X-Tenant-Id: 94f13981caf746e383601ed3304a94e7 Aug 04 03:32:46.003642 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: X-Tenant-Name: admin Aug 04 03:32:46.003642 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: X-User: admin Aug 04 03:32:46.003642 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: X-User-Domain-Id: default Aug 04 03:32:46.003642 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: X-User-Domain-Name: Default Aug 04 03:32:46.003642 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: X-User-Id: 4d0f702c6dd04ac1a8cf16b1ca420f19 Aug 04 03:32:46.003642 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: X-User-Name: admin Aug 04 03:32:46.003642 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: method: > Aug 04 03:32:46.003642 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: exception: Flavor 42 could not be found. Aug 04 03:32:46.003642 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: action_args: {'id': '42'} Aug 04 03:32:46.003642 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: {{(pid=104904) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 03:32:46.003642 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 03:32:46.004609 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 04 03:32:46.004609 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 04 03:32:46.004609 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 04 03:32:46.004609 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 04 03:32:46.004609 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 03:32:46.004609 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 03:32:46.004609 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 04 03:32:46.004609 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 04 03:32:46.004609 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 04 03:32:46.004609 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 03:32:46.004609 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 04 03:32:46.004609 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 04 03:32:46.004609 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 04 03:32:46.004609 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: ERROR nova.api.openstack.wsgi Aug 04 03:32:46.004609 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 03:32:46.004609 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: ERROR nova.api.openstack.wsgi Aug 04 03:32:46.004609 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 03:32:46.004609 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 03:32:46.004609 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 03:32:46.008086 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 03:32:46.008086 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 03:32:46.008086 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 03:32:46.008086 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 03:32:46.008086 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 04 03:32:46.008086 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 04 03:32:46.008086 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 04 03:32:46.008086 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: ERROR nova.api.openstack.wsgi Aug 04 03:32:46.008086 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 03:32:46.008086 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: ERROR nova.api.openstack.wsgi Aug 04 03:32:46.008086 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 03:32:46.008086 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 03:32:46.008086 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 03:32:46.008086 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 03:32:46.008086 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 03:32:46.008086 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 04 03:32:46.008086 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: ERROR nova.api.openstack.wsgi Aug 04 03:32:46.008086 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi [None req-ddca2037-2725-4312-9fac-e52653ef54c9 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=104904) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 03:32:46.009392 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: INFO nova.api.openstack.requestlog [None req-ddca2037-2725-4312-9fac-e52653ef54c9 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014933 Aug 04 03:32:46.009392 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: [pid: 104904|app: 0|req: 22/42] 10.222.0.66 () {60 vars in 1190 bytes} [Thu Aug 4 03:32:45 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 04 03:32:46.972684 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi [None req-7fa1aa8d-7896-4145-82d2-8141117b80a0 admin admin] Calling method '>' {{(pid=104903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:32:46.973737 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: INFO nova.api.openstack.requestlog [None req-7fa1aa8d-7896-4145-82d2-8141117b80a0 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001490 Aug 04 03:32:46.974295 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: [pid: 104903|app: 0|req: 21/43] 10.222.0.66 () {56 vars in 1074 bytes} [Thu Aug 4 03:32:46 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 03:32:47.497088 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi [None req-692a4c0a-ce83-4f60-99c9-62a9bc20d5b7 admin admin] Calling method '>' {{(pid=104904) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:32:47.502498 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: INFO nova.api.openstack.wsgi [None req-692a4c0a-ce83-4f60-99c9-62a9bc20d5b7 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 04 03:32:47.503992 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi [None req-692a4c0a-ce83-4f60-99c9-62a9bc20d5b7 admin admin] Request method failure captured: Aug 04 03:32:47.503992 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 04 03:32:47.503992 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: Accept: application/json Aug 04 03:32:47.503992 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: Accept-Encoding: gzip, deflate Aug 04 03:32:47.503992 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: Connection: keep-alive Aug 04 03:32:47.503992 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: Content-Length: 0 Aug 04 03:32:47.503992 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: Host: 10.222.0.66 Aug 04 03:32:47.503992 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: Openstack-Api-Version: compute 2.90 Aug 04 03:32:47.503992 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: Openstack-System-Scope: None Aug 04 03:32:47.503992 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: User-Agent: python-novaclient Aug 04 03:32:47.503992 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: X-Auth-Token: gAAAAABi6z3eIK4HL92XMP4P4BgSJHWS-LNO_na9kHRkFCct2E4S-cRUr2Z_N74LFoRA678aFBxc-16HW_l2QDBBfZndptUVLcq351lfpIcoxy-o5sm3YG6M_vqW88vMdyOq7Ll5piOKZ8uhcHzVmZAt3aiu43tZvEpADbxOSROu2UeatvH4R2U Aug 04 03:32:47.503992 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: X-Domain-Id: None Aug 04 03:32:47.503992 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: X-Domain-Name: None Aug 04 03:32:47.503992 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: X-Identity-Status: Confirmed Aug 04 03:32:47.503992 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: X-Is-Admin-Project: True Aug 04 03:32:47.503992 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: X-Openstack-Nova-Api-Version: 2.90 Aug 04 03:32:47.503992 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: X-Project-Domain-Id: default Aug 04 03:32:47.503992 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: X-Project-Domain-Name: Default Aug 04 03:32:47.503992 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: X-Project-Id: 94f13981caf746e383601ed3304a94e7 Aug 04 03:32:47.503992 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: X-Project-Name: admin Aug 04 03:32:47.503992 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: X-Role: admin,member,reader Aug 04 03:32:47.503992 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: X-Roles: admin,member,reader Aug 04 03:32:47.505817 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/94f13981caf746e383601ed3304a94e7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/94f13981caf746e383601ed3304a94e7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/94f13981caf746e383601ed3304a94e7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_94f13981caf746e383601ed3304a94e7"}]}] Aug 04 03:32:47.505817 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: X-Tenant: admin Aug 04 03:32:47.505817 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: X-Tenant-Id: 94f13981caf746e383601ed3304a94e7 Aug 04 03:32:47.505817 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: X-Tenant-Name: admin Aug 04 03:32:47.505817 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: X-User: admin Aug 04 03:32:47.505817 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: X-User-Domain-Id: default Aug 04 03:32:47.505817 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: X-User-Domain-Name: Default Aug 04 03:32:47.505817 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: X-User-Id: 4d0f702c6dd04ac1a8cf16b1ca420f19 Aug 04 03:32:47.505817 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: X-User-Name: admin Aug 04 03:32:47.505817 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: method: > Aug 04 03:32:47.505817 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: exception: Flavor 84 could not be found. Aug 04 03:32:47.505817 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: action_args: {'id': '84'} Aug 04 03:32:47.505817 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: {{(pid=104904) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 03:32:47.505817 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 03:32:47.506857 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 04 03:32:47.506857 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 04 03:32:47.506857 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 04 03:32:47.506857 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 04 03:32:47.506857 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 03:32:47.506857 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 03:32:47.506857 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 04 03:32:47.506857 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 04 03:32:47.506857 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 04 03:32:47.506857 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 03:32:47.506857 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 04 03:32:47.506857 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 04 03:32:47.506857 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 04 03:32:47.506857 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: ERROR nova.api.openstack.wsgi Aug 04 03:32:47.506857 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 03:32:47.506857 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: ERROR nova.api.openstack.wsgi Aug 04 03:32:47.506857 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 03:32:47.506857 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 03:32:47.506857 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 03:32:47.508278 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 03:32:47.508278 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 03:32:47.508278 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 03:32:47.508278 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 03:32:47.508278 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 04 03:32:47.508278 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 04 03:32:47.508278 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 04 03:32:47.508278 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: ERROR nova.api.openstack.wsgi Aug 04 03:32:47.508278 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 03:32:47.508278 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: ERROR nova.api.openstack.wsgi Aug 04 03:32:47.508278 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 03:32:47.508278 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 03:32:47.508278 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 03:32:47.508278 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 03:32:47.508278 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 03:32:47.508278 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 04 03:32:47.508278 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: ERROR nova.api.openstack.wsgi Aug 04 03:32:47.508278 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi [None req-692a4c0a-ce83-4f60-99c9-62a9bc20d5b7 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=104904) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 03:32:47.509575 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: INFO nova.api.openstack.requestlog [None req-692a4c0a-ce83-4f60-99c9-62a9bc20d5b7 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.393749 Aug 04 03:32:47.509575 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: [pid: 104904|app: 0|req: 23/44] 10.222.0.66 () {60 vars in 1190 bytes} [Thu Aug 4 03:32:47 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 395 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 04 03:32:47.515232 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi [None req-26ca9439-9bd5-4dfb-a5fb-42860b451089 admin admin] Calling method '>' {{(pid=104903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:32:47.529967 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: INFO nova.api.openstack.requestlog [None req-26ca9439-9bd5-4dfb-a5fb-42860b451089 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018313 Aug 04 03:32:47.530494 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: [pid: 104903|app: 0|req: 22/45] 10.222.0.66 () {60 vars in 1210 bytes} [Thu Aug 4 03:32:47 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 03:32:47.540471 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi [None req-00018330-3e00-41df-9b8b-54389ddbc728 admin admin] Calling method '>' {{(pid=104904) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:32:47.556044 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: INFO nova.api.openstack.requestlog [None req-00018330-3e00-41df-9b8b-54389ddbc728 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019743 Aug 04 03:32:47.556579 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: [pid: 104904|app: 0|req: 24/46] 10.222.0.66 () {60 vars in 1210 bytes} [Thu Aug 4 03:32:47 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 03:32:47.565907 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi [None req-b927ebd7-920e-4135-92ee-343ab8f2e562 admin admin] Calling method '>' {{(pid=104903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:32:47.571313 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: INFO nova.api.openstack.wsgi [None req-b927ebd7-920e-4135-92ee-343ab8f2e562 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 04 03:32:47.572819 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi [None req-b927ebd7-920e-4135-92ee-343ab8f2e562 admin admin] Request method failure captured: Aug 04 03:32:47.572819 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 04 03:32:47.572819 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: Accept: application/json Aug 04 03:32:47.572819 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: Accept-Encoding: gzip, deflate Aug 04 03:32:47.572819 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: Connection: keep-alive Aug 04 03:32:47.572819 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: Content-Length: 0 Aug 04 03:32:47.572819 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: Host: 10.222.0.66 Aug 04 03:32:47.572819 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: Openstack-Api-Version: compute 2.90 Aug 04 03:32:47.572819 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: Openstack-System-Scope: None Aug 04 03:32:47.572819 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: User-Agent: python-novaclient Aug 04 03:32:47.572819 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: X-Auth-Token: gAAAAABi6z3eIK4HL92XMP4P4BgSJHWS-LNO_na9kHRkFCct2E4S-cRUr2Z_N74LFoRA678aFBxc-16HW_l2QDBBfZndptUVLcq351lfpIcoxy-o5sm3YG6M_vqW88vMdyOq7Ll5piOKZ8uhcHzVmZAt3aiu43tZvEpADbxOSROu2UeatvH4R2U Aug 04 03:32:47.572819 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: X-Domain-Id: None Aug 04 03:32:47.572819 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: X-Domain-Name: None Aug 04 03:32:47.572819 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: X-Identity-Status: Confirmed Aug 04 03:32:47.572819 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: X-Is-Admin-Project: True Aug 04 03:32:47.572819 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: X-Openstack-Nova-Api-Version: 2.90 Aug 04 03:32:47.572819 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: X-Project-Domain-Id: default Aug 04 03:32:47.572819 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: X-Project-Domain-Name: Default Aug 04 03:32:47.572819 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: X-Project-Id: 94f13981caf746e383601ed3304a94e7 Aug 04 03:32:47.572819 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: X-Project-Name: admin Aug 04 03:32:47.572819 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: X-Role: admin,member,reader Aug 04 03:32:47.572819 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: X-Roles: admin,member,reader Aug 04 03:32:47.574440 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/94f13981caf746e383601ed3304a94e7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/94f13981caf746e383601ed3304a94e7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/94f13981caf746e383601ed3304a94e7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_94f13981caf746e383601ed3304a94e7"}]}] Aug 04 03:32:47.574440 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: X-Tenant: admin Aug 04 03:32:47.574440 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: X-Tenant-Id: 94f13981caf746e383601ed3304a94e7 Aug 04 03:32:47.574440 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: X-Tenant-Name: admin Aug 04 03:32:47.574440 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: X-User: admin Aug 04 03:32:47.574440 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: X-User-Domain-Id: default Aug 04 03:32:47.574440 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: X-User-Domain-Name: Default Aug 04 03:32:47.574440 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: X-User-Id: 4d0f702c6dd04ac1a8cf16b1ca420f19 Aug 04 03:32:47.574440 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: X-User-Name: admin Aug 04 03:32:47.574440 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: method: > Aug 04 03:32:47.574440 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: exception: Flavor 84 could not be found. Aug 04 03:32:47.574440 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: action_args: {'id': '84'} Aug 04 03:32:47.574440 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: {{(pid=104903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 03:32:47.574440 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 03:32:47.575345 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 04 03:32:47.575345 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 04 03:32:47.575345 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 04 03:32:47.575345 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 04 03:32:47.575345 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 03:32:47.575345 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 03:32:47.575345 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 04 03:32:47.575345 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 04 03:32:47.575345 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 04 03:32:47.575345 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 03:32:47.575345 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 04 03:32:47.575345 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 04 03:32:47.575345 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 04 03:32:47.575345 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: ERROR nova.api.openstack.wsgi Aug 04 03:32:47.575345 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 03:32:47.575345 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: ERROR nova.api.openstack.wsgi Aug 04 03:32:47.575345 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 03:32:47.575345 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 03:32:47.575345 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 03:32:47.576525 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 03:32:47.576525 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 03:32:47.576525 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 03:32:47.576525 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 03:32:47.576525 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 04 03:32:47.576525 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 04 03:32:47.576525 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 04 03:32:47.576525 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: ERROR nova.api.openstack.wsgi Aug 04 03:32:47.576525 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 03:32:47.576525 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: ERROR nova.api.openstack.wsgi Aug 04 03:32:47.576525 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 03:32:47.576525 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 03:32:47.576525 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 03:32:47.576525 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 03:32:47.576525 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 03:32:47.576525 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 04 03:32:47.576525 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: ERROR nova.api.openstack.wsgi Aug 04 03:32:47.576525 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi [None req-b927ebd7-920e-4135-92ee-343ab8f2e562 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=104903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 03:32:47.577531 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: INFO nova.api.openstack.requestlog [None req-b927ebd7-920e-4135-92ee-343ab8f2e562 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011853 Aug 04 03:32:47.577531 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: [pid: 104903|app: 0|req: 23/47] 10.222.0.66 () {60 vars in 1190 bytes} [Thu Aug 4 03:32:47 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 04 03:32:48.568626 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi [None req-00018330-3e00-41df-9b8b-54389ddbc728 admin admin] Calling method '>' {{(pid=104904) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:32:48.569750 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: INFO nova.api.openstack.requestlog [None req-00018330-3e00-41df-9b8b-54389ddbc728 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001831 Aug 04 03:32:48.570173 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: [pid: 104904|app: 0|req: 25/48] 10.222.0.66 () {56 vars in 1074 bytes} [Thu Aug 4 03:32:48 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 03:32:49.094519 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi [None req-095e88c4-6065-4225-bbf7-b844842e046c admin admin] Calling method '>' {{(pid=104903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:32:49.100401 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: INFO nova.api.openstack.wsgi [None req-095e88c4-6065-4225-bbf7-b844842e046c admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 04 03:32:49.101910 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi [None req-095e88c4-6065-4225-bbf7-b844842e046c admin admin] Request method failure captured: Aug 04 03:32:49.101910 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 04 03:32:49.101910 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: Accept: application/json Aug 04 03:32:49.101910 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: Accept-Encoding: gzip, deflate Aug 04 03:32:49.101910 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: Connection: keep-alive Aug 04 03:32:49.101910 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: Content-Length: 0 Aug 04 03:32:49.101910 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: Host: 10.222.0.66 Aug 04 03:32:49.101910 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: Openstack-Api-Version: compute 2.90 Aug 04 03:32:49.101910 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: Openstack-System-Scope: None Aug 04 03:32:49.101910 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: User-Agent: python-novaclient Aug 04 03:32:49.101910 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: X-Auth-Token: gAAAAABi6z3gf16oIuyGPWwSQuMrU-uhW25E7b8h_70ArCYX1yLjnSfLYes5zvrDylljyNeq7m3eVoJUgHDsN3JanoQE5h0UXZZjO4K6awJBpl1wTEp7YwMB4EIW7GtG4q-An3rmK5H0UiMWmaUyFNRKTKjmUSx93YAT-gpj-e4W3QIU-ztehVk Aug 04 03:32:49.101910 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: X-Domain-Id: None Aug 04 03:32:49.101910 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: X-Domain-Name: None Aug 04 03:32:49.101910 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: X-Identity-Status: Confirmed Aug 04 03:32:49.101910 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: X-Is-Admin-Project: True Aug 04 03:32:49.101910 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: X-Openstack-Nova-Api-Version: 2.90 Aug 04 03:32:49.101910 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: X-Project-Domain-Id: default Aug 04 03:32:49.101910 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: X-Project-Domain-Name: Default Aug 04 03:32:49.101910 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: X-Project-Id: 94f13981caf746e383601ed3304a94e7 Aug 04 03:32:49.101910 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: X-Project-Name: admin Aug 04 03:32:49.101910 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: X-Role: admin,member,reader Aug 04 03:32:49.101910 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: X-Roles: admin,member,reader Aug 04 03:32:49.103424 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/94f13981caf746e383601ed3304a94e7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/94f13981caf746e383601ed3304a94e7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/94f13981caf746e383601ed3304a94e7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_94f13981caf746e383601ed3304a94e7"}]}] Aug 04 03:32:49.103424 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: X-Tenant: admin Aug 04 03:32:49.103424 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: X-Tenant-Id: 94f13981caf746e383601ed3304a94e7 Aug 04 03:32:49.103424 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: X-Tenant-Name: admin Aug 04 03:32:49.103424 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: X-User: admin Aug 04 03:32:49.103424 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: X-User-Domain-Id: default Aug 04 03:32:49.103424 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: X-User-Domain-Name: Default Aug 04 03:32:49.103424 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: X-User-Id: 4d0f702c6dd04ac1a8cf16b1ca420f19 Aug 04 03:32:49.103424 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: X-User-Name: admin Aug 04 03:32:49.103424 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: method: > Aug 04 03:32:49.103424 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: exception: Flavor 451 could not be found. Aug 04 03:32:49.103424 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: action_args: {'id': '451'} Aug 04 03:32:49.103424 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: {{(pid=104903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 03:32:49.103424 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 03:32:49.104362 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 04 03:32:49.104362 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 04 03:32:49.104362 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 04 03:32:49.104362 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 04 03:32:49.104362 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 03:32:49.104362 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 03:32:49.104362 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 04 03:32:49.104362 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 04 03:32:49.104362 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 04 03:32:49.104362 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 03:32:49.104362 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 04 03:32:49.104362 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 04 03:32:49.104362 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 04 03:32:49.104362 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: ERROR nova.api.openstack.wsgi Aug 04 03:32:49.104362 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 03:32:49.104362 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: ERROR nova.api.openstack.wsgi Aug 04 03:32:49.104362 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 03:32:49.104362 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 03:32:49.104362 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 03:32:49.111134 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 03:32:49.111134 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 03:32:49.111134 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 03:32:49.111134 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 03:32:49.111134 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 04 03:32:49.111134 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 04 03:32:49.111134 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 04 03:32:49.111134 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: ERROR nova.api.openstack.wsgi Aug 04 03:32:49.111134 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 03:32:49.111134 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: ERROR nova.api.openstack.wsgi Aug 04 03:32:49.111134 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 03:32:49.111134 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 03:32:49.111134 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 03:32:49.111134 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 03:32:49.111134 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 03:32:49.111134 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 04 03:32:49.111134 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: ERROR nova.api.openstack.wsgi Aug 04 03:32:49.111134 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi [None req-095e88c4-6065-4225-bbf7-b844842e046c admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=104903) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 03:32:49.112347 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: INFO nova.api.openstack.requestlog [None req-095e88c4-6065-4225-bbf7-b844842e046c admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.392634 Aug 04 03:32:49.112347 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: [pid: 104903|app: 0|req: 24/49] 10.222.0.66 () {60 vars in 1193 bytes} [Thu Aug 4 03:32:48 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 394 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 04 03:32:49.113386 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi [None req-dfd838bd-4c79-4363-9de3-e1f8a1aff364 admin admin] Calling method '>' {{(pid=104904) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:32:49.128384 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: INFO nova.api.openstack.requestlog [None req-dfd838bd-4c79-4363-9de3-e1f8a1aff364 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018568 Aug 04 03:32:49.128931 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: [pid: 104904|app: 0|req: 26/50] 10.222.0.66 () {60 vars in 1210 bytes} [Thu Aug 4 03:32:49 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 03:32:49.138889 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi [None req-1efbaabd-09a4-4b38-9706-cc8c4f1735df admin admin] Calling method '>' {{(pid=104903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:32:49.154678 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: INFO nova.api.openstack.requestlog [None req-1efbaabd-09a4-4b38-9706-cc8c4f1735df admin admin] 10.222.0.66 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019310 Aug 04 03:32:49.155202 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: [pid: 104903|app: 0|req: 25/51] 10.222.0.66 () {60 vars in 1210 bytes} [Thu Aug 4 03:32:49 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 03:32:49.165359 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi [None req-9cbc8f0b-b43a-43d8-9bd1-b4b74cd485ee admin admin] Calling method '>' {{(pid=104904) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:32:49.170791 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: INFO nova.api.openstack.wsgi [None req-9cbc8f0b-b43a-43d8-9bd1-b4b74cd485ee admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 04 03:32:49.172303 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi [None req-9cbc8f0b-b43a-43d8-9bd1-b4b74cd485ee admin admin] Request method failure captured: Aug 04 03:32:49.172303 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 04 03:32:49.172303 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: Accept: application/json Aug 04 03:32:49.172303 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: Accept-Encoding: gzip, deflate Aug 04 03:32:49.172303 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: Connection: keep-alive Aug 04 03:32:49.172303 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: Content-Length: 0 Aug 04 03:32:49.172303 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: Host: 10.222.0.66 Aug 04 03:32:49.172303 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: Openstack-Api-Version: compute 2.90 Aug 04 03:32:49.172303 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: Openstack-System-Scope: None Aug 04 03:32:49.172303 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: User-Agent: python-novaclient Aug 04 03:32:49.172303 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: X-Auth-Token: gAAAAABi6z3gf16oIuyGPWwSQuMrU-uhW25E7b8h_70ArCYX1yLjnSfLYes5zvrDylljyNeq7m3eVoJUgHDsN3JanoQE5h0UXZZjO4K6awJBpl1wTEp7YwMB4EIW7GtG4q-An3rmK5H0UiMWmaUyFNRKTKjmUSx93YAT-gpj-e4W3QIU-ztehVk Aug 04 03:32:49.172303 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: X-Domain-Id: None Aug 04 03:32:49.172303 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: X-Domain-Name: None Aug 04 03:32:49.172303 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: X-Identity-Status: Confirmed Aug 04 03:32:49.172303 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: X-Is-Admin-Project: True Aug 04 03:32:49.172303 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: X-Openstack-Nova-Api-Version: 2.90 Aug 04 03:32:49.172303 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: X-Project-Domain-Id: default Aug 04 03:32:49.172303 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: X-Project-Domain-Name: Default Aug 04 03:32:49.172303 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: X-Project-Id: 94f13981caf746e383601ed3304a94e7 Aug 04 03:32:49.172303 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: X-Project-Name: admin Aug 04 03:32:49.172303 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: X-Role: admin,member,reader Aug 04 03:32:49.172303 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: X-Roles: admin,member,reader Aug 04 03:32:49.173845 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/94f13981caf746e383601ed3304a94e7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/94f13981caf746e383601ed3304a94e7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/94f13981caf746e383601ed3304a94e7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_94f13981caf746e383601ed3304a94e7"}]}] Aug 04 03:32:49.173845 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: X-Tenant: admin Aug 04 03:32:49.173845 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: X-Tenant-Id: 94f13981caf746e383601ed3304a94e7 Aug 04 03:32:49.173845 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: X-Tenant-Name: admin Aug 04 03:32:49.173845 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: X-User: admin Aug 04 03:32:49.173845 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: X-User-Domain-Id: default Aug 04 03:32:49.173845 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: X-User-Domain-Name: Default Aug 04 03:32:49.173845 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: X-User-Id: 4d0f702c6dd04ac1a8cf16b1ca420f19 Aug 04 03:32:49.173845 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: X-User-Name: admin Aug 04 03:32:49.173845 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: method: > Aug 04 03:32:49.173845 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: exception: Flavor 451 could not be found. Aug 04 03:32:49.173845 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: action_args: {'id': '451'} Aug 04 03:32:49.173845 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: {{(pid=104904) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 03:32:49.173845 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 03:32:49.175349 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 04 03:32:49.175349 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 04 03:32:49.175349 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 04 03:32:49.175349 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 04 03:32:49.175349 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 03:32:49.175349 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 03:32:49.175349 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 04 03:32:49.175349 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 04 03:32:49.175349 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 04 03:32:49.175349 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 03:32:49.175349 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 04 03:32:49.175349 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 04 03:32:49.175349 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 04 03:32:49.175349 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: ERROR nova.api.openstack.wsgi Aug 04 03:32:49.175349 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 03:32:49.175349 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: ERROR nova.api.openstack.wsgi Aug 04 03:32:49.175349 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 03:32:49.175349 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 03:32:49.175349 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 03:32:49.176762 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 03:32:49.176762 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 03:32:49.176762 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 03:32:49.176762 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 03:32:49.176762 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 04 03:32:49.176762 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 04 03:32:49.176762 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 04 03:32:49.176762 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: ERROR nova.api.openstack.wsgi Aug 04 03:32:49.176762 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 03:32:49.176762 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: ERROR nova.api.openstack.wsgi Aug 04 03:32:49.176762 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 03:32:49.176762 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 03:32:49.176762 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 03:32:49.176762 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 03:32:49.176762 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 03:32:49.176762 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 04 03:32:49.176762 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: ERROR nova.api.openstack.wsgi Aug 04 03:32:49.176762 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi [None req-9cbc8f0b-b43a-43d8-9bd1-b4b74cd485ee admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=104904) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 03:32:49.178104 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: INFO nova.api.openstack.requestlog [None req-9cbc8f0b-b43a-43d8-9bd1-b4b74cd485ee admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012427 Aug 04 03:32:49.178104 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: [pid: 104904|app: 0|req: 27/52] 10.222.0.66 () {60 vars in 1193 bytes} [Thu Aug 4 03:32:49 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 04 03:32:50.137347 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi [None req-1efbaabd-09a4-4b38-9706-cc8c4f1735df admin admin] Calling method '>' {{(pid=104903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:32:50.138396 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: INFO nova.api.openstack.requestlog [None req-1efbaabd-09a4-4b38-9706-cc8c4f1735df admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001492 Aug 04 03:32:50.138787 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: [pid: 104903|app: 0|req: 26/53] 10.222.0.66 () {56 vars in 1074 bytes} [Thu Aug 4 03:32:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 03:32:50.673762 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi [None req-8648f78f-8270-4601-9a4f-54addd1b965c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104904) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 03:32:50.754666 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: INFO nova.api.openstack.requestlog [None req-8648f78f-8270-4601-9a4f-54addd1b965c admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.470936 Aug 04 03:32:50.755760 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: [pid: 104904|app: 0|req: 28/54] 10.222.0.66 () {64 vars in 1235 bytes} [Thu Aug 4 03:32:50 2022] POST /compute/v2.1/flavors => generated 404 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 03:32:51.741532 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi [None req-1efbaabd-09a4-4b38-9706-cc8c4f1735df admin admin] Calling method '>' {{(pid=104903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:32:51.742536 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: INFO nova.api.openstack.requestlog [None req-1efbaabd-09a4-4b38-9706-cc8c4f1735df admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 Aug 04 03:32:51.742931 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: [pid: 104903|app: 0|req: 27/55] 10.222.0.66 () {56 vars in 1074 bytes} [Thu Aug 4 03:32:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 03:32:52.267204 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi [None req-7aa878b7-fd86-465d-b82f-67489966cbb1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104904) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 03:32:52.337904 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: INFO nova.api.openstack.requestlog [None req-7aa878b7-fd86-465d-b82f-67489966cbb1 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.455771 Aug 04 03:32:52.338465 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: [pid: 104904|app: 0|req: 29/56] 10.222.0.66 () {64 vars in 1235 bytes} [Thu Aug 4 03:32:51 2022] POST /compute/v2.1/flavors => generated 405 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 03:32:53.314454 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi [None req-1efbaabd-09a4-4b38-9706-cc8c4f1735df admin admin] Calling method '>' {{(pid=104903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:32:53.315446 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: INFO nova.api.openstack.requestlog [None req-1efbaabd-09a4-4b38-9706-cc8c4f1735df admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001411 Aug 04 03:32:53.315837 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: [pid: 104903|app: 0|req: 28/57] 10.222.0.66 () {56 vars in 1074 bytes} [Thu Aug 4 03:32:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 03:32:53.834692 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi [None req-9486d99a-65c3-4dc1-bfff-505a6442f1ce admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104904) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 03:32:53.915602 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: INFO nova.api.openstack.requestlog [None req-9486d99a-65c3-4dc1-bfff-505a6442f1ce admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.459746 Aug 04 03:32:53.916104 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: [pid: 104904|app: 0|req: 30/58] 10.222.0.66 () {64 vars in 1235 bytes} [Thu Aug 4 03:32:53 2022] POST /compute/v2.1/flavors => generated 407 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 03:32:54.887751 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi [None req-1efbaabd-09a4-4b38-9706-cc8c4f1735df admin admin] Calling method '>' {{(pid=104903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:32:54.888775 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: INFO nova.api.openstack.requestlog [None req-1efbaabd-09a4-4b38-9706-cc8c4f1735df admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 Aug 04 03:32:54.889160 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: [pid: 104903|app: 0|req: 29/59] 10.222.0.66 () {56 vars in 1074 bytes} [Thu Aug 4 03:32:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 03:32:55.418152 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi [None req-0da96a06-ff32-4509-ac66-8a618b23d211 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104904) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 03:32:55.492773 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: INFO nova.api.openstack.requestlog [None req-0da96a06-ff32-4509-ac66-8a618b23d211 admin admin] 10.222.0.66 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.461991 Aug 04 03:32:55.493796 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: [pid: 104904|app: 0|req: 31/60] 10.222.0.66 () {64 vars in 1235 bytes} [Thu Aug 4 03:32:55 2022] POST /compute/v2.1/flavors => generated 409 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 03:32:56.475337 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi [None req-1efbaabd-09a4-4b38-9706-cc8c4f1735df admin admin] Calling method '>' {{(pid=104903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:32:56.476371 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: INFO nova.api.openstack.requestlog [None req-1efbaabd-09a4-4b38-9706-cc8c4f1735df admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001430 Aug 04 03:32:56.476767 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: [pid: 104903|app: 0|req: 30/61] 10.222.0.66 () {56 vars in 1074 bytes} [Thu Aug 4 03:32:56 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 03:32:56.998748 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi [None req-ae5d6898-8589-434d-aa62-f0f11cb3538b admin admin] Calling method '>' {{(pid=104904) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:32:57.019595 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: INFO nova.api.openstack.requestlog [None req-ae5d6898-8589-434d-aa62-f0f11cb3538b admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.403107 Aug 04 03:32:57.020140 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: [pid: 104904|app: 0|req: 32/62] 10.222.0.66 () {60 vars in 1202 bytes} [Thu Aug 4 03:32:56 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 03:33:48.648541 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi [None req-1efbaabd-09a4-4b38-9706-cc8c4f1735df admin admin] Calling method '>' {{(pid=104903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:33:48.649684 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: INFO nova.api.openstack.requestlog [None req-1efbaabd-09a4-4b38-9706-cc8c4f1735df admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001630 Aug 04 03:33:48.650160 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: [pid: 104903|app: 0|req: 31/63] 10.222.0.66 () {54 vars in 931 bytes} [Thu Aug 4 03:33:48 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 03:33:48.660675 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG dbcounter [-] [104904] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=104904) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:33:49.040804 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi [None req-22ae214c-c663-4818-b9c8-56646ca0b612 admin admin] Calling method '>' {{(pid=104904) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:33:49.061393 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: INFO nova.api.openstack.requestlog [None req-22ae214c-c663-4818-b9c8-56646ca0b612 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.405058 Aug 04 03:33:49.061873 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: [pid: 104904|app: 0|req: 33/64] 10.222.0.66 () {60 vars in 1292 bytes} [Thu Aug 4 03:33:48 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 03:33:49.086695 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi [None req-26f0b667-6e10-47b1-b9a6-3a4df41c1f39 admin admin] Calling method '>' {{(pid=104903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:33:49.090250 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG dbcounter [-] [104903] Writing DB stats nova_api:SELECT=19,nova_api:SAVEPOINT=1,nova_api:INSERT=1,nova_api:RELEASE=1 {{(pid=104903) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:33:49.095494 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: INFO nova.api.openstack.requestlog [None req-26f0b667-6e10-47b1-b9a6-3a4df41c1f39 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013193 Aug 04 03:33:49.096026 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: [pid: 104903|app: 0|req: 32/65] 10.222.0.66 () {60 vars in 1283 bytes} [Thu Aug 4 03:33:49 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:33:49.107539 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi [None req-a2591df6-cb3c-4cc1-8ee5-3bfcaec2bd05 admin admin] Calling method '>' {{(pid=104904) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:33:49.115124 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: INFO nova.api.openstack.requestlog [None req-a2591df6-cb3c-4cc1-8ee5-3bfcaec2bd05 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011188 Aug 04 03:33:49.115638 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: [pid: 104904|app: 0|req: 34/66] 10.222.0.66 () {60 vars in 1286 bytes} [Thu Aug 4 03:33:49 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:33:49.127111 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi [None req-16a37e58-32f6-4c42-8ccc-c9e95f315356 admin admin] Calling method '>' {{(pid=104903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:33:49.135740 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: INFO nova.api.openstack.requestlog [None req-16a37e58-32f6-4c42-8ccc-c9e95f315356 admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012147 Aug 04 03:33:49.136261 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: [pid: 104903|app: 0|req: 33/67] 10.222.0.66 () {60 vars in 1286 bytes} [Thu Aug 4 03:33:49 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:33:49.148102 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi [None req-1e81b0a1-4685-44e7-b589-6f714e77fe6c admin admin] Calling method '>' {{(pid=104904) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:33:49.155704 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: INFO nova.api.openstack.requestlog [None req-1e81b0a1-4685-44e7-b589-6f714e77fe6c admin admin] 10.222.0.66 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011696 Aug 04 03:33:49.156212 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: [pid: 104904|app: 0|req: 35/68] 10.222.0.66 () {60 vars in 1283 bytes} [Thu Aug 4 03:33:49 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:37:09.585875 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi [None req-16a37e58-32f6-4c42-8ccc-c9e95f315356 admin admin] Calling method '>' {{(pid=104903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:37:09.586885 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: INFO nova.api.openstack.requestlog [None req-16a37e58-32f6-4c42-8ccc-c9e95f315356 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 Aug 04 03:37:09.587269 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: [pid: 104903|app: 0|req: 34/69] 10.222.0.66 () {56 vars in 1074 bytes} [Thu Aug 4 03:37:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 03:37:09.729260 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG dbcounter [-] [104904] Writing DB stats nova_api:SELECT=6 {{(pid=104904) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:37:09.890094 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi [None req-59ee18fe-6cb6-462a-9767-d07d31c27f1b admin admin] Calling method '>' {{(pid=104904) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:37:09.892527 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 03:37:09.892527 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: warnings.warn(msg) Aug 04 03:37:09.893772 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG oslo_concurrency.lockutils [None req-59ee18fe-6cb6-462a-9767-d07d31c27f1b admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104904) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:37:09.905784 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG oslo_concurrency.lockutils [None req-59ee18fe-6cb6-462a-9767-d07d31c27f1b admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104904) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:37:09.905784 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG oslo_concurrency.lockutils [None req-59ee18fe-6cb6-462a-9767-d07d31c27f1b admin admin] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104904) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:37:09.905784 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG oslo_concurrency.lockutils [None req-59ee18fe-6cb6-462a-9767-d07d31c27f1b admin admin] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104904) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:37:09.930276 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: INFO nova.api.openstack.requestlog [None req-59ee18fe-6cb6-462a-9767-d07d31c27f1b admin admin] 10.222.0.66 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.202490 Aug 04 03:37:09.932893 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: [pid: 104904|app: 0|req: 36/70] 10.222.0.66 () {60 vars in 1193 bytes} [Thu Aug 4 03:37:09 2022] GET /compute/v2.1/os-services => generated 794 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 03:37:10.763778 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi [None req-16a37e58-32f6-4c42-8ccc-c9e95f315356 admin admin] Calling method '>' {{(pid=104903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:37:10.764796 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: INFO nova.api.openstack.requestlog [None req-16a37e58-32f6-4c42-8ccc-c9e95f315356 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001489 Aug 04 03:37:10.765186 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: [pid: 104903|app: 0|req: 35/71] 10.222.0.66 () {56 vars in 1074 bytes} [Thu Aug 4 03:37:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 03:37:10.965606 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi [None req-08a8bd8e-93e2-4e93-9853-bdc1e0c013f6 admin admin] Calling method '>' {{(pid=104904) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:37:10.968002 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 03:37:10.968002 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: warnings.warn(msg) Aug 04 03:37:10.969254 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG oslo_concurrency.lockutils [None req-08a8bd8e-93e2-4e93-9853-bdc1e0c013f6 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104904) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:37:10.975319 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG oslo_concurrency.lockutils [None req-08a8bd8e-93e2-4e93-9853-bdc1e0c013f6 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=104904) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:37:10.975319 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG oslo_concurrency.lockutils [None req-08a8bd8e-93e2-4e93-9853-bdc1e0c013f6 admin admin] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104904) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:37:10.975319 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG oslo_concurrency.lockutils [None req-08a8bd8e-93e2-4e93-9853-bdc1e0c013f6 admin admin] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104904) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:37:10.991792 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: INFO nova.api.openstack.requestlog [None req-08a8bd8e-93e2-4e93-9853-bdc1e0c013f6 admin admin] 10.222.0.66 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.081476 Aug 04 03:37:10.992388 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: [pid: 104904|app: 0|req: 37/72] 10.222.0.66 () {60 vars in 1193 bytes} [Thu Aug 4 03:37:10 2022] GET /compute/v2.1/os-services => generated 794 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 03:37:22.230499 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi [None req-16a37e58-32f6-4c42-8ccc-c9e95f315356 admin admin] Calling method '>' {{(pid=104903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:37:22.231532 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: INFO nova.api.openstack.requestlog [None req-16a37e58-32f6-4c42-8ccc-c9e95f315356 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 Aug 04 03:37:22.231945 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: [pid: 104903|app: 0|req: 36/73] 10.222.0.66 () {56 vars in 1074 bytes} [Thu Aug 4 03:37:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 03:37:22.375110 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG dbcounter [-] [104904] Writing DB stats nova_cell0:SELECT=4 {{(pid=104904) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:37:22.375851 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG dbcounter [-] [104904] Writing DB stats nova_cell1:SELECT=4 {{(pid=104904) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:37:22.376461 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG dbcounter [-] [104904] Writing DB stats nova_api:SELECT=8 {{(pid=104904) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:37:22.424534 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi [None req-90e22997-f980-4abf-b617-652bc65911dc admin admin] Calling method '>' {{(pid=104904) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:37:22.426895 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 03:37:22.426895 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: warnings.warn(msg) Aug 04 03:37:22.428137 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG oslo_concurrency.lockutils [None req-90e22997-f980-4abf-b617-652bc65911dc admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104904) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:37:22.428582 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG oslo_concurrency.lockutils [None req-90e22997-f980-4abf-b617-652bc65911dc admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104904) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:37:22.429651 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG oslo_concurrency.lockutils [None req-90e22997-f980-4abf-b617-652bc65911dc admin admin] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104904) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:37:22.430077 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG oslo_concurrency.lockutils [None req-90e22997-f980-4abf-b617-652bc65911dc admin admin] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=104904) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:37:22.455254 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: INFO nova.api.openstack.requestlog [None req-90e22997-f980-4abf-b617-652bc65911dc admin admin] 10.222.0.66 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.90 time: 0.084573 Aug 04 03:37:22.455813 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: [pid: 104904|app: 0|req: 38/74] 10.222.0.66 () {60 vars in 1193 bytes} [Thu Aug 4 03:37:22 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 03:37:23.289264 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: DEBUG nova.api.openstack.wsgi [None req-16a37e58-32f6-4c42-8ccc-c9e95f315356 admin admin] Calling method '>' {{(pid=104903) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:37:23.290271 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: INFO nova.api.openstack.requestlog [None req-16a37e58-32f6-4c42-8ccc-c9e95f315356 admin admin] 10.222.0.66 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002040 Aug 04 03:37:23.290663 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: [pid: 104903|app: 0|req: 37/75] 10.222.0.66 () {56 vars in 1074 bytes} [Thu Aug 4 03:37:23 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 03:37:23.480918 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG nova.api.openstack.wsgi [None req-8ccab2d8-70a6-498b-b4b2-014c99af0f9e admin admin] Calling method '>' {{(pid=104904) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:37:23.483309 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 04 03:37:23.483309 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: warnings.warn(msg) Aug 04 03:37:23.484482 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG oslo_concurrency.lockutils [None req-8ccab2d8-70a6-498b-b4b2-014c99af0f9e admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104904) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:37:23.484920 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG oslo_concurrency.lockutils [None req-8ccab2d8-70a6-498b-b4b2-014c99af0f9e admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104904) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:37:23.485725 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG oslo_concurrency.lockutils [None req-8ccab2d8-70a6-498b-b4b2-014c99af0f9e admin admin] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104904) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:37:23.486147 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: DEBUG oslo_concurrency.lockutils [None req-8ccab2d8-70a6-498b-b4b2-014c99af0f9e admin admin] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104904) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:37:23.507825 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: INFO nova.api.openstack.requestlog [None req-8ccab2d8-70a6-498b-b4b2-014c99af0f9e admin admin] 10.222.0.66 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.90 time: 0.079194 Aug 04 03:37:23.508405 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: [pid: 104904|app: 0|req: 39/76] 10.222.0.66 () {60 vars in 1193 bytes} [Thu Aug 4 03:37:23 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 03:38:19.457432 dv-cinder-733062-32-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 04 03:38:19.458287 dv-cinder-733062-32-iscsi devstack@n-api.service[104898]: Thu Aug 4 03:38:19 2022 - graceful shutdown triggered... Aug 04 03:38:19.458753 dv-cinder-733062-32-iscsi devstack@n-api.service[104903]: Gracefully killing worker 1 (pid: 104903)... Aug 04 03:38:19.459801 dv-cinder-733062-32-iscsi devstack@n-api.service[104904]: Gracefully killing worker 2 (pid: 104904)... Aug 04 03:38:20.459647 dv-cinder-733062-32-iscsi devstack@n-api.service[104898]: worker 1 buried after 1 seconds Aug 04 03:38:20.459647 dv-cinder-733062-32-iscsi devstack@n-api.service[104898]: worker 2 buried after 1 seconds Aug 04 03:38:20.459647 dv-cinder-733062-32-iscsi devstack@n-api.service[104898]: goodbye to uWSGI. Aug 04 03:38:20.461218 dv-cinder-733062-32-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 04 03:38:20.461793 dv-cinder-733062-32-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 04 03:38:20.464633 dv-cinder-733062-32-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 04 03:38:20.473865 dv-cinder-733062-32-iscsi devstack@n-api.service[130239]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 04 03:38:20.476442 dv-cinder-733062-32-iscsi devstack@n-api.service[130239]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Aug 4 03:38:20 2022] *** Aug 04 03:38:20.476442 dv-cinder-733062-32-iscsi devstack@n-api.service[130239]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 04 03:38:20.476442 dv-cinder-733062-32-iscsi devstack@n-api.service[130239]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 04 03:38:20.476442 dv-cinder-733062-32-iscsi devstack@n-api.service[130239]: nodename: dv-cinder-733062-32-iscsi Aug 04 03:38:20.476442 dv-cinder-733062-32-iscsi devstack@n-api.service[130239]: machine: x86_64 Aug 04 03:38:20.476442 dv-cinder-733062-32-iscsi devstack@n-api.service[130239]: clock source: unix Aug 04 03:38:20.476442 dv-cinder-733062-32-iscsi devstack@n-api.service[130239]: pcre jit disabled Aug 04 03:38:20.476442 dv-cinder-733062-32-iscsi devstack@n-api.service[130239]: detected number of CPU cores: 4 Aug 04 03:38:20.476442 dv-cinder-733062-32-iscsi devstack@n-api.service[130239]: current working directory: / Aug 04 03:38:20.476442 dv-cinder-733062-32-iscsi devstack@n-api.service[130239]: detected binary path: /usr/bin/uwsgi-core Aug 04 03:38:20.476442 dv-cinder-733062-32-iscsi devstack@n-api.service[130239]: your processes number limit is 47680 Aug 04 03:38:20.477150 dv-cinder-733062-32-iscsi devstack@n-api.service[130239]: your memory page size is 4096 bytes Aug 04 03:38:20.477150 dv-cinder-733062-32-iscsi devstack@n-api.service[130239]: detected max file descriptor number: 2048 Aug 04 03:38:20.477150 dv-cinder-733062-32-iscsi devstack@n-api.service[130239]: lock engine: pthread robust mutexes Aug 04 03:38:20.477150 dv-cinder-733062-32-iscsi devstack@n-api.service[130239]: thunder lock: enabled Aug 04 03:38:20.477150 dv-cinder-733062-32-iscsi devstack@n-api.service[130239]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 04 03:38:20.477150 dv-cinder-733062-32-iscsi devstack@n-api.service[130239]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 04 03:38:20.515642 dv-cinder-733062-32-iscsi devstack@n-api.service[130239]: Python main interpreter initialized at 0x5645fc9389c0 Aug 04 03:38:20.515898 dv-cinder-733062-32-iscsi devstack@n-api.service[130239]: python threads support enabled Aug 04 03:38:20.516003 dv-cinder-733062-32-iscsi devstack@n-api.service[130239]: your server socket listen backlog is limited to 100 connections Aug 04 03:38:20.516097 dv-cinder-733062-32-iscsi devstack@n-api.service[130239]: your mercy for graceful operations on workers is 90 seconds Aug 04 03:38:20.516560 dv-cinder-733062-32-iscsi devstack@n-api.service[130239]: mapped 403077 bytes (393 KB) for 2 cores Aug 04 03:38:20.516822 dv-cinder-733062-32-iscsi devstack@n-api.service[130239]: *** Operational MODE: preforking *** Aug 04 03:38:20.517286 dv-cinder-733062-32-iscsi devstack@n-api.service[130239]: *** uWSGI is running in multiple interpreter mode *** Aug 04 03:38:20.517462 dv-cinder-733062-32-iscsi devstack@n-api.service[130239]: spawned uWSGI master process (pid: 130239) Aug 04 03:38:20.517829 dv-cinder-733062-32-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 04 03:38:20.519909 dv-cinder-733062-32-iscsi devstack@n-api.service[130239]: spawned uWSGI worker 1 (pid: 130262, cores: 1) Aug 04 03:38:20.519909 dv-cinder-733062-32-iscsi devstack@n-api.service[130239]: spawned uWSGI worker 2 (pid: 130263, cores: 1) Aug 04 03:38:20.519909 dv-cinder-733062-32-iscsi devstack@n-api.service[130239]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 04 03:38:21.196195 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 04 03:38:21.197026 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 04 03:38:22.362992 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 04 03:38:22.362992 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: from cryptography.utils import int_from_bytes Aug 04 03:38:22.363988 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 04 03:38:22.363988 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: from cryptography.utils import int_from_bytes Aug 04 03:38:22.367737 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 04 03:38:22.367737 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: from cryptography.utils import int_from_bytes Aug 04 03:38:22.368250 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 04 03:38:22.368250 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: from cryptography.utils import int_from_bytes Aug 04 03:38:24.729143 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 04 03:38:24.729856 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 04 03:38:24.729856 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 04 03:38:24.730366 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 04 03:38:24.730472 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 04 03:38:24.730826 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.731156 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.731482 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.731805 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.732132 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.732444 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.732762 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.733078 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.733307 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 04 03:38:24.733677 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.733767 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 04 03:38:24.733854 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.734044 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.734136 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 04 03:38:24.734296 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-733062-32-iscsi {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.734459 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 04 03:38:24.734619 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.734734 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 04 03:38:24.734906 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.735069 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.735229 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.735399 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.735515 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.735714 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.735828 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.736037 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.736137 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.736371 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.736485 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.736681 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.736879 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.736992 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.737342 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.737682 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.737944 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.738726 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.738858 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.739057 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-733062-32-iscsi {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.739182 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.739383 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.739507 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.739698 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.739809 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.740012 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.740142 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.740987 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.741096 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.741481 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.741605 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.741991 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.742110 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.742337 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.742452 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.742663 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.742939 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.743070 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-733062-32-iscsi {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.743256 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.743445 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.743552 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.743746 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.743964 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.744199 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.744401 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.744602 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.744810 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.745012 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.745241 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.745461 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.745673 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.745874 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.746086 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.746307 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.746624 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.746811 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.747003 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.747154 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-733062-32-iscsi {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.747295 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.747468 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.747468 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.747759 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.747909 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.748055 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.748226 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.748226 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.748523 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.748667 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.748811 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.748949 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.749092 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.749262 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.749416 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.749626 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.749771 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.749921 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.750065 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.750217 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.750367 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.750511 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.750658 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.750801 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.750954 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.751093 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.751230 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.751366 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.751513 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.751658 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.751817 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.751959 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.752227 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.752376 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.752526 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.752673 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.752823 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.752969 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.753113 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.753269 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.753415 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.753570 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.753718 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.753864 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.754018 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.754161 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.754304 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.754456 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.754602 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.754749 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.754888 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.755026 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.755172 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.755319 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.755462 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.755610 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.755795 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.755944 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.756093 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.756247 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.756393 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.756604 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.756762 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.756911 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.757063 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.757258 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.757404 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.757553 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.757855 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.758020 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.66 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.758170 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.758310 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.66 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.758447 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.758585 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.758730 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.758881 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.759029 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.759167 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.759428 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.66 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.759582 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.759729 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.66 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.759888 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.760029 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.760174 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.760319 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.760465 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.760620 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.760772 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.760912 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.761051 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.761189 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.761368 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.761523 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.761916 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.762097 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.762259 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.762497 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.762497 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.762776 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.762915 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.763059 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.763199 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.763336 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.763473 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.763619 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.763619 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.763902 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.764049 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.764188 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.764333 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.764480 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.764619 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.764757 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.764895 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.765039 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.765183 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.765384 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.765384 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.765656 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.765812 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.765976 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.766130 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.766276 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.766416 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.766562 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.766716 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.766861 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.767011 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.767157 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.767302 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.767441 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.767584 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.767803 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.768038 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.768186 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.768334 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.768474 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.768701 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.768852 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.769022 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.769176 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.769356 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.769498 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.769636 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.769786 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.769942 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.770090 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.770242 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.770382 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.770521 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.770657 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.770831 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.770986 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.771133 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.771271 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.771982 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.772266 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.772642 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.772825 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.772968 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.773114 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.773299 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.773455 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.773596 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.773743 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.773889 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.773889 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.774583 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.774734 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.774820 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.774904 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.774981 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.775057 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.775133 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.775305 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.775616 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.775923 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.776231 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.776538 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.776848 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.777158 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.777492 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.777654 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.777807 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.778080 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.778247 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.778395 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.778532 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.778709 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.778857 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.779005 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.779305 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.779453 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.779623 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.779776 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.779955 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.780118 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.780268 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.780416 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.780618 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.780771 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.780918 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.781058 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.781293 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.781456 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.781632 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.781780 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.781951 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.782105 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.782272 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.782515 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 04 03:38:24.782684 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.782923 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.783075 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.783236 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.783389 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.783537 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.783675 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.783820 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.783968 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.784116 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.784265 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.784406 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.784543 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.784712 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.784869 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.785016 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.785162 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.785366 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.785521 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.785691 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.785849 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.786003 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.786152 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.786302 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.786441 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.786629 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.786776 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.786958 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.787703 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.787907 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.788270 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.788430 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.788598 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.788760 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.788908 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.789068 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.789319 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.789470 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.789608 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.789760 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.789899 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.790044 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.790190 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.790381 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.790542 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.790730 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.790891 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.791063 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.791226 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.791374 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.791527 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.791719 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.791866 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.792043 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.792188 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.792359 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.792540 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.792772 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.792935 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.793170 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.793350 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.793509 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.793670 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.793819 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.793958 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.794095 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.794240 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.794392 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.794539 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.794678 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.794815 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.794953 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.795136 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.795449 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.795699 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.795848 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.796033 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.796184 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.796331 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.796481 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.796626 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.796777 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.796923 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.797062 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.797262 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.797423 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.797573 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.797711 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.797964 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.798208 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.798503 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.798659 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.798808 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.798955 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.799102 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.799240 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.799386 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.799525 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.799670 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.799821 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.799971 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.800117 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.800366 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.800513 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.800660 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.800798 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.800938 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.801075 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.801279 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.801437 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.801578 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.801722 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.801879 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.802027 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.802176 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.802316 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.802454 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.802598 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.802856 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.803187 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.803364 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.803592 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.803736 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.803883 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.804034 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.804262 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.804404 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.804543 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.804687 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.804835 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.804979 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.805134 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.805298 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.805439 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.805588 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.805741 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.805880 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.806039 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.806188 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.806328 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.806474 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.806613 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.806759 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.806905 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.807049 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.807196 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.807335 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.807482 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.807634 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.807773 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.807920 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.808149 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.808296 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.808580 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.808743 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.808887 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.809024 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.809161 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.809338 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.809487 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.809635 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.809781 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.809920 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.810076 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.810223 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.810372 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.810519 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.810665 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.810829 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.811091 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.811243 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.811398 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.811552 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.811699 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.811837 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.811975 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.812123 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.812275 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.812414 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.812554 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.812691 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.812835 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.812980 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.813267 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.813427 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.813583 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.813823 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.813979 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.814139 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.814286 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.814431 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.814570 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.814708 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.814851 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.814999 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.815145 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.815291 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.815429 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.815567 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.815704 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.815850 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.815998 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.816143 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.816289 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.816428 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.816572 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.816728 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.816867 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.817004 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.817141 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.817318 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.817474 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.817613 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.817758 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.817906 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.818083 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.818297 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.818458 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.818768 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.819103 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.819256 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.819424 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.819572 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.819750 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.819898 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.820064 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.820210 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.820381 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.820536 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.820689 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.820838 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.820977 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.821224 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.821380 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.821563 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.821719 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.821887 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.822033 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.822207 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.822364 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.822554 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.822701 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.822867 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.823029 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.823192 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.823357 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.823598 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.823743 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.823994 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.824150 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.824290 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.824428 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.824575 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.824724 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.824863 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.825659 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.825810 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.825951 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.826098 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.826238 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.826389 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.826528 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.826665 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.826810 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.826960 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.826960 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.827247 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.827394 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.827394 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.827657 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.827796 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.827940 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.828087 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.828235 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.828380 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.828519 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.828830 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.828830 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.829141 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.829315 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.829464 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.829609 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.829748 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.829900 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.830048 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.830186 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.830331 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.830477 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.830633 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.830808 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.830808 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.831088 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.831227 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.831467 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.831620 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.831769 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.831909 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.832047 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.832184 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.832330 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.832479 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.832618 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.832778 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.832925 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.833070 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.833306 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.833535 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.833794 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.834597 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.834750 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.834890 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.835035 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.835188 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.835328 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.835466 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.835617 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.835764 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.835902 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.835902 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.836182 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.836321 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.836458 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.836458 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.836730 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.836870 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.837014 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.837014 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.837359 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.837359 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.837661 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.837807 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.837955 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.838101 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.838247 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.838393 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.838545 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.838545 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.838980 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.839132 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.839279 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.839430 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.839578 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.839719 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.839864 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.840069 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.840216 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.840363 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.840510 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.840657 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.840797 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.840973 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.841120 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.841300 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.841536 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.841858 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.842014 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.842162 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.842308 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.842485 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.842642 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.842845 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.842999 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.843139 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.843275 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.843452 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.843607 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.843757 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.844021 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.844166 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.844318 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.844459 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.844615 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.844862 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.845043 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.845798 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.845949 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.846113 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.846267 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.846408 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.846566 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.846713 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.846859 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.847005 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.847152 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.847152 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.847431 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.847577 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.847724 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.847870 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.848016 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.848169 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.848319 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.848472 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.848620 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.848759 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.848897 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.849214 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.849381 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.849546 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.850276 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.850432 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.850586 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.850742 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.850899 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.851057 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.851211 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.851359 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.851518 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.851749 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.851903 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.852057 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.852204 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.852350 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.852505 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.852651 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.852651 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.852935 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.853100 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.853308 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.853475 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.853624 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.853784 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.853931 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.854084 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.854230 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.854230 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.854532 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.854679 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.855011 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.855179 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.855335 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.855483 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.855636 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.855791 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.855951 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.855951 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.856238 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.856391 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.856546 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.856691 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.856844 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.856990 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.857164 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.857337 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.857496 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.857496 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.857833 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.857980 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.858132 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.858278 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.858422 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.858578 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.858724 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.858870 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.859022 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.859326 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.859487 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.859648 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.859804 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.859953 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.860097 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.860242 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.860393 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.860548 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.860703 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.860855 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.861007 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.861154 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.861377 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.861527 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.861679 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.861908 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.862067 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.862214 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.862368 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.862530 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.862677 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.862830 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.862984 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.863131 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.863549 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.863549 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.863841 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.863993 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.864139 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.864283 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.864437 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.864583 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.864736 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.864894 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.865329 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.865571 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.865731 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.865890 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.866040 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.866185 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.866338 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.866493 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.866641 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.866793 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.866940 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.867093 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.867246 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.867400 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.867547 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.867691 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.867847 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.867994 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.868140 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.868294 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.868441 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.868585 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.868731 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.868876 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.869034 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.869182 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.869508 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.869667 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.869821 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.869985 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.870144 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.870290 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.870436 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.870581 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.870739 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.870886 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.871045 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.871192 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.871337 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.871488 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.871634 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.871787 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.872038 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.872192 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.872347 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.872500 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.872654 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.872881 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.873038 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.873192 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.873383 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.873537 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.873691 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.873850 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.874008 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.874153 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.874300 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.874452 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.874599 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.874756 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.874921 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.875075 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.875426 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.875589 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.875589 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.875879 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.875879 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.876182 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.876331 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.876484 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.876640 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.876786 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.876931 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.877083 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.877261 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.877421 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.877421 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.877713 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.877866 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.878012 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.878169 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.878316 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.878474 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.878629 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.878774 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.878920 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.879071 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.879217 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.879375 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.879618 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.879618 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.879915 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.880068 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.880242 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.880398 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.880551 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.880704 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.880879 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.881026 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.881180 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.881349 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.881495 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.881641 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.881787 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.881942 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.882185 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.882350 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.882504 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.882651 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.882796 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.882952 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.883107 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.883254 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.883408 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.883408 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.883702 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.883857 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.884004 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.884167 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.884321 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.884474 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.884629 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.884791 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.884951 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.885104 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.885300 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.885628 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.885779 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.885941 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.886098 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.886252 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.886410 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.886556 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.886701 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.886855 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.887003 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.887148 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.887293 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.887444 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.887599 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.887746 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.887897 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.888051 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.888197 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.888360 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.888516 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.888670 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.888816 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.888968 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.889122 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.889291 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.889457 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.889623 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.889775 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.889921 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.890068 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.890222 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.890389 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.890536 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.890688 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.890841 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.890995 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.891142 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.891296 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.891441 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.891586 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.891730 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.891875 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.892028 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.892203 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.892417 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.892568 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.892722 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.892876 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.893032 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.893188 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.893360 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.893507 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.893662 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.893816 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.893976 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.894123 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.894280 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.894426 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.894571 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.894724 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.894887 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.895035 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.895179 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.895333 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.895333 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.895804 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.895804 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.896102 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.896102 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.896924 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.897085 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.897308 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.897471 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.897618 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.897618 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.897895 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.898047 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.898207 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.898353 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.898506 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.898659 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.898823 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.898976 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.899136 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.899289 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.899435 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.899587 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.899733 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.899887 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.900040 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.900193 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.900341 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.900492 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.900639 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.900821 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.901062 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.901239 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.901393 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.901539 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.901686 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.901686 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.901982 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.902134 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.902286 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.902449 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.902736 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.902899 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.903087 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.903768 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.903927 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.904088 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.904244 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.904398 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.904551 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.904697 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.904845 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.904999 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.905145 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.905350 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.905497 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.905497 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.905914 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.906079 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.906235 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.906388 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.906534 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.906679 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.906934 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.907097 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.907244 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.907389 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.907534 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.907695 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.907850 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.907998 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.908143 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.908295 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.908441 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.908586 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.908741 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.908888 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.909033 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.909184 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.909367 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.909528 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.909693 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.909848 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.910003 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.910156 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.910310 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.910464 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.910611 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.910764 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.910916 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.911062 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.911209 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.911368 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.911516 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.911678 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.911832 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.912002 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.912786 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.912951 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.913101 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.913292 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.913292 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.913593 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.913593 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.913891 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.914038 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.914195 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.914349 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.914503 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.914662 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.914809 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.914954 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.915099 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.915259 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.915410 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.915569 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.915715 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.915867 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.916124 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.916288 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.916442 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.916602 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.916750 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.916920 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.917152 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.917341 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.917503 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.917651 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.917796 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.917941 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.918094 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.918242 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.918413 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.918570 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.918723 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.918876 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.919029 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.919184 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.919345 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.919495 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.919640 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.919793 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.919939 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.920084 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.920238 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.920403 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.920558 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.920712 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.920858 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.921017 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.921163 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.921362 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.921520 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.921674 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.921820 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.921975 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.922127 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.922291 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.922438 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.922592 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.922738 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.922985 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.923144 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.923293 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.923439 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.923593 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.923740 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.923894 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.924042 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.924187 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.924344 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.924492 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.924648 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.924801 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.924955 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.925102 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.925288 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.925441 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.925659 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.925817 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.925817 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.926128 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.926371 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.926542 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.926699 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.926849 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.926994 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.927158 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.927397 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.927547 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.927803 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.927981 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.928138 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.928418 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.928574 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.928747 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.928897 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.929048 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.929244 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.929402 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.929559 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.929719 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.929875 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.930023 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.930168 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.930320 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.930474 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.930629 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.930794 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.930968 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.931117 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.931270 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.931429 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.931576 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.931728 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.931873 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.932027 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.932172 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.932330 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.932477 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.932648 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.932803 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.932975 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.933223 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.933394 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.933551 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.933697 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.933842 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.933987 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.934147 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.934294 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.934446 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.934603 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.934755 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.934909 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.935072 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.935227 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.935382 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.935529 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.935673 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.935825 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.935983 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.936131 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.936284 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.936284 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.936682 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.936843 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.936998 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.937151 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.937362 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.937611 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.937763 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.937917 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.938074 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.938221 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.938374 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.938529 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.938699 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.938699 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.938992 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.939138 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.939283 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.939429 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.939589 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.939743 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.939897 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.940044 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.940190 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.940341 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.940498 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.940662 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.940810 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.940955 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.941107 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.941294 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.941459 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.941608 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.941754 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.941898 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.942052 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.942207 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.942354 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.942354 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.942651 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.942800 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.942945 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.943103 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.943360 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.943570 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.943720 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.943882 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.944037 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.944192 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.944346 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.944346 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.944636 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.944790 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.944945 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.945093 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.945272 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.945433 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.945580 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.945736 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.945904 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.946060 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.946207 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.946353 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.946543 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.946790 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.946955 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.947110 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.947257 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.947415 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.947569 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.947832 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.947985 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.948138 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.948284 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.948429 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.948585 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.948744 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.948900 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.948900 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.949220 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.949387 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.949543 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.949698 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.949854 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.950000 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.950146 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.950299 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.950446 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.950611 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.950766 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.950920 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.951065 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.951211 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.951369 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.951516 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.951661 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.951813 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.951967 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.952113 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.952267 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.952414 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.952570 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.952716 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.952861 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.953013 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.953168 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.953365 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.953524 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.953671 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.953822 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.953975 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.953975 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.954275 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.954423 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.954578 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.954724 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.954869 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.955097 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.955255 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.955413 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.955560 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.955705 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.955863 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.956010 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.956156 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.956301 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.956458 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.956604 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.956774 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.957022 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.957183 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.957377 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.957534 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.957688 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.957861 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.958095 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.958247 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.958393 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.958538 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.958706 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.959366 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.959366 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.959657 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.959805 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.959951 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.960115 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.960269 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.960417 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.960562 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.960715 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.960869 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.961029 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.961187 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.961365 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.961521 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.961667 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.961820 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.961976 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.962130 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.962278 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.962432 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.962579 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.962733 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.962880 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.963036 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.963183 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.963335 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.963491 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.963654 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.963802 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.963955 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.964102 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.964247 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.964400 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.964560 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.964716 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.964861 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.965023 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.965170 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.965358 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.965522 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.965673 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.965827 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.965981 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.966133 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.966289 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.966436 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.966583 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.966742 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.966901 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.967146 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.967315 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.967463 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.967615 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.967763 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.967908 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.968053 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.968310 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.968469 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.968624 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.968778 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.968931 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.969096 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.969278 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.969432 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.969584 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.969732 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.969885 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.970041 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.970195 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.970348 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.970503 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.970649 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.970649 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.970935 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.970935 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.971234 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.971380 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.971525 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.971670 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.971829 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.971984 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.972136 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.972283 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.972428 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.972586 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.972742 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.972907 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.973060 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.973262 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.973416 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.973580 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.973728 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.973880 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.974046 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.974194 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.974341 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.974517 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.975238 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.975407 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.975564 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.975711 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.975866 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.976014 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.976160 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.976306 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.976458 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.976605 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.976759 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.976912 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.977066 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.977335 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.977509 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.977666 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.977823 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.977977 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.978133 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.978297 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.978449 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.978605 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.978759 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.978905 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.979050 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.979240 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.979395 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.979566 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.979721 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.979876 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.980029 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.980176 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.980329 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.980486 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.980643 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.980797 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.980950 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.981098 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.981302 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.981302 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.981623 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.981771 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.981923 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.982069 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.982227 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.982375 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.982521 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.982673 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.982827 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.982974 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.983128 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.983275 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.983438 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.983592 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.983745 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.983898 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.984053 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.984201 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.984354 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.984501 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.984653 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.984874 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.985031 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.985184 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.985380 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.985533 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.985689 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.985844 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.985999 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.986146 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.986291 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.986436 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.986588 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.986744 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.986892 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.987044 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.987199 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.987380 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.987624 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.987790 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.987938 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.988083 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.988488 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.988637 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.988792 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.988945 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.989091 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.989287 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.989453 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.989620 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.989782 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.989929 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.990074 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.990254 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.990402 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.990555 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.990716 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.990871 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.991024 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.991171 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.991316 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.991469 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.991627 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.991781 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.991927 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.992072 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.992216 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.992370 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.992516 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.992516 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.992793 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.992938 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.993089 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.993264 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.993418 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.993574 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.993720 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.993875 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.994021 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.994175 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.994322 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.994468 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.994613 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.994758 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.994913 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.995060 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.995213 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.995377 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.995529 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.995676 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.995835 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.995991 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.996137 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.996137 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.996423 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.996423 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.996719 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.996874 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.997023 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.997168 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.997388 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.997551 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.997819 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.997974 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.998130 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.998280 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.998425 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.998585 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.998732 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.998879 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.999024 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.999170 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.999328 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.999485 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.999634 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.999780 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:24.999933 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=130263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 04 03:38:25.000082 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:25.000082 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:25.000082 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:25.000082 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:25.000082 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:25.000082 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:25.000082 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:25.000082 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:25.001215 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:25.001215 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:25.001215 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:25.001215 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:25.001215 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:25.001215 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:25.001215 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:25.001215 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:25.002361 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:25.002361 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:25.002361 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:25.002361 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:25.002361 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:25.002361 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:25.002361 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:25.002361 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:25.003491 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:25.003491 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:25.003491 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:25.003491 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:25.003491 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:25.003491 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:25.004331 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:25.004331 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 04 03:38:25.004331 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=130262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 04 03:38:25.147488 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO dbcounter [None req-e7840783-aac8-46be-9548-e181a12cf4d3 None None] Registered counter for database nova_api Aug 04 03:38:25.157103 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO dbcounter [None req-eb6f6dc7-da74-40e2-bc4a-f1e00df004e3 None None] Registered counter for database nova_api Aug 04 03:38:25.168570 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_db.sqlalchemy.engines [None req-e7840783-aac8-46be-9548-e181a12cf4d3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=130263) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 03:38:25.175578 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG dbcounter [-] [130263] Writer thread running {{(pid=130263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 03:38:25.177473 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_db.sqlalchemy.engines [None req-eb6f6dc7-da74-40e2-bc4a-f1e00df004e3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=130262) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 03:38:25.184072 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG dbcounter [-] [130262] Writer thread running {{(pid=130262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 03:38:25.232647 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.context [None req-e7840783-aac8-46be-9548-e181a12cf4d3 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),832e4e75-7d7f-4738-9a24-2466a2a2c834(cell1) {{(pid=130263) load_cells /opt/stack/nova/nova/context.py:464}} Aug 04 03:38:25.236705 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-e7840783-aac8-46be-9548-e181a12cf4d3 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:38:25.238626 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-e7840783-aac8-46be-9548-e181a12cf4d3 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:38:25.239468 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-e7840783-aac8-46be-9548-e181a12cf4d3 None None] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:38:25.240958 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.context [None req-eb6f6dc7-da74-40e2-bc4a-f1e00df004e3 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),832e4e75-7d7f-4738-9a24-2466a2a2c834(cell1) {{(pid=130262) load_cells /opt/stack/nova/nova/context.py:464}} Aug 04 03:38:25.241676 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-e7840783-aac8-46be-9548-e181a12cf4d3 None None] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:38:25.243666 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO dbcounter [None req-e7840783-aac8-46be-9548-e181a12cf4d3 None None] Registered counter for database nova_cell0 Aug 04 03:38:25.245087 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-eb6f6dc7-da74-40e2-bc4a-f1e00df004e3 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:38:25.246826 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-eb6f6dc7-da74-40e2-bc4a-f1e00df004e3 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:38:25.247669 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-eb6f6dc7-da74-40e2-bc4a-f1e00df004e3 None None] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:38:25.247764 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO dbcounter [None req-e7840783-aac8-46be-9548-e181a12cf4d3 None None] Registered counter for database nova_cell1 Aug 04 03:38:25.249787 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-eb6f6dc7-da74-40e2-bc4a-f1e00df004e3 None None] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:38:25.251778 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO dbcounter [None req-eb6f6dc7-da74-40e2-bc4a-f1e00df004e3 None None] Registered counter for database nova_cell0 Aug 04 03:38:25.254937 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_db.sqlalchemy.engines [None req-e7840783-aac8-46be-9548-e181a12cf4d3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=130263) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 03:38:25.256502 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO dbcounter [None req-eb6f6dc7-da74-40e2-bc4a-f1e00df004e3 None None] Registered counter for database nova_cell1 Aug 04 03:38:25.257817 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_db.sqlalchemy.engines [None req-e7840783-aac8-46be-9548-e181a12cf4d3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=130263) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 03:38:25.263775 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_db.sqlalchemy.engines [None req-eb6f6dc7-da74-40e2-bc4a-f1e00df004e3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=130262) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 03:38:25.264933 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG dbcounter [-] [130263] Writer thread running {{(pid=130263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 03:38:25.265996 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_db.sqlalchemy.engines [None req-eb6f6dc7-da74-40e2-bc4a-f1e00df004e3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=130262) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 03:38:25.267012 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG dbcounter [-] [130263] Writer thread running {{(pid=130263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 03:38:25.272018 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG dbcounter [-] [130262] Writer thread running {{(pid=130262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 03:38:25.273855 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG dbcounter [-] [130262] Writer thread running {{(pid=130262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 03:38:25.410833 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO dbcounter [None req-e7840783-aac8-46be-9548-e181a12cf4d3 None None] Registered counter for database nova_cell0 Aug 04 03:38:25.419178 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_db.sqlalchemy.engines [None req-e7840783-aac8-46be-9548-e181a12cf4d3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=130263) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 03:38:25.421937 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO dbcounter [None req-eb6f6dc7-da74-40e2-bc4a-f1e00df004e3 None None] Registered counter for database nova_cell0 Aug 04 03:38:25.424073 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG dbcounter [-] [130263] Writer thread running {{(pid=130263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 03:38:25.429926 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_db.sqlalchemy.engines [None req-eb6f6dc7-da74-40e2-bc4a-f1e00df004e3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=130262) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 04 03:38:25.437013 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG dbcounter [-] [130262] Writer thread running {{(pid=130262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 04 03:38:25.744222 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: WARNING keystonemiddleware.auth_token [None req-e7840783-aac8-46be-9548-e181a12cf4d3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 04 03:38:25.751964 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: WARNING keystonemiddleware.auth_token [None req-e7840783-aac8-46be-9548-e181a12cf4d3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 04 03:38:25.759967 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: WARNING keystonemiddleware.auth_token [None req-eb6f6dc7-da74-40e2-bc4a-f1e00df004e3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 04 03:38:25.767365 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: WARNING keystonemiddleware.auth_token [None req-eb6f6dc7-da74-40e2-bc4a-f1e00df004e3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 04 03:38:26.096634 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: WARNING keystonemiddleware.auth_token [None req-e7840783-aac8-46be-9548-e181a12cf4d3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 04 03:38:26.103257 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: WARNING keystonemiddleware.auth_token [None req-e7840783-aac8-46be-9548-e181a12cf4d3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 04 03:38:26.109680 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5645fc9389c0 pid: 130263 (default app) Aug 04 03:38:26.116355 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: WARNING keystonemiddleware.auth_token [None req-eb6f6dc7-da74-40e2-bc4a-f1e00df004e3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 04 03:38:26.122751 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: WARNING keystonemiddleware.auth_token [None req-eb6f6dc7-da74-40e2-bc4a-f1e00df004e3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 04 03:38:26.128884 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5645fc9389c0 pid: 130262 (default app) Aug 04 03:39:02.450760 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG dbcounter [-] [130263] Writing DB stats nova_api:SELECT=3 {{(pid=130263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:39:02.451745 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG dbcounter [-] [130263] Writing DB stats nova_cell0:SELECT=3 {{(pid=130263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:39:02.452488 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG dbcounter [-] [130263] Writing DB stats nova_cell1:SELECT=3 {{(pid=130263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:39:02.453224 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG dbcounter [-] [130263] Writing DB stats nova_cell0:SELECT=3 {{(pid=130263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:39:02.551939 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG dbcounter [-] [130262] Writing DB stats nova_api:SELECT=3 {{(pid=130262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:39:02.552938 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG dbcounter [-] [130262] Writing DB stats nova_cell1:SELECT=3 {{(pid=130262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:39:02.553715 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG dbcounter [-] [130262] Writing DB stats nova_cell0:SELECT=3 {{(pid=130262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:39:02.554737 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG dbcounter [-] [130262] Writing DB stats nova_cell0:SELECT=3 {{(pid=130262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:39:03.491501 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-9b10cde8-49a4-42d9-80dc-0680fc5d4291 tempest-VolumesGetTestJSON-1117041948 tempest-VolumesGetTestJSON-1117041948-project] Action: 'create', calling method: .version_select at 0x7f72e904ed30>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-484626660", "metadata": {"Type": "work"}}} {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 03:39:03.757615 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-83473310-aada-4c40-a009-f95748273bf6 tempest-VolumesSnapshotsTestJSON-1676260217 tempest-VolumesSnapshotsTestJSON-1676260217-project] Action: 'create', calling method: .version_select at 0x7f72e904fd30>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1635559562"}} {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 03:39:06.060240 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-9b10cde8-49a4-42d9-80dc-0680fc5d4291 tempest-VolumesGetTestJSON-1117041948 tempest-VolumesGetTestJSON-1117041948-project] 10.222.0.66 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 3.620736 Aug 04 03:39:06.060891 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 1/1] 10.222.0.66 () {60 vars in 1156 bytes} [Thu Aug 4 03:39:02 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 3623 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 04 03:39:06.083884 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-7678cb88-ab94-4d44-9b0a-dfd06000970f tempest-VolumesGetTestJSON-1117041948 tempest-VolumesGetTestJSON-1117041948-project] Calling method '.version_select at 0x7f72e8ea8b80>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:39:06.314556 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-7678cb88-ab94-4d44-9b0a-dfd06000970f tempest-VolumesGetTestJSON-1117041948 tempest-VolumesGetTestJSON-1117041948-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/6cb6cbbc-3cab-4dc7-8e2a-398b593c6fbc" status: 200 len: 352 microversion: 2.1 time: 0.239407 Aug 04 03:39:06.318267 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 2/2] 10.222.0.66 () {58 vars in 1245 bytes} [Thu Aug 4 03:39:06 2022] GET /compute/v2.1/os-volumes/6cb6cbbc-3cab-4dc7-8e2a-398b593c6fbc => generated 352 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 03:39:06.867540 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-83473310-aada-4c40-a009-f95748273bf6 tempest-VolumesSnapshotsTestJSON-1676260217 tempest-VolumesSnapshotsTestJSON-1676260217-project] 10.222.0.66 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 4.213261 Aug 04 03:39:06.867540 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 1/3] 10.222.0.66 () {60 vars in 1155 bytes} [Thu Aug 4 03:39:02 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 4216 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 04 03:39:06.870676 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-a6e95d5e-f341-4338-8808-ccda9fb88865 tempest-VolumesSnapshotsTestJSON-1676260217 tempest-VolumesSnapshotsTestJSON-1676260217-project] Calling method '.version_select at 0x7f72e8ebd280>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:39:06.892891 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-a6e95d5e-f341-4338-8808-ccda9fb88865 tempest-VolumesSnapshotsTestJSON-1676260217 tempest-VolumesSnapshotsTestJSON-1676260217-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/68a9d165-2c49-47a3-b761-6e9e28767812" status: 200 len: 345 microversion: 2.1 time: 0.122173 Aug 04 03:39:06.893832 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 3/4] 10.222.0.66 () {58 vars in 1245 bytes} [Thu Aug 4 03:39:06 2022] GET /compute/v2.1/os-volumes/68a9d165-2c49-47a3-b761-6e9e28767812 => generated 345 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 03:39:07.330525 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-e0085950-6a19-40f2-8d4d-9b3e9a0cd72d tempest-VolumesGetTestJSON-1117041948 tempest-VolumesGetTestJSON-1117041948-project] Calling method '.version_select at 0x7f72e8eaab80>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:39:07.442380 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-e0085950-6a19-40f2-8d4d-9b3e9a0cd72d tempest-VolumesGetTestJSON-1117041948 tempest-VolumesGetTestJSON-1117041948-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/6cb6cbbc-3cab-4dc7-8e2a-398b593c6fbc" status: 200 len: 352 microversion: 2.1 time: 0.116273 Aug 04 03:39:07.450927 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 2/5] 10.222.0.66 () {58 vars in 1245 bytes} [Thu Aug 4 03:39:07 2022] GET /compute/v2.1/os-volumes/6cb6cbbc-3cab-4dc7-8e2a-398b593c6fbc => generated 352 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 03:39:07.908781 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-d6071b54-d178-4fd0-bb59-a3dc6db64096 tempest-VolumesSnapshotsTestJSON-1676260217 tempest-VolumesSnapshotsTestJSON-1676260217-project] Calling method '.version_select at 0x7f72e8ebd9d0>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:39:08.052773 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-d6071b54-d178-4fd0-bb59-a3dc6db64096 tempest-VolumesSnapshotsTestJSON-1676260217 tempest-VolumesSnapshotsTestJSON-1676260217-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/68a9d165-2c49-47a3-b761-6e9e28767812" status: 200 len: 346 microversion: 2.1 time: 0.148091 Aug 04 03:39:08.053720 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 4/6] 10.222.0.66 () {58 vars in 1245 bytes} [Thu Aug 4 03:39:07 2022] GET /compute/v2.1/os-volumes/68a9d165-2c49-47a3-b761-6e9e28767812 => generated 346 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 03:39:08.075624 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-8574848b-148b-4848-a910-1c1af916a9b2 tempest-VolumesSnapshotsTestJSON-1676260217 tempest-VolumesSnapshotsTestJSON-1676260217-project] Action: 'create', calling method: .version_select at 0x7f72e8ec1280>, body: {"snapshot": {"volume_id": "68a9d165-2c49-47a3-b761-6e9e28767812", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-123132388"}} {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 03:39:08.122723 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-c3bdfa9d-4965-41ca-a106-1db02c68363a tempest-VolumesTestJSON-2135614783 tempest-VolumesTestJSON-2135614783-project] Calling method '.version_select at 0x7f72e8ea8dc0>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:39:08.254135 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-c3bdfa9d-4965-41ca-a106-1db02c68363a tempest-VolumesTestJSON-2135614783 tempest-VolumesTestJSON-2135614783-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/448d2eb5-19c4-4387-98d9-07f710b6944d" status: 200 len: 351 microversion: 2.1 time: 0.131742 Aug 04 03:39:08.254135 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 5/7] 10.222.0.66 () {58 vars in 1245 bytes} [Thu Aug 4 03:39:08 2022] GET /compute/v2.1/os-volumes/448d2eb5-19c4-4387-98d9-07f710b6944d => generated 351 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 03:39:08.457242 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-e8b1ac6d-ba07-4037-850f-2375680cf1f2 tempest-VolumesGetTestJSON-1117041948 tempest-VolumesGetTestJSON-1117041948-project] Calling method '.version_select at 0x7f72e8ebdb80>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:39:09.008637 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-8574848b-148b-4848-a910-1c1af916a9b2 tempest-VolumesSnapshotsTestJSON-1676260217 tempest-VolumesSnapshotsTestJSON-1676260217-project] 10.222.0.66 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.937629 Aug 04 03:39:09.008637 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 3/8] 10.222.0.66 () {60 vars in 1162 bytes} [Thu Aug 4 03:39:08 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 03:39:09.015652 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-75d0a872-936c-4dd7-9c24-600f8e0a456c tempest-VolumesSnapshotsTestJSON-1676260217 tempest-VolumesSnapshotsTestJSON-1676260217-project] Calling method '.version_select at 0x7f72e8ec43a0>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:39:09.138889 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-e8b1ac6d-ba07-4037-850f-2375680cf1f2 tempest-VolumesGetTestJSON-1117041948 tempest-VolumesGetTestJSON-1117041948-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/6cb6cbbc-3cab-4dc7-8e2a-398b593c6fbc" status: 200 len: 353 microversion: 2.1 time: 0.685910 Aug 04 03:39:09.139677 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 6/9] 10.222.0.66 () {58 vars in 1245 bytes} [Thu Aug 4 03:39:08 2022] GET /compute/v2.1/os-volumes/6cb6cbbc-3cab-4dc7-8e2a-398b593c6fbc => generated 353 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 03:39:09.157702 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-4d41b099-ef1e-4e21-932c-296b40db5cbf tempest-VolumesGetTestJSON-1117041948 tempest-VolumesGetTestJSON-1117041948-project] Calling method '.version_select at 0x7f72e8ebd310>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:39:09.233448 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-75d0a872-936c-4dd7-9c24-600f8e0a456c tempest-VolumesSnapshotsTestJSON-1676260217 tempest-VolumesSnapshotsTestJSON-1676260217-project] 10.222.0.66 "GET /compute/v2.1/os-snapshots/f1fc3271-3518-4fe8-b9bd-274b0f732d31" status: 200 len: 286 microversion: 2.1 time: 0.221785 Aug 04 03:39:09.234532 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 4/10] 10.222.0.66 () {58 vars in 1251 bytes} [Thu Aug 4 03:39:09 2022] GET /compute/v2.1/os-snapshots/f1fc3271-3518-4fe8-b9bd-274b0f732d31 => generated 286 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 03:39:09.248462 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-519355be-4c32-470a-abfc-17945851331c tempest-VolumesSnapshotsTestJSON-1676260217 tempest-VolumesSnapshotsTestJSON-1676260217-project] Calling method '.version_select at 0x7f72e8ec1d30>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:39:09.328329 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-4d41b099-ef1e-4e21-932c-296b40db5cbf tempest-VolumesGetTestJSON-1117041948 tempest-VolumesGetTestJSON-1117041948-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/6cb6cbbc-3cab-4dc7-8e2a-398b593c6fbc" status: 200 len: 353 microversion: 2.1 time: 0.177854 Aug 04 03:39:09.329156 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 7/11] 10.222.0.66 () {58 vars in 1245 bytes} [Thu Aug 4 03:39:09 2022] GET /compute/v2.1/os-volumes/6cb6cbbc-3cab-4dc7-8e2a-398b593c6fbc => generated 353 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 03:39:09.349706 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-e9c8e747-cf8e-42a1-b2be-ce681b54e324 tempest-VolumesGetTestJSON-1117041948 tempest-VolumesGetTestJSON-1117041948-project] Calling method '.version_select at 0x7f72e8ebd160>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:39:09.362221 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-519355be-4c32-470a-abfc-17945851331c tempest-VolumesSnapshotsTestJSON-1676260217 tempest-VolumesSnapshotsTestJSON-1676260217-project] 10.222.0.66 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.119504 Aug 04 03:39:09.363846 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 5/12] 10.222.0.66 () {58 vars in 1140 bytes} [Thu Aug 4 03:39:09 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 03:39:09.377168 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-25a1fe32-205f-45ee-9efa-41e814dc1f0b tempest-VolumesSnapshotsTestJSON-1676260217 tempest-VolumesSnapshotsTestJSON-1676260217-project] Calling method '.version_select at 0x7f72e8eaaaf0>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:39:09.530581 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-25a1fe32-205f-45ee-9efa-41e814dc1f0b tempest-VolumesSnapshotsTestJSON-1676260217 tempest-VolumesSnapshotsTestJSON-1676260217-project] 10.222.0.66 "GET /compute/v2.1/os-snapshots/f1fc3271-3518-4fe8-b9bd-274b0f732d31" status: 200 len: 286 microversion: 2.1 time: 0.152922 Aug 04 03:39:09.530581 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 6/13] 10.222.0.66 () {58 vars in 1251 bytes} [Thu Aug 4 03:39:09 2022] GET /compute/v2.1/os-snapshots/f1fc3271-3518-4fe8-b9bd-274b0f732d31 => generated 286 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 03:39:09.669842 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-e9c8e747-cf8e-42a1-b2be-ce681b54e324 tempest-VolumesGetTestJSON-1117041948 tempest-VolumesGetTestJSON-1117041948-project] 10.222.0.66 "DELETE /compute/v2.1/os-volumes/6cb6cbbc-3cab-4dc7-8e2a-398b593c6fbc" status: 202 len: 0 microversion: 2.1 time: 0.323728 Aug 04 03:39:09.672842 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 8/14] 10.222.0.66 () {58 vars in 1248 bytes} [Thu Aug 4 03:39:09 2022] DELETE /compute/v2.1/os-volumes/6cb6cbbc-3cab-4dc7-8e2a-398b593c6fbc => generated 0 bytes in 329 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 03:39:09.680235 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-a289d4ce-fecd-41b1-91c9-09fa504ca0d7 tempest-VolumesGetTestJSON-1117041948 tempest-VolumesGetTestJSON-1117041948-project] Calling method '.version_select at 0x7f72e8ec4160>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:39:09.760861 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-a289d4ce-fecd-41b1-91c9-09fa504ca0d7 tempest-VolumesGetTestJSON-1117041948 tempest-VolumesGetTestJSON-1117041948-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/6cb6cbbc-3cab-4dc7-8e2a-398b593c6fbc" status: 200 len: 352 microversion: 2.1 time: 0.085768 Aug 04 03:39:09.762156 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 7/15] 10.222.0.66 () {58 vars in 1245 bytes} [Thu Aug 4 03:39:09 2022] GET /compute/v2.1/os-volumes/6cb6cbbc-3cab-4dc7-8e2a-398b593c6fbc => generated 352 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 03:39:10.541645 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-debccfbe-e245-49a1-9110-edee681932fe tempest-VolumesSnapshotsTestJSON-1676260217 tempest-VolumesSnapshotsTestJSON-1676260217-project] Calling method '.version_select at 0x7f72e8ebda60>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:39:10.605339 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-debccfbe-e245-49a1-9110-edee681932fe tempest-VolumesSnapshotsTestJSON-1676260217 tempest-VolumesSnapshotsTestJSON-1676260217-project] 10.222.0.66 "GET /compute/v2.1/os-snapshots/f1fc3271-3518-4fe8-b9bd-274b0f732d31" status: 200 len: 286 microversion: 2.1 time: 0.069062 Aug 04 03:39:10.618721 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 9/16] 10.222.0.66 () {58 vars in 1251 bytes} [Thu Aug 4 03:39:10 2022] GET /compute/v2.1/os-snapshots/f1fc3271-3518-4fe8-b9bd-274b0f732d31 => generated 286 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 03:39:10.783864 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-aff03e00-91ae-4222-a584-8e3096eb071d tempest-VolumesGetTestJSON-1117041948 tempest-VolumesGetTestJSON-1117041948-project] Calling method '.version_select at 0x7f72e8eaaca0>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:39:10.874658 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-aff03e00-91ae-4222-a584-8e3096eb071d tempest-VolumesGetTestJSON-1117041948 tempest-VolumesGetTestJSON-1117041948-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/6cb6cbbc-3cab-4dc7-8e2a-398b593c6fbc" status: 200 len: 352 microversion: 2.1 time: 0.096386 Aug 04 03:39:10.875236 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 8/17] 10.222.0.66 () {58 vars in 1245 bytes} [Thu Aug 4 03:39:10 2022] GET /compute/v2.1/os-volumes/6cb6cbbc-3cab-4dc7-8e2a-398b593c6fbc => generated 352 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 03:39:11.622466 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-ac23a174-1978-450e-ae2a-567a38ed0844 tempest-VolumesSnapshotsTestJSON-1676260217 tempest-VolumesSnapshotsTestJSON-1676260217-project] Calling method '.version_select at 0x7f72e8ea8b80>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:39:11.727982 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-ac23a174-1978-450e-ae2a-567a38ed0844 tempest-VolumesSnapshotsTestJSON-1676260217 tempest-VolumesSnapshotsTestJSON-1676260217-project] 10.222.0.66 "GET /compute/v2.1/os-snapshots/f1fc3271-3518-4fe8-b9bd-274b0f732d31" status: 200 len: 286 microversion: 2.1 time: 0.111856 Aug 04 03:39:11.728979 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 10/18] 10.222.0.66 () {58 vars in 1251 bytes} [Thu Aug 4 03:39:11 2022] GET /compute/v2.1/os-snapshots/f1fc3271-3518-4fe8-b9bd-274b0f732d31 => generated 286 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 03:39:11.891821 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-b8a4d615-5836-468a-bd47-5078b44242a3 tempest-VolumesGetTestJSON-1117041948 tempest-VolumesGetTestJSON-1117041948-project] Calling method '.version_select at 0x7f72e8ec1160>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:39:11.997409 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-b8a4d615-5836-468a-bd47-5078b44242a3 tempest-VolumesGetTestJSON-1117041948 tempest-VolumesGetTestJSON-1117041948-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/6cb6cbbc-3cab-4dc7-8e2a-398b593c6fbc" status: 200 len: 352 microversion: 2.1 time: 0.110411 Aug 04 03:39:11.998108 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 9/19] 10.222.0.66 () {58 vars in 1245 bytes} [Thu Aug 4 03:39:11 2022] GET /compute/v2.1/os-volumes/6cb6cbbc-3cab-4dc7-8e2a-398b593c6fbc => generated 352 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 03:39:12.742486 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-cf54fe57-6be8-4fdd-bcb4-ce13aa5555fe tempest-VolumesSnapshotsTestJSON-1676260217 tempest-VolumesSnapshotsTestJSON-1676260217-project] Calling method '.version_select at 0x7f72e8ea8af0>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:39:12.811653 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-cf54fe57-6be8-4fdd-bcb4-ce13aa5555fe tempest-VolumesSnapshotsTestJSON-1676260217 tempest-VolumesSnapshotsTestJSON-1676260217-project] 10.222.0.66 "GET /compute/v2.1/os-snapshots/f1fc3271-3518-4fe8-b9bd-274b0f732d31" status: 200 len: 286 microversion: 2.1 time: 0.075464 Aug 04 03:39:12.812561 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 11/20] 10.222.0.66 () {58 vars in 1251 bytes} [Thu Aug 4 03:39:12 2022] GET /compute/v2.1/os-snapshots/f1fc3271-3518-4fe8-b9bd-274b0f732d31 => generated 286 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 03:39:13.016206 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-5510fad1-fc30-4b7d-82c3-1bd681abde84 tempest-VolumesGetTestJSON-1117041948 tempest-VolumesGetTestJSON-1117041948-project] Calling method '.version_select at 0x7f72e8ec19d0>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:39:13.135263 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-5510fad1-fc30-4b7d-82c3-1bd681abde84 tempest-VolumesGetTestJSON-1117041948 tempest-VolumesGetTestJSON-1117041948-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/6cb6cbbc-3cab-4dc7-8e2a-398b593c6fbc" status: 200 len: 352 microversion: 2.1 time: 0.122822 Aug 04 03:39:13.141480 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 10/21] 10.222.0.66 () {58 vars in 1245 bytes} [Thu Aug 4 03:39:13 2022] GET /compute/v2.1/os-volumes/6cb6cbbc-3cab-4dc7-8e2a-398b593c6fbc => generated 352 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 03:39:13.507105 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-fc98aa1f-8b55-41a4-9e68-bfdcd2678da8 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-13387256", "imageRef": "0208f4b3-1d2f-42e4-a9b4-528bf5066fe1", "flavorRef": "452", "networks": [{"uuid": "9d6b6dd0-a5e6-45be-b663-1109a51c3efb"}]}} {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 03:39:13.657278 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.network.neutron [None req-fc98aa1f-8b55-41a4-9e68-bfdcd2678da8 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] validate_networks() for [('9d6b6dd0-a5e6-45be-b663-1109a51c3efb', None, None, None, None, None)] {{(pid=130263) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 03:39:13.826945 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-23a28ab6-1fef-4a1b-85b1-28650e92458e tempest-VolumesSnapshotsTestJSON-1676260217 tempest-VolumesSnapshotsTestJSON-1676260217-project] Calling method '.version_select at 0x7f72e8ec40d0>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:39:13.898978 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-23a28ab6-1fef-4a1b-85b1-28650e92458e tempest-VolumesSnapshotsTestJSON-1676260217 tempest-VolumesSnapshotsTestJSON-1676260217-project] 10.222.0.66 "GET /compute/v2.1/os-snapshots/f1fc3271-3518-4fe8-b9bd-274b0f732d31" status: 200 len: 286 microversion: 2.1 time: 0.078176 Aug 04 03:39:13.899842 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 11/22] 10.222.0.66 () {58 vars in 1251 bytes} [Thu Aug 4 03:39:13 2022] GET /compute/v2.1/os-snapshots/f1fc3271-3518-4fe8-b9bd-274b0f732d31 => generated 286 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 03:39:14.148782 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-2adf567f-6fd3-482f-94f3-d6624f2646f6 tempest-VolumesGetTestJSON-1117041948 tempest-VolumesGetTestJSON-1117041948-project] Calling method '.version_select at 0x7f72e8ec1af0>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:39:14.320685 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-2adf567f-6fd3-482f-94f3-d6624f2646f6 tempest-VolumesGetTestJSON-1117041948 tempest-VolumesGetTestJSON-1117041948-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/6cb6cbbc-3cab-4dc7-8e2a-398b593c6fbc" status: 200 len: 352 microversion: 2.1 time: 0.176175 Aug 04 03:39:14.322032 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 12/23] 10.222.0.66 () {58 vars in 1245 bytes} [Thu Aug 4 03:39:14 2022] GET /compute/v2.1/os-volumes/6cb6cbbc-3cab-4dc7-8e2a-398b593c6fbc => generated 352 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 03:39:14.912673 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-c22994b3-6e28-4884-a415-99fea80785fb tempest-VolumesSnapshotsTestJSON-1676260217 tempest-VolumesSnapshotsTestJSON-1676260217-project] Calling method '.version_select at 0x7f72e8ec1280>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:39:14.954842 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-c22994b3-6e28-4884-a415-99fea80785fb tempest-VolumesSnapshotsTestJSON-1676260217 tempest-VolumesSnapshotsTestJSON-1676260217-project] 10.222.0.66 "GET /compute/v2.1/os-snapshots/f1fc3271-3518-4fe8-b9bd-274b0f732d31" status: 200 len: 286 microversion: 2.1 time: 0.046841 Aug 04 03:39:14.956002 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 13/24] 10.222.0.66 () {58 vars in 1251 bytes} [Thu Aug 4 03:39:14 2022] GET /compute/v2.1/os-snapshots/f1fc3271-3518-4fe8-b9bd-274b0f732d31 => generated 286 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 03:39:15.337663 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-0031d226-48a1-436c-842f-9abf20cbb1a1 tempest-VolumesGetTestJSON-1117041948 tempest-VolumesGetTestJSON-1117041948-project] Calling method '.version_select at 0x7f72e8eaae50>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:39:15.448808 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-0031d226-48a1-436c-842f-9abf20cbb1a1 tempest-VolumesGetTestJSON-1117041948 tempest-VolumesGetTestJSON-1117041948-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/6cb6cbbc-3cab-4dc7-8e2a-398b593c6fbc" status: 200 len: 352 microversion: 2.1 time: 0.117818 Aug 04 03:39:15.449655 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 14/25] 10.222.0.66 () {58 vars in 1245 bytes} [Thu Aug 4 03:39:15 2022] GET /compute/v2.1/os-volumes/6cb6cbbc-3cab-4dc7-8e2a-398b593c6fbc => generated 352 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 03:39:15.793840 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.virt.hardware [None req-fc98aa1f-8b55-41a4-9e68-bfdcd2678da8 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Flavor limits 0:0:0 {{(pid=130263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 03:39:15.794831 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.virt.hardware [None req-fc98aa1f-8b55-41a4-9e68-bfdcd2678da8 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Image limits 0:0:0 {{(pid=130263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 03:39:15.795822 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.virt.hardware [None req-fc98aa1f-8b55-41a4-9e68-bfdcd2678da8 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Flavor pref 0:0:0 {{(pid=130263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 03:39:15.796394 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.virt.hardware [None req-fc98aa1f-8b55-41a4-9e68-bfdcd2678da8 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Image pref 0:0:0 {{(pid=130263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 03:39:15.796960 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.virt.hardware [None req-fc98aa1f-8b55-41a4-9e68-bfdcd2678da8 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 03:39:15.841028 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-fc98aa1f-8b55-41a4-9e68-bfdcd2678da8 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:39:15.841535 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-f8fe42a7-c052-4d18-b9a1-7a61bcc53a72 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1812256069", "imageRef": "0208f4b3-1d2f-42e4-a9b4-528bf5066fe1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 03:39:15.844612 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-fc98aa1f-8b55-41a4-9e68-bfdcd2678da8 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:39:15.845865 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-fc98aa1f-8b55-41a4-9e68-bfdcd2678da8 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:39:15.846526 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-fc98aa1f-8b55-41a4-9e68-bfdcd2678da8 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:39:15.918894 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.quota [None req-fc98aa1f-8b55-41a4-9e68-bfdcd2678da8 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Getting quotas for project 8a97e25e7eae402f8f5c4222019ed87c. Resources: {'instances', 'ram', 'cores'} {{(pid=130263) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 03:39:15.944598 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.quota [None req-fc98aa1f-8b55-41a4-9e68-bfdcd2678da8 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Getting quotas for user d9f4252210bd412ba24305b00a6e77b4 and project 8a97e25e7eae402f8f5c4222019ed87c. Resources: {'instances', 'ram', 'cores'} {{(pid=130263) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 03:39:15.965468 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-fc98aa1f-8b55-41a4-9e68-bfdcd2678da8 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Going to run 1 instances... {{(pid=130263) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 03:39:15.971997 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-fc98aa1f-8b55-41a4-9e68-bfdcd2678da8 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] [instance: f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0208f4b3-1d2f-42e4-a9b4-528bf5066fe1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130263) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 03:39:16.084048 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.network.neutron [None req-f8fe42a7-c052-4d18-b9a1-7a61bcc53a72 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] validate_networks() for [('cab855e4-301b-40e9-91e6-cb378cff2fa6', None, None, None, None, None)] {{(pid=130262) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 03:39:16.126889 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-fc98aa1f-8b55-41a4-9e68-bfdcd2678da8 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.865394 Aug 04 03:39:16.127782 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 12/26] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 03:39:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 2867 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 03:39:16.664315 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-ddf05b53-7d48-4855-b48d-4008ffa059db tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Action: 'create', calling method: .version_select at 0x7f72e85c05e0>, body: {"keypair": {"name": "tempest-keypair-874038558", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKxuIztCPBHabnbpgSCqOVm9EiO1U4A3c/bbx6udH9Jac5HRtXgnHC292/baVeW0k4TnKH2NRR8+gxjxmwgQcAfRsoZ4vU4hf21eXVr0yP3Ei5hUA1SglxKiQ1VTbw+iXw=="}} {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 03:39:16.710752 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.quota [None req-ddf05b53-7d48-4855-b48d-4008ffa059db tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Getting quotas for project f46b8dc64007429b805971d4c6f5b471. Resources: {'key_pairs'} {{(pid=130263) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 03:39:16.720228 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.quota [None req-ddf05b53-7d48-4855-b48d-4008ffa059db tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Getting quotas for user 6dba436d0a67433f8c8ae7cd40d3f795 and project f46b8dc64007429b805971d4c6f5b471. Resources: {'key_pairs'} {{(pid=130263) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 03:39:16.835249 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-ddf05b53-7d48-4855-b48d-4008ffa059db tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.706037 Aug 04 03:39:16.847534 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 13/27] 10.222.0.66 () {60 vars in 1159 bytes} [Thu Aug 4 03:39:16 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 03:39:16.850104 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-bacfa1a9-b364-400b-be33-1561c64e65bd tempest-VolumesSnapshotsTestJSON-1676260217 tempest-VolumesSnapshotsTestJSON-1676260217-project] Calling method '.version_select at 0x7f72e85c01f0>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:39:16.922372 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-bacfa1a9-b364-400b-be33-1561c64e65bd tempest-VolumesSnapshotsTestJSON-1676260217 tempest-VolumesSnapshotsTestJSON-1676260217-project] 10.222.0.66 "GET /compute/v2.1/os-snapshots/f1fc3271-3518-4fe8-b9bd-274b0f732d31" status: 200 len: 287 microversion: 2.1 time: 0.077991 Aug 04 03:39:16.923346 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 14/28] 10.222.0.66 () {58 vars in 1251 bytes} [Thu Aug 4 03:39:16 2022] GET /compute/v2.1/os-snapshots/f1fc3271-3518-4fe8-b9bd-274b0f732d31 => generated 287 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 03:39:16.928560 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-c47a2f90-3ec5-484f-a3ee-130951271a49 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:39:16.929436 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-c47a2f90-3ec5-484f-a3ee-130951271a49 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] [instance: f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:39:17.125685 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-c47a2f90-3ec5-484f-a3ee-130951271a49 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f4252210bd412ba24305b00a6e77b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a97e25e7eae402f8f5c4222019ed87c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:39:17.191784 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-c47a2f90-3ec5-484f-a3ee-130951271a49 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] 10.222.0.66 "GET /compute/v2.1/servers/f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e" status: 200 len: 1213 microversion: 2.1 time: 0.265841 Aug 04 03:39:17.194116 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 15/29] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:39:16 2022] GET /compute/v2.1/servers/f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e => generated 1213 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:39:17.215821 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-6bbb1def-fb9e-4814-83ff-452daccad833 tempest-VolumesGetTestJSON-1117041948 tempest-VolumesGetTestJSON-1117041948-project] Calling method '.version_select at 0x7f72e85da9d0>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:39:17.621595 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.wsgi [None req-6bbb1def-fb9e-4814-83ff-452daccad833 tempest-VolumesGetTestJSON-1117041948 tempest-VolumesGetTestJSON-1117041948-project] HTTP exception thrown: Volume 6cb6cbbc-3cab-4dc7-8e2a-398b593c6fbc could not be found. Aug 04 03:39:17.628814 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-6bbb1def-fb9e-4814-83ff-452daccad833 tempest-VolumesGetTestJSON-1117041948 tempest-VolumesGetTestJSON-1117041948-project] Request method failure captured: Aug 04 03:39:17.628814 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: request: GET /compute/v2.1/os-volumes/6cb6cbbc-3cab-4dc7-8e2a-398b593c6fbc HTTP/1.1 Aug 04 03:39:17.628814 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Accept: application/json Aug 04 03:39:17.628814 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Accept-Encoding: identity Aug 04 03:39:17.628814 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Connection: close Aug 04 03:39:17.628814 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Content-Length: 0 Aug 04 03:39:17.628814 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Content-Type: application/json Aug 04 03:39:17.628814 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Host: 10.222.0.66 Aug 04 03:39:17.628814 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Openstack-System-Scope: None Aug 04 03:39:17.628814 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: User-Agent: python-urllib3/1.26.11 Aug 04 03:39:17.628814 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Auth-Token: gAAAAABi6z9WmlHR34j3cBThaS-OTwjWCK4gUjho4TCgyIKuvVEi55WLqaowX2m2oo7LckZkEER6KRe4BPBO7jRawpWn0OFMTbhb57jSUD5pJ64XpGbBJYkuypIXV4bx7l34mypQ6GUdcYhH8sELaIKW5l0WOf15ATdEXmKD9ZrL3B9o0hm9RL4 Aug 04 03:39:17.628814 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Domain-Id: None Aug 04 03:39:17.628814 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Domain-Name: None Aug 04 03:39:17.628814 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Identity-Status: Confirmed Aug 04 03:39:17.628814 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Is-Admin-Project: True Aug 04 03:39:17.628814 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Project-Domain-Id: default Aug 04 03:39:17.628814 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Project-Domain-Name: Default Aug 04 03:39:17.628814 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Project-Id: d3ace7ff4e72453bab404b46bb8b2cef Aug 04 03:39:17.628814 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Project-Name: tempest-VolumesGetTestJSON-1117041948 Aug 04 03:39:17.628814 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Role: member,reader Aug 04 03:39:17.628814 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Roles: member,reader Aug 04 03:39:17.630835 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/d3ace7ff4e72453bab404b46bb8b2cef"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/d3ace7ff4e72453bab404b46bb8b2cef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/d3ace7ff4e72453bab404b46bb8b2cef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_d3ace7ff4e72453bab404b46bb8b2cef"}]}] Aug 04 03:39:17.630835 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Tenant: tempest-VolumesGetTestJSON-1117041948 Aug 04 03:39:17.630835 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Tenant-Id: d3ace7ff4e72453bab404b46bb8b2cef Aug 04 03:39:17.630835 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Tenant-Name: tempest-VolumesGetTestJSON-1117041948 Aug 04 03:39:17.630835 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-User: tempest-VolumesGetTestJSON-1117041948-project Aug 04 03:39:17.630835 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-User-Domain-Id: default Aug 04 03:39:17.630835 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-User-Domain-Name: Default Aug 04 03:39:17.630835 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-User-Id: 6daf35a4dd4249ecb83225047b942998 Aug 04 03:39:17.630835 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-User-Name: tempest-VolumesGetTestJSON-1117041948-project Aug 04 03:39:17.630835 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: method: Aug 04 03:39:17.630835 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: exception: Volume 6cb6cbbc-3cab-4dc7-8e2a-398b593c6fbc could not be found. Aug 04 03:39:17.630835 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: action_args: {'id': '6cb6cbbc-3cab-4dc7-8e2a-398b593c6fbc'} Aug 04 03:39:17.630835 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 03:39:17.631606 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 03:39:17.631606 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 03:39:17.631606 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 03:39:17.631606 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 04 03:39:17.631606 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 04 03:39:17.631606 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 04 03:39:17.631606 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 04 03:39:17.631606 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 04 03:39:17.631606 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 04 03:39:17.631606 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 04 03:39:17.631606 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 04 03:39:17.631606 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 03:39:17.631606 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 03:39:17.631606 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 03:39:17.631606 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 03:39:17.631606 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6cb6cbbc-3cab-4dc7-8e2a-398b593c6fbc could not be found. (HTTP 404) (Request-ID: req-1c2b0b8c-b1f2-4e75-817e-ce57903a6cba) Aug 04 03:39:17.631606 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Aug 04 03:39:17.631606 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 03:39:17.631606 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Aug 04 03:39:17.632527 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 03:39:17.632527 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 04 03:39:17.632527 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 04 03:39:17.632527 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 04 03:39:17.632527 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 04 03:39:17.632527 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 04 03:39:17.632527 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 04 03:39:17.632527 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 04 03:39:17.632527 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 04 03:39:17.632527 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 03:39:17.632527 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 03:39:17.632527 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 04 03:39:17.632527 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 04 03:39:17.632527 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 04 03:39:17.632527 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 04 03:39:17.632527 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 04 03:39:17.632527 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 04 03:39:17.632527 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 04 03:39:17.632527 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 04 03:39:17.640947 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 03:39:17.640947 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 03:39:17.640947 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 03:39:17.640947 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 03:39:17.640947 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6cb6cbbc-3cab-4dc7-8e2a-398b593c6fbc could not be found. Aug 04 03:39:17.640947 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Aug 04 03:39:17.640947 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 03:39:17.640947 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Aug 04 03:39:17.640947 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 03:39:17.640947 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 03:39:17.640947 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 03:39:17.640947 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 03:39:17.640947 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 03:39:17.640947 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 03:39:17.640947 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 03:39:17.640947 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 03:39:17.640947 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 03:39:17.640947 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 04 03:39:17.640947 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 03:39:17.642226 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 6cb6cbbc-3cab-4dc7-8e2a-398b593c6fbc could not be found. Aug 04 03:39:17.642226 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Aug 04 03:39:17.642226 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 03:39:17.642226 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Aug 04 03:39:17.642226 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 03:39:17.642226 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 03:39:17.642226 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 03:39:17.642226 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 03:39:17.642226 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 03:39:17.642226 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6cb6cbbc-3cab-4dc7-8e2a-398b593c6fbc could not be found. Aug 04 03:39:17.642226 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Aug 04 03:39:17.642226 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-6bbb1def-fb9e-4814-83ff-452daccad833 tempest-VolumesGetTestJSON-1117041948 tempest-VolumesGetTestJSON-1117041948-project] Returning 404 to user: Volume 6cb6cbbc-3cab-4dc7-8e2a-398b593c6fbc could not be found. {{(pid=130263) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 03:39:17.642226 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-6bbb1def-fb9e-4814-83ff-452daccad833 tempest-VolumesGetTestJSON-1117041948 tempest-VolumesGetTestJSON-1117041948-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/6cb6cbbc-3cab-4dc7-8e2a-398b593c6fbc" status: 404 len: 109 microversion: 2.1 time: 0.439854 Aug 04 03:39:17.642226 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 16/30] 10.222.0.66 () {58 vars in 1245 bytes} [Thu Aug 4 03:39:17 2022] GET /compute/v2.1/os-volumes/6cb6cbbc-3cab-4dc7-8e2a-398b593c6fbc => generated 109 bytes in 443 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 03:39:17.655297 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-900182de-f61a-484f-b7c5-b04f76d5cd75 tempest-VolumesSnapshotsTestJSON-1676260217 tempest-VolumesSnapshotsTestJSON-1676260217-project] Calling method '.version_select at 0x7f72e8508160>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:39:17.907453 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.virt.hardware [None req-f8fe42a7-c052-4d18-b9a1-7a61bcc53a72 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Flavor limits 0:0:0 {{(pid=130262) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 03:39:17.908431 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.virt.hardware [None req-f8fe42a7-c052-4d18-b9a1-7a61bcc53a72 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Image limits 0:0:0 {{(pid=130262) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 03:39:17.909867 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.virt.hardware [None req-f8fe42a7-c052-4d18-b9a1-7a61bcc53a72 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Flavor pref 0:0:0 {{(pid=130262) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 03:39:17.910472 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.virt.hardware [None req-f8fe42a7-c052-4d18-b9a1-7a61bcc53a72 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Image pref 0:0:0 {{(pid=130262) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 03:39:17.911060 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.virt.hardware [None req-f8fe42a7-c052-4d18-b9a1-7a61bcc53a72 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130262) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 03:39:17.925458 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-900182de-f61a-484f-b7c5-b04f76d5cd75 tempest-VolumesSnapshotsTestJSON-1676260217 tempest-VolumesSnapshotsTestJSON-1676260217-project] 10.222.0.66 "DELETE /compute/v2.1/os-snapshots/f1fc3271-3518-4fe8-b9bd-274b0f732d31" status: 202 len: 0 microversion: 2.1 time: 0.284207 Aug 04 03:39:17.926095 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 17/31] 10.222.0.66 () {58 vars in 1254 bytes} [Thu Aug 4 03:39:17 2022] DELETE /compute/v2.1/os-snapshots/f1fc3271-3518-4fe8-b9bd-274b0f732d31 => generated 0 bytes in 287 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 03:39:17.934007 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-fbf098a6-fc4d-404d-8ca4-62a1fdc558e5 tempest-VolumesTestJSON-2135614783 tempest-VolumesTestJSON-2135614783-project] Calling method '.version_select at 0x7f72e8508820>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:39:17.956421 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-f8fe42a7-c052-4d18-b9a1-7a61bcc53a72 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:39:17.957108 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-f8fe42a7-c052-4d18-b9a1-7a61bcc53a72 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:39:17.958713 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-f8fe42a7-c052-4d18-b9a1-7a61bcc53a72 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:39:17.961263 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-f8fe42a7-c052-4d18-b9a1-7a61bcc53a72 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:39:18.009974 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.quota [None req-f8fe42a7-c052-4d18-b9a1-7a61bcc53a72 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Getting quotas for project 7d9ff6952b014d0a9abb28dcf0b818b0. Resources: {'instances', 'ram', 'cores'} {{(pid=130262) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 03:39:18.029865 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.quota [None req-f8fe42a7-c052-4d18-b9a1-7a61bcc53a72 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Getting quotas for user 3ec8d131a9764028a096314a4ecd58f9 and project 7d9ff6952b014d0a9abb28dcf0b818b0. Resources: {'instances', 'ram', 'cores'} {{(pid=130262) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 03:39:18.056958 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-fbf098a6-fc4d-404d-8ca4-62a1fdc558e5 tempest-VolumesTestJSON-2135614783 tempest-VolumesTestJSON-2135614783-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/018587b8-6da8-42a0-83f2-85c3906d931e" status: 200 len: 350 microversion: 2.1 time: 0.128761 Aug 04 03:39:18.057967 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 18/32] 10.222.0.66 () {58 vars in 1245 bytes} [Thu Aug 4 03:39:17 2022] GET /compute/v2.1/os-volumes/018587b8-6da8-42a0-83f2-85c3906d931e => generated 350 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 03:39:18.062865 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-63dd5841-721e-4b49-b24c-5f01d0020de9 tempest-VolumesSnapshotsTestJSON-1676260217 tempest-VolumesSnapshotsTestJSON-1676260217-project] Calling method '.version_select at 0x7f72e987af70>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:39:18.070530 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-f8fe42a7-c052-4d18-b9a1-7a61bcc53a72 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Going to run 1 instances... {{(pid=130262) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 03:39:18.072890 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-f8fe42a7-c052-4d18-b9a1-7a61bcc53a72 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] [instance: 8620bffd-405f-41cc-9388-abdb301923d5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0208f4b3-1d2f-42e4-a9b4-528bf5066fe1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130262) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 03:39:18.265575 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-f8fe42a7-c052-4d18-b9a1-7a61bcc53a72 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.812912 Aug 04 03:39:18.266919 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 15/33] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 03:39:15 2022] POST /compute/v2.1/servers => generated 383 bytes in 2816 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 03:39:18.273143 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-a4a6d9ae-efc5-4781-aae1-e8318dbc4d76 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:39:18.274101 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-a4a6d9ae-efc5-4781-aae1-e8318dbc4d76 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] [instance: f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:39:18.311687 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-63dd5841-721e-4b49-b24c-5f01d0020de9 tempest-VolumesSnapshotsTestJSON-1676260217 tempest-VolumesSnapshotsTestJSON-1676260217-project] 10.222.0.66 "GET /compute/v2.1/os-snapshots/f1fc3271-3518-4fe8-b9bd-274b0f732d31" status: 200 len: 286 microversion: 2.1 time: 0.251402 Aug 04 03:39:18.317681 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 19/34] 10.222.0.66 () {58 vars in 1251 bytes} [Thu Aug 4 03:39:18 2022] GET /compute/v2.1/os-snapshots/f1fc3271-3518-4fe8-b9bd-274b0f732d31 => generated 286 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 03:39:18.334891 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-bbded5ca-2ed9-43e3-bc53-e05e8b7d99ad tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:39:18.334891 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-bbded5ca-2ed9-43e3-bc53-e05e8b7d99ad tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] [instance: 8620bffd-405f-41cc-9388-abdb301923d5] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:39:18.586835 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-a4a6d9ae-efc5-4781-aae1-e8318dbc4d76 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f4252210bd412ba24305b00a6e77b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a97e25e7eae402f8f5c4222019ed87c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:39:18.598095 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-bbded5ca-2ed9-43e3-bc53-e05e8b7d99ad tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec8d131a9764028a096314a4ecd58f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9ff6952b014d0a9abb28dcf0b818b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:39:18.609738 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-bbded5ca-2ed9-43e3-bc53-e05e8b7d99ad tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] 10.222.0.66 "GET /compute/v2.1/servers/8620bffd-405f-41cc-9388-abdb301923d5" status: 200 len: 1222 microversion: 2.1 time: 0.288708 Aug 04 03:39:18.617391 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 20/35] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:39:18 2022] GET /compute/v2.1/servers/8620bffd-405f-41cc-9388-abdb301923d5 => generated 1222 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:39:18.652893 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-a4a6d9ae-efc5-4781-aae1-e8318dbc4d76 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] 10.222.0.66 "GET /compute/v2.1/servers/f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e" status: 200 len: 1213 microversion: 2.1 time: 0.380600 Aug 04 03:39:18.666354 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 16/36] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:39:18 2022] GET /compute/v2.1/servers/f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e => generated 1213 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:39:18.914895 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-f70bc7b9-6c69-4b38-af9a-6f41df8cd61a tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1723915911", "imageRef": "0208f4b3-1d2f-42e4-a9b4-528bf5066fe1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 03:39:19.024340 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.network.neutron [None req-f70bc7b9-6c69-4b38-af9a-6f41df8cd61a tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] validate_networks() for [('cab855e4-301b-40e9-91e6-cb378cff2fa6', None, None, None, None, None)] {{(pid=130263) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 03:39:19.329601 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-97c7616f-8684-4fde-bd32-7a6752464baa tempest-VolumesSnapshotsTestJSON-1676260217 tempest-VolumesSnapshotsTestJSON-1676260217-project] Calling method '.version_select at 0x7f72e85740d0>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:39:19.563685 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.wsgi [None req-97c7616f-8684-4fde-bd32-7a6752464baa tempest-VolumesSnapshotsTestJSON-1676260217 tempest-VolumesSnapshotsTestJSON-1676260217-project] HTTP exception thrown: Snapshot f1fc3271-3518-4fe8-b9bd-274b0f732d31 could not be found. Aug 04 03:39:19.572226 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-97c7616f-8684-4fde-bd32-7a6752464baa tempest-VolumesSnapshotsTestJSON-1676260217 tempest-VolumesSnapshotsTestJSON-1676260217-project] Request method failure captured: Aug 04 03:39:19.572226 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: request: GET /compute/v2.1/os-snapshots/f1fc3271-3518-4fe8-b9bd-274b0f732d31 HTTP/1.1 Aug 04 03:39:19.572226 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: Accept: application/json Aug 04 03:39:19.572226 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: Accept-Encoding: identity Aug 04 03:39:19.572226 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: Connection: close Aug 04 03:39:19.572226 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: Content-Length: 0 Aug 04 03:39:19.572226 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: Content-Type: application/json Aug 04 03:39:19.572226 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: Host: 10.222.0.66 Aug 04 03:39:19.572226 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: Openstack-System-Scope: None Aug 04 03:39:19.572226 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: User-Agent: python-urllib3/1.26.11 Aug 04 03:39:19.572226 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Auth-Token: gAAAAABi6z9WVkC0S9eJGFaCCMn1OGNQCSJuS2VJR6c8P84yFJoypN8cpmCsXhvIZAOLqaAObK0CzMOeVp5Q2XAOgRJYpcG9-DoXb2DsvkgaSLCbmiUZ_3qBZ7yIPq-2hcQVui49QKp4W6nhNNRQuW6DipSDxsDxt5CrZEoHj1d_oGRpV_-gXZQ Aug 04 03:39:19.572226 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Domain-Id: None Aug 04 03:39:19.572226 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Domain-Name: None Aug 04 03:39:19.572226 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Identity-Status: Confirmed Aug 04 03:39:19.572226 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Is-Admin-Project: True Aug 04 03:39:19.572226 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Project-Domain-Id: default Aug 04 03:39:19.572226 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Project-Domain-Name: Default Aug 04 03:39:19.572226 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Project-Id: 08ca5027abb74e11ac8c337217852767 Aug 04 03:39:19.572226 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1676260217 Aug 04 03:39:19.572226 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Role: member,reader Aug 04 03:39:19.572226 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Roles: member,reader Aug 04 03:39:19.573579 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/08ca5027abb74e11ac8c337217852767"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/08ca5027abb74e11ac8c337217852767"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/08ca5027abb74e11ac8c337217852767"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_08ca5027abb74e11ac8c337217852767"}]}] Aug 04 03:39:19.573579 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1676260217 Aug 04 03:39:19.573579 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Tenant-Id: 08ca5027abb74e11ac8c337217852767 Aug 04 03:39:19.573579 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1676260217 Aug 04 03:39:19.573579 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-User: tempest-VolumesSnapshotsTestJSON-1676260217-project Aug 04 03:39:19.573579 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-User-Domain-Id: default Aug 04 03:39:19.573579 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-User-Domain-Name: Default Aug 04 03:39:19.573579 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-User-Id: 3719507c161845789093a0c70189448f Aug 04 03:39:19.573579 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1676260217-project Aug 04 03:39:19.573579 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: method: Aug 04 03:39:19.573579 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: exception: Snapshot f1fc3271-3518-4fe8-b9bd-274b0f732d31 could not be found. Aug 04 03:39:19.573579 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: action_args: {'id': 'f1fc3271-3518-4fe8-b9bd-274b0f732d31'} Aug 04 03:39:19.573579 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 03:39:19.574406 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 03:39:19.574406 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 04 03:39:19.574406 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 04 03:39:19.574406 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 04 03:39:19.574406 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 04 03:39:19.574406 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 04 03:39:19.574406 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 04 03:39:19.574406 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 04 03:39:19.574406 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 04 03:39:19.574406 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 04 03:39:19.574406 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 04 03:39:19.574406 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 03:39:19.574406 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 03:39:19.574406 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 03:39:19.574406 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 03:39:19.574406 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot f1fc3271-3518-4fe8-b9bd-274b0f732d31 could not be found. (HTTP 404) (Request-ID: req-92bb2b91-dc09-49d9-b729-6ca0ac0bb149) Aug 04 03:39:19.574406 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi Aug 04 03:39:19.574406 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 03:39:19.575455 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi Aug 04 03:39:19.575455 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 03:39:19.575455 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 04 03:39:19.575455 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 04 03:39:19.575455 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 04 03:39:19.575455 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 04 03:39:19.575455 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 04 03:39:19.575455 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 04 03:39:19.575455 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 04 03:39:19.575455 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 04 03:39:19.575455 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 04 03:39:19.575455 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 04 03:39:19.575455 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 04 03:39:19.575455 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 04 03:39:19.575455 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 04 03:39:19.575455 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 04 03:39:19.575455 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 04 03:39:19.575455 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 04 03:39:19.575455 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 04 03:39:19.576572 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 04 03:39:19.576572 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 03:39:19.576572 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 03:39:19.576572 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 03:39:19.576572 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 03:39:19.576572 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot f1fc3271-3518-4fe8-b9bd-274b0f732d31 could not be found. Aug 04 03:39:19.576572 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi Aug 04 03:39:19.576572 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 03:39:19.576572 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi Aug 04 03:39:19.576572 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 03:39:19.576572 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 03:39:19.576572 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 03:39:19.576572 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 03:39:19.576572 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 03:39:19.576572 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 03:39:19.576572 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 03:39:19.576572 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 03:39:19.576572 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 03:39:19.576572 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 04 03:39:19.576572 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 03:39:19.578605 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot f1fc3271-3518-4fe8-b9bd-274b0f732d31 could not be found. Aug 04 03:39:19.578605 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi Aug 04 03:39:19.578605 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 03:39:19.578605 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi Aug 04 03:39:19.578605 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 03:39:19.578605 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 03:39:19.578605 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 03:39:19.578605 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 03:39:19.578605 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 03:39:19.578605 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot f1fc3271-3518-4fe8-b9bd-274b0f732d31 could not be found. Aug 04 03:39:19.578605 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi Aug 04 03:39:19.580897 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-97c7616f-8684-4fde-bd32-7a6752464baa tempest-VolumesSnapshotsTestJSON-1676260217 tempest-VolumesSnapshotsTestJSON-1676260217-project] Returning 404 to user: Snapshot f1fc3271-3518-4fe8-b9bd-274b0f732d31 could not be found. {{(pid=130262) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 03:39:19.582165 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-97c7616f-8684-4fde-bd32-7a6752464baa tempest-VolumesSnapshotsTestJSON-1676260217 tempest-VolumesSnapshotsTestJSON-1676260217-project] 10.222.0.66 "GET /compute/v2.1/os-snapshots/f1fc3271-3518-4fe8-b9bd-274b0f732d31" status: 404 len: 111 microversion: 2.1 time: 0.256377 Aug 04 03:39:19.591000 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 17/37] 10.222.0.66 () {58 vars in 1251 bytes} [Thu Aug 4 03:39:19 2022] GET /compute/v2.1/os-snapshots/f1fc3271-3518-4fe8-b9bd-274b0f732d31 => generated 111 bytes in 261 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 03:39:19.601878 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-1eb1307b-21e3-4187-ad35-30a42e386942 tempest-VolumesSnapshotsTestJSON-1676260217 tempest-VolumesSnapshotsTestJSON-1676260217-project] Calling method '.version_select at 0x7f72e982f160>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:39:20.133730 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-1eb1307b-21e3-4187-ad35-30a42e386942 tempest-VolumesSnapshotsTestJSON-1676260217 tempest-VolumesSnapshotsTestJSON-1676260217-project] 10.222.0.66 "DELETE /compute/v2.1/os-volumes/68a9d165-2c49-47a3-b761-6e9e28767812" status: 202 len: 0 microversion: 2.1 time: 0.542351 Aug 04 03:39:20.137799 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 18/38] 10.222.0.66 () {58 vars in 1248 bytes} [Thu Aug 4 03:39:19 2022] DELETE /compute/v2.1/os-volumes/68a9d165-2c49-47a3-b761-6e9e28767812 => generated 0 bytes in 549 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 03:39:20.143714 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-8e5f4009-647f-40e5-9ca7-0eb92fb5e76b tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:39:20.144334 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-8e5f4009-647f-40e5-9ca7-0eb92fb5e76b tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] [instance: f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:39:20.162328 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-8e5f4009-647f-40e5-9ca7-0eb92fb5e76b tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:39:20.162805 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-8e5f4009-647f-40e5-9ca7-0eb92fb5e76b tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:39:20.164457 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-8e5f4009-647f-40e5-9ca7-0eb92fb5e76b tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:39:20.168746 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-8e5f4009-647f-40e5-9ca7-0eb92fb5e76b tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:39:20.328337 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.virt.hardware [None req-f70bc7b9-6c69-4b38-af9a-6f41df8cd61a tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Flavor limits 0:0:0 {{(pid=130263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 03:39:20.329426 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.virt.hardware [None req-f70bc7b9-6c69-4b38-af9a-6f41df8cd61a tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Image limits 0:0:0 {{(pid=130263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 03:39:20.330071 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.virt.hardware [None req-f70bc7b9-6c69-4b38-af9a-6f41df8cd61a tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Flavor pref 0:0:0 {{(pid=130263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 03:39:20.330697 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.virt.hardware [None req-f70bc7b9-6c69-4b38-af9a-6f41df8cd61a tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Image pref 0:0:0 {{(pid=130263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 03:39:20.331428 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.virt.hardware [None req-f70bc7b9-6c69-4b38-af9a-6f41df8cd61a tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 03:39:20.353993 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-f70bc7b9-6c69-4b38-af9a-6f41df8cd61a tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:39:20.354625 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-f70bc7b9-6c69-4b38-af9a-6f41df8cd61a tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:39:20.356153 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-f70bc7b9-6c69-4b38-af9a-6f41df8cd61a tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:39:20.358691 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-f70bc7b9-6c69-4b38-af9a-6f41df8cd61a tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:39:20.427425 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.quota [None req-f70bc7b9-6c69-4b38-af9a-6f41df8cd61a tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Getting quotas for project 7d9ff6952b014d0a9abb28dcf0b818b0. Resources: {'instances', 'ram', 'cores'} {{(pid=130263) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 03:39:20.443658 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.quota [None req-f70bc7b9-6c69-4b38-af9a-6f41df8cd61a tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Getting quotas for user 3ec8d131a9764028a096314a4ecd58f9 and project 7d9ff6952b014d0a9abb28dcf0b818b0. Resources: {'instances', 'ram', 'cores'} {{(pid=130263) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 03:39:20.490299 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-8e5f4009-647f-40e5-9ca7-0eb92fb5e76b tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f4252210bd412ba24305b00a6e77b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a97e25e7eae402f8f5c4222019ed87c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:39:20.491788 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-f70bc7b9-6c69-4b38-af9a-6f41df8cd61a tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Going to run 1 instances... {{(pid=130263) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 03:39:20.497246 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-f70bc7b9-6c69-4b38-af9a-6f41df8cd61a tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] [instance: 60273216-f2ed-46cf-8836-1d85335d8920] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0208f4b3-1d2f-42e4-a9b4-528bf5066fe1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130263) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 03:39:20.516947 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-8e5f4009-647f-40e5-9ca7-0eb92fb5e76b tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] 10.222.0.66 "GET /compute/v2.1/servers/f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e" status: 200 len: 1217 microversion: 2.1 time: 0.372690 Aug 04 03:39:20.526107 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 19/39] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:39:20 2022] GET /compute/v2.1/servers/f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e => generated 1217 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:39:20.542162 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-1e8fc613-14fc-47fd-8bd1-5bd04636bccf tempest-VolumesSnapshotsTestJSON-1676260217 tempest-VolumesSnapshotsTestJSON-1676260217-project] Calling method '.version_select at 0x7f72e84653a0>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:39:20.646187 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.wsgi [None req-1e8fc613-14fc-47fd-8bd1-5bd04636bccf tempest-VolumesSnapshotsTestJSON-1676260217 tempest-VolumesSnapshotsTestJSON-1676260217-project] HTTP exception thrown: Volume 68a9d165-2c49-47a3-b761-6e9e28767812 could not be found. Aug 04 03:39:20.646187 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-1e8fc613-14fc-47fd-8bd1-5bd04636bccf tempest-VolumesSnapshotsTestJSON-1676260217 tempest-VolumesSnapshotsTestJSON-1676260217-project] Request method failure captured: Aug 04 03:39:20.646187 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: request: GET /compute/v2.1/os-volumes/68a9d165-2c49-47a3-b761-6e9e28767812 HTTP/1.1 Aug 04 03:39:20.646187 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: Accept: application/json Aug 04 03:39:20.646187 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: Accept-Encoding: identity Aug 04 03:39:20.646187 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: Connection: close Aug 04 03:39:20.646187 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: Content-Length: 0 Aug 04 03:39:20.646187 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: Content-Type: application/json Aug 04 03:39:20.646187 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: Host: 10.222.0.66 Aug 04 03:39:20.646187 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: Openstack-System-Scope: None Aug 04 03:39:20.646187 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: User-Agent: python-urllib3/1.26.11 Aug 04 03:39:20.646187 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Auth-Token: gAAAAABi6z9WVkC0S9eJGFaCCMn1OGNQCSJuS2VJR6c8P84yFJoypN8cpmCsXhvIZAOLqaAObK0CzMOeVp5Q2XAOgRJYpcG9-DoXb2DsvkgaSLCbmiUZ_3qBZ7yIPq-2hcQVui49QKp4W6nhNNRQuW6DipSDxsDxt5CrZEoHj1d_oGRpV_-gXZQ Aug 04 03:39:20.646187 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Domain-Id: None Aug 04 03:39:20.646187 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Domain-Name: None Aug 04 03:39:20.646187 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Identity-Status: Confirmed Aug 04 03:39:20.646187 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Is-Admin-Project: True Aug 04 03:39:20.646187 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Project-Domain-Id: default Aug 04 03:39:20.646187 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Project-Domain-Name: Default Aug 04 03:39:20.646187 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Project-Id: 08ca5027abb74e11ac8c337217852767 Aug 04 03:39:20.646187 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1676260217 Aug 04 03:39:20.646187 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Role: member,reader Aug 04 03:39:20.646187 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Roles: member,reader Aug 04 03:39:20.647367 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/08ca5027abb74e11ac8c337217852767"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/08ca5027abb74e11ac8c337217852767"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/08ca5027abb74e11ac8c337217852767"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_08ca5027abb74e11ac8c337217852767"}]}] Aug 04 03:39:20.647367 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1676260217 Aug 04 03:39:20.647367 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Tenant-Id: 08ca5027abb74e11ac8c337217852767 Aug 04 03:39:20.647367 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1676260217 Aug 04 03:39:20.647367 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-User: tempest-VolumesSnapshotsTestJSON-1676260217-project Aug 04 03:39:20.647367 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-User-Domain-Id: default Aug 04 03:39:20.647367 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-User-Domain-Name: Default Aug 04 03:39:20.647367 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-User-Id: 3719507c161845789093a0c70189448f Aug 04 03:39:20.647367 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1676260217-project Aug 04 03:39:20.647367 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: method: Aug 04 03:39:20.647367 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: exception: Volume 68a9d165-2c49-47a3-b761-6e9e28767812 could not be found. Aug 04 03:39:20.647367 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: action_args: {'id': '68a9d165-2c49-47a3-b761-6e9e28767812'} Aug 04 03:39:20.647367 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 03:39:20.648118 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 03:39:20.648118 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 03:39:20.648118 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 03:39:20.648118 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 04 03:39:20.648118 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 04 03:39:20.648118 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 04 03:39:20.648118 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 04 03:39:20.648118 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 04 03:39:20.648118 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 04 03:39:20.648118 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 04 03:39:20.648118 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 04 03:39:20.648118 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 03:39:20.648118 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 03:39:20.648118 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 03:39:20.648118 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 03:39:20.648118 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 68a9d165-2c49-47a3-b761-6e9e28767812 could not be found. (HTTP 404) (Request-ID: req-84d8845a-a7af-4b3c-ae95-a8090c4a9e8f) Aug 04 03:39:20.648118 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi Aug 04 03:39:20.648118 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 03:39:20.648118 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi Aug 04 03:39:20.649046 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 03:39:20.649046 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 04 03:39:20.649046 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 04 03:39:20.649046 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 04 03:39:20.649046 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 04 03:39:20.649046 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 04 03:39:20.649046 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 04 03:39:20.649046 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 04 03:39:20.649046 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 04 03:39:20.649046 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 03:39:20.649046 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 03:39:20.649046 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 04 03:39:20.649046 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 04 03:39:20.649046 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 04 03:39:20.649046 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 04 03:39:20.649046 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 04 03:39:20.649046 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 04 03:39:20.649046 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 04 03:39:20.649046 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 04 03:39:20.651482 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 03:39:20.651482 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 03:39:20.651482 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 03:39:20.651482 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 03:39:20.651482 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 68a9d165-2c49-47a3-b761-6e9e28767812 could not be found. Aug 04 03:39:20.651482 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi Aug 04 03:39:20.651482 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 03:39:20.651482 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi Aug 04 03:39:20.651482 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 03:39:20.651482 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 03:39:20.651482 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 03:39:20.651482 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 03:39:20.651482 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 03:39:20.651482 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 03:39:20.651482 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 03:39:20.651482 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 03:39:20.651482 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 03:39:20.651482 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 04 03:39:20.651482 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 03:39:20.653322 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 68a9d165-2c49-47a3-b761-6e9e28767812 could not be found. Aug 04 03:39:20.653322 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi Aug 04 03:39:20.653322 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 03:39:20.653322 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi Aug 04 03:39:20.653322 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 03:39:20.653322 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 03:39:20.653322 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 03:39:20.653322 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 03:39:20.653322 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 03:39:20.653322 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 68a9d165-2c49-47a3-b761-6e9e28767812 could not be found. Aug 04 03:39:20.653322 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi Aug 04 03:39:20.653322 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-1e8fc613-14fc-47fd-8bd1-5bd04636bccf tempest-VolumesSnapshotsTestJSON-1676260217 tempest-VolumesSnapshotsTestJSON-1676260217-project] Returning 404 to user: Volume 68a9d165-2c49-47a3-b761-6e9e28767812 could not be found. {{(pid=130262) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 03:39:20.653322 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-1e8fc613-14fc-47fd-8bd1-5bd04636bccf tempest-VolumesSnapshotsTestJSON-1676260217 tempest-VolumesSnapshotsTestJSON-1676260217-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/68a9d165-2c49-47a3-b761-6e9e28767812" status: 404 len: 109 microversion: 2.1 time: 0.118160 Aug 04 03:39:20.653322 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 20/40] 10.222.0.66 () {58 vars in 1245 bytes} [Thu Aug 4 03:39:20 2022] GET /compute/v2.1/os-volumes/68a9d165-2c49-47a3-b761-6e9e28767812 => generated 109 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 03:39:20.664342 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-f70bc7b9-6c69-4b38-af9a-6f41df8cd61a tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.761888 Aug 04 03:39:20.666019 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-bdea3f83-02cb-4ab4-9e45-c2c41fe6d815 tempest-VolumesTestJSON-2135614783 tempest-VolumesTestJSON-2135614783-project] Calling method '.version_select at 0x7f72e84c9b80>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:39:20.673311 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 21/41] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 03:39:18 2022] POST /compute/v2.1/servers => generated 383 bytes in 1769 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 03:39:20.686567 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-5cdb8216-c2a4-4711-b8fb-3709c1c3fbc7 tempest-VolumesSnapshotsTestJSON-1676260217 tempest-VolumesSnapshotsTestJSON-1676260217-project] Calling method '.version_select at 0x7f72e85084c0>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:39:20.774802 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-bdea3f83-02cb-4ab4-9e45-c2c41fe6d815 tempest-VolumesTestJSON-2135614783 tempest-VolumesTestJSON-2135614783-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/01dc1372-4103-4305-a8d3-e5773ba10fce" status: 200 len: 351 microversion: 2.1 time: 0.119338 Aug 04 03:39:20.776067 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 21/42] 10.222.0.66 () {58 vars in 1245 bytes} [Thu Aug 4 03:39:20 2022] GET /compute/v2.1/os-volumes/01dc1372-4103-4305-a8d3-e5773ba10fce => generated 351 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 03:39:20.795242 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-60b8b57a-0604-4d8a-a589-6b29d804e1a6 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:39:20.795864 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-60b8b57a-0604-4d8a-a589-6b29d804e1a6 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] [instance: 60273216-f2ed-46cf-8836-1d85335d8920] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:39:20.807808 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.wsgi [None req-5cdb8216-c2a4-4711-b8fb-3709c1c3fbc7 tempest-VolumesSnapshotsTestJSON-1676260217 tempest-VolumesSnapshotsTestJSON-1676260217-project] HTTP exception thrown: Volume 68a9d165-2c49-47a3-b761-6e9e28767812 could not be found. Aug 04 03:39:20.810396 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-5cdb8216-c2a4-4711-b8fb-3709c1c3fbc7 tempest-VolumesSnapshotsTestJSON-1676260217 tempest-VolumesSnapshotsTestJSON-1676260217-project] Request method failure captured: Aug 04 03:39:20.810396 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: request: DELETE /compute/v2.1/os-volumes/68a9d165-2c49-47a3-b761-6e9e28767812 HTTP/1.1 Aug 04 03:39:20.810396 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Accept: application/json Aug 04 03:39:20.810396 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Accept-Encoding: identity Aug 04 03:39:20.810396 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Connection: close Aug 04 03:39:20.810396 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Content-Length: 0 Aug 04 03:39:20.810396 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Content-Type: application/json Aug 04 03:39:20.810396 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Host: 10.222.0.66 Aug 04 03:39:20.810396 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Openstack-System-Scope: None Aug 04 03:39:20.810396 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: User-Agent: python-urllib3/1.26.11 Aug 04 03:39:20.810396 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Auth-Token: gAAAAABi6z9WVkC0S9eJGFaCCMn1OGNQCSJuS2VJR6c8P84yFJoypN8cpmCsXhvIZAOLqaAObK0CzMOeVp5Q2XAOgRJYpcG9-DoXb2DsvkgaSLCbmiUZ_3qBZ7yIPq-2hcQVui49QKp4W6nhNNRQuW6DipSDxsDxt5CrZEoHj1d_oGRpV_-gXZQ Aug 04 03:39:20.810396 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Domain-Id: None Aug 04 03:39:20.810396 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Domain-Name: None Aug 04 03:39:20.810396 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Identity-Status: Confirmed Aug 04 03:39:20.810396 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Is-Admin-Project: True Aug 04 03:39:20.810396 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Project-Domain-Id: default Aug 04 03:39:20.810396 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Project-Domain-Name: Default Aug 04 03:39:20.810396 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Project-Id: 08ca5027abb74e11ac8c337217852767 Aug 04 03:39:20.810396 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1676260217 Aug 04 03:39:20.810396 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Role: member,reader Aug 04 03:39:20.810396 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Roles: member,reader Aug 04 03:39:20.811462 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/08ca5027abb74e11ac8c337217852767"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/08ca5027abb74e11ac8c337217852767"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/08ca5027abb74e11ac8c337217852767"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_08ca5027abb74e11ac8c337217852767"}]}] Aug 04 03:39:20.811462 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1676260217 Aug 04 03:39:20.811462 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Tenant-Id: 08ca5027abb74e11ac8c337217852767 Aug 04 03:39:20.811462 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1676260217 Aug 04 03:39:20.811462 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-User: tempest-VolumesSnapshotsTestJSON-1676260217-project Aug 04 03:39:20.811462 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-User-Domain-Id: default Aug 04 03:39:20.811462 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-User-Domain-Name: Default Aug 04 03:39:20.811462 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-User-Id: 3719507c161845789093a0c70189448f Aug 04 03:39:20.811462 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1676260217-project Aug 04 03:39:20.811462 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: method: Aug 04 03:39:20.811462 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: exception: Volume 68a9d165-2c49-47a3-b761-6e9e28767812 could not be found. Aug 04 03:39:20.811462 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: action_args: {'id': '68a9d165-2c49-47a3-b761-6e9e28767812'} Aug 04 03:39:20.811462 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 03:39:20.812075 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 03:39:20.812075 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 03:39:20.812075 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 03:39:20.812075 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 04 03:39:20.812075 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 04 03:39:20.812075 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 04 03:39:20.812075 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 04 03:39:20.812075 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 04 03:39:20.812075 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 04 03:39:20.812075 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 04 03:39:20.812075 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 04 03:39:20.812075 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 03:39:20.812075 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 03:39:20.812075 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 03:39:20.812075 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 03:39:20.812075 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 68a9d165-2c49-47a3-b761-6e9e28767812 could not be found. (HTTP 404) (Request-ID: req-b2a25dd3-d1f4-4a02-a29c-1e2ea3c9f409) Aug 04 03:39:20.812075 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Aug 04 03:39:20.812075 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 03:39:20.812075 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Aug 04 03:39:20.813007 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 03:39:20.813007 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 04 03:39:20.813007 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 04 03:39:20.813007 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 04 03:39:20.813007 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 04 03:39:20.813007 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 04 03:39:20.813007 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 04 03:39:20.813007 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 04 03:39:20.813007 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 04 03:39:20.813007 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 03:39:20.813007 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 03:39:20.813007 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 04 03:39:20.813007 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 04 03:39:20.813007 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 04 03:39:20.813007 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 04 03:39:20.813007 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 04 03:39:20.813007 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 04 03:39:20.813007 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 04 03:39:20.813007 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 04 03:39:20.820937 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 03:39:20.820937 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 03:39:20.820937 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 03:39:20.820937 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 03:39:20.820937 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 68a9d165-2c49-47a3-b761-6e9e28767812 could not be found. Aug 04 03:39:20.820937 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Aug 04 03:39:20.820937 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 03:39:20.820937 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Aug 04 03:39:20.820937 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 03:39:20.820937 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 03:39:20.820937 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 03:39:20.820937 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 03:39:20.820937 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 03:39:20.820937 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 03:39:20.820937 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 03:39:20.820937 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 03:39:20.820937 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 03:39:20.820937 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 04 03:39:20.820937 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 03:39:20.822238 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 68a9d165-2c49-47a3-b761-6e9e28767812 could not be found. Aug 04 03:39:20.822238 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Aug 04 03:39:20.822238 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 03:39:20.822238 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Aug 04 03:39:20.822238 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 03:39:20.822238 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 03:39:20.822238 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 03:39:20.822238 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 03:39:20.822238 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 03:39:20.822238 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 68a9d165-2c49-47a3-b761-6e9e28767812 could not be found. Aug 04 03:39:20.822238 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Aug 04 03:39:20.822238 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-5cdb8216-c2a4-4711-b8fb-3709c1c3fbc7 tempest-VolumesSnapshotsTestJSON-1676260217 tempest-VolumesSnapshotsTestJSON-1676260217-project] Returning 404 to user: Volume 68a9d165-2c49-47a3-b761-6e9e28767812 could not be found. {{(pid=130263) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 03:39:20.822238 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-5cdb8216-c2a4-4711-b8fb-3709c1c3fbc7 tempest-VolumesSnapshotsTestJSON-1676260217 tempest-VolumesSnapshotsTestJSON-1676260217-project] 10.222.0.66 "DELETE /compute/v2.1/os-volumes/68a9d165-2c49-47a3-b761-6e9e28767812" status: 404 len: 109 microversion: 2.1 time: 0.139793 Aug 04 03:39:20.822238 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 22/43] 10.222.0.66 () {58 vars in 1248 bytes} [Thu Aug 4 03:39:20 2022] DELETE /compute/v2.1/os-volumes/68a9d165-2c49-47a3-b761-6e9e28767812 => generated 109 bytes in 142 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 03:39:20.828885 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-32938af8-8794-4fd8-897c-cef092d191ff tempest-VolumesTestJSON-2135614783 tempest-VolumesTestJSON-2135614783-project] Calling method '.version_select at 0x7f72e8558ca0>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:39:21.030120 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-60b8b57a-0604-4d8a-a589-6b29d804e1a6 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec8d131a9764028a096314a4ecd58f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9ff6952b014d0a9abb28dcf0b818b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:39:21.045790 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-60b8b57a-0604-4d8a-a589-6b29d804e1a6 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] 10.222.0.66 "GET /compute/v2.1/servers/60273216-f2ed-46cf-8836-1d85335d8920" status: 200 len: 1222 microversion: 2.1 time: 0.267017 Aug 04 03:39:21.049569 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 22/44] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:39:20 2022] GET /compute/v2.1/servers/60273216-f2ed-46cf-8836-1d85335d8920 => generated 1222 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:39:21.066129 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-d1a41877-4fac-4689-8fc9-b419f45502af tempest-VolumesSnapshotsTestJSON-1676260217 tempest-VolumesSnapshotsTestJSON-1676260217-project] Calling method '.version_select at 0x7f72e8489160>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:39:21.106164 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-32938af8-8794-4fd8-897c-cef092d191ff tempest-VolumesTestJSON-2135614783 tempest-VolumesTestJSON-2135614783-project] 10.222.0.66 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.288129 Aug 04 03:39:21.106164 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 23/45] 10.222.0.66 () {58 vars in 1134 bytes} [Thu Aug 4 03:39:20 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:39:21.120708 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-43c024cc-7bef-45a8-adb0-d39b7ee28736 tempest-VolumesTestJSON-2135614783 tempest-VolumesTestJSON-2135614783-project] Calling method '.version_select at 0x7f72e85080d0>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:39:21.138636 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.wsgi [None req-d1a41877-4fac-4689-8fc9-b419f45502af tempest-VolumesSnapshotsTestJSON-1676260217 tempest-VolumesSnapshotsTestJSON-1676260217-project] HTTP exception thrown: Volume 68a9d165-2c49-47a3-b761-6e9e28767812 could not be found. Aug 04 03:39:21.141434 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-d1a41877-4fac-4689-8fc9-b419f45502af tempest-VolumesSnapshotsTestJSON-1676260217 tempest-VolumesSnapshotsTestJSON-1676260217-project] Request method failure captured: Aug 04 03:39:21.141434 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: request: GET /compute/v2.1/os-volumes/68a9d165-2c49-47a3-b761-6e9e28767812 HTTP/1.1 Aug 04 03:39:21.141434 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: Accept: application/json Aug 04 03:39:21.141434 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: Accept-Encoding: identity Aug 04 03:39:21.141434 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: Connection: close Aug 04 03:39:21.141434 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: Content-Length: 0 Aug 04 03:39:21.141434 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: Content-Type: application/json Aug 04 03:39:21.141434 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: Host: 10.222.0.66 Aug 04 03:39:21.141434 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: Openstack-System-Scope: None Aug 04 03:39:21.141434 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: User-Agent: python-urllib3/1.26.11 Aug 04 03:39:21.141434 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Auth-Token: gAAAAABi6z9WVkC0S9eJGFaCCMn1OGNQCSJuS2VJR6c8P84yFJoypN8cpmCsXhvIZAOLqaAObK0CzMOeVp5Q2XAOgRJYpcG9-DoXb2DsvkgaSLCbmiUZ_3qBZ7yIPq-2hcQVui49QKp4W6nhNNRQuW6DipSDxsDxt5CrZEoHj1d_oGRpV_-gXZQ Aug 04 03:39:21.141434 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Domain-Id: None Aug 04 03:39:21.141434 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Domain-Name: None Aug 04 03:39:21.141434 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Identity-Status: Confirmed Aug 04 03:39:21.141434 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Is-Admin-Project: True Aug 04 03:39:21.141434 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Project-Domain-Id: default Aug 04 03:39:21.141434 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Project-Domain-Name: Default Aug 04 03:39:21.141434 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Project-Id: 08ca5027abb74e11ac8c337217852767 Aug 04 03:39:21.141434 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1676260217 Aug 04 03:39:21.141434 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Role: member,reader Aug 04 03:39:21.141434 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Roles: member,reader Aug 04 03:39:21.142746 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/08ca5027abb74e11ac8c337217852767"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/08ca5027abb74e11ac8c337217852767"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/08ca5027abb74e11ac8c337217852767"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_08ca5027abb74e11ac8c337217852767"}]}] Aug 04 03:39:21.142746 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1676260217 Aug 04 03:39:21.142746 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Tenant-Id: 08ca5027abb74e11ac8c337217852767 Aug 04 03:39:21.142746 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1676260217 Aug 04 03:39:21.142746 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-User: tempest-VolumesSnapshotsTestJSON-1676260217-project Aug 04 03:39:21.142746 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-User-Domain-Id: default Aug 04 03:39:21.142746 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-User-Domain-Name: Default Aug 04 03:39:21.142746 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-User-Id: 3719507c161845789093a0c70189448f Aug 04 03:39:21.142746 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1676260217-project Aug 04 03:39:21.142746 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: method: Aug 04 03:39:21.142746 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: exception: Volume 68a9d165-2c49-47a3-b761-6e9e28767812 could not be found. Aug 04 03:39:21.142746 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: action_args: {'id': '68a9d165-2c49-47a3-b761-6e9e28767812'} Aug 04 03:39:21.142746 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 03:39:21.143835 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 03:39:21.143835 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 03:39:21.143835 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 03:39:21.143835 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 04 03:39:21.143835 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 04 03:39:21.143835 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 04 03:39:21.143835 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 04 03:39:21.143835 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 04 03:39:21.143835 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 04 03:39:21.143835 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 04 03:39:21.143835 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 04 03:39:21.143835 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 03:39:21.143835 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 03:39:21.143835 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 03:39:21.143835 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 03:39:21.143835 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 68a9d165-2c49-47a3-b761-6e9e28767812 could not be found. (HTTP 404) (Request-ID: req-3b579351-38b5-4f43-8ef8-528f57779e4e) Aug 04 03:39:21.143835 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi Aug 04 03:39:21.143835 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 03:39:21.143835 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi Aug 04 03:39:21.144985 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 03:39:21.144985 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 04 03:39:21.144985 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 04 03:39:21.144985 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 04 03:39:21.144985 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 04 03:39:21.144985 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 04 03:39:21.144985 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 04 03:39:21.144985 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 04 03:39:21.144985 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 04 03:39:21.144985 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 03:39:21.144985 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 03:39:21.144985 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 04 03:39:21.144985 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 04 03:39:21.144985 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 04 03:39:21.144985 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 04 03:39:21.144985 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 04 03:39:21.144985 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 04 03:39:21.144985 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 04 03:39:21.144985 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 04 03:39:21.146680 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 03:39:21.146680 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 03:39:21.146680 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 03:39:21.146680 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 03:39:21.146680 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 68a9d165-2c49-47a3-b761-6e9e28767812 could not be found. Aug 04 03:39:21.146680 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi Aug 04 03:39:21.146680 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 03:39:21.146680 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi Aug 04 03:39:21.146680 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 03:39:21.146680 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 03:39:21.146680 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 03:39:21.146680 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 03:39:21.146680 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 03:39:21.146680 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 03:39:21.146680 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 03:39:21.146680 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 03:39:21.146680 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 03:39:21.146680 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 04 03:39:21.146680 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 03:39:21.148326 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 68a9d165-2c49-47a3-b761-6e9e28767812 could not be found. Aug 04 03:39:21.148326 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi Aug 04 03:39:21.148326 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 03:39:21.148326 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi Aug 04 03:39:21.148326 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 03:39:21.148326 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 03:39:21.148326 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 03:39:21.148326 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 03:39:21.148326 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 03:39:21.148326 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 68a9d165-2c49-47a3-b761-6e9e28767812 could not be found. Aug 04 03:39:21.148326 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi Aug 04 03:39:21.151158 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-d1a41877-4fac-4689-8fc9-b419f45502af tempest-VolumesSnapshotsTestJSON-1676260217 tempest-VolumesSnapshotsTestJSON-1676260217-project] Returning 404 to user: Volume 68a9d165-2c49-47a3-b761-6e9e28767812 could not be found. {{(pid=130262) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 03:39:21.152208 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-d1a41877-4fac-4689-8fc9-b419f45502af tempest-VolumesSnapshotsTestJSON-1676260217 tempest-VolumesSnapshotsTestJSON-1676260217-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/68a9d165-2c49-47a3-b761-6e9e28767812" status: 404 len: 109 microversion: 2.1 time: 0.099103 Aug 04 03:39:21.164153 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 23/46] 10.222.0.66 () {58 vars in 1245 bytes} [Thu Aug 4 03:39:21 2022] GET /compute/v2.1/os-volumes/68a9d165-2c49-47a3-b761-6e9e28767812 => generated 109 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 03:39:21.308118 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-43c024cc-7bef-45a8-adb0-d39b7ee28736 tempest-VolumesTestJSON-2135614783 tempest-VolumesTestJSON-2135614783-project] 10.222.0.66 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.192459 Aug 04 03:39:21.308925 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 24/47] 10.222.0.66 () {58 vars in 1149 bytes} [Thu Aug 4 03:39:21 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 03:39:21.336456 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-c1901cb1-57d7-4811-84df-4e3213a35f8e tempest-VolumesTestJSON-2135614783 tempest-VolumesTestJSON-2135614783-project] Calling method '.version_select at 0x7f72e84898b0>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:39:21.517136 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-c1901cb1-57d7-4811-84df-4e3213a35f8e tempest-VolumesTestJSON-2135614783 tempest-VolumesTestJSON-2135614783-project] 10.222.0.66 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.194699 Aug 04 03:39:21.518903 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 24/48] 10.222.0.66 () {58 vars in 1134 bytes} [Thu Aug 4 03:39:21 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:39:21.532097 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-8d1c3fc3-fed3-4630-9661-c0a5ea32bdac tempest-VolumesTestJSON-2135614783 tempest-VolumesTestJSON-2135614783-project] Calling method '.version_select at 0x7f72e851a280>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:39:21.540518 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-d88b00c3-6fb5-466a-bc91-fc7e701ae094 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:39:21.541104 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-d88b00c3-6fb5-466a-bc91-fc7e701ae094 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] [instance: f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:39:21.586300 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-d88b00c3-6fb5-466a-bc91-fc7e701ae094 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:39:21.586846 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-d88b00c3-6fb5-466a-bc91-fc7e701ae094 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:39:21.601169 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-d88b00c3-6fb5-466a-bc91-fc7e701ae094 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:39:21.605224 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-d88b00c3-6fb5-466a-bc91-fc7e701ae094 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:39:21.741615 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-d88b00c3-6fb5-466a-bc91-fc7e701ae094 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f4252210bd412ba24305b00a6e77b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a97e25e7eae402f8f5c4222019ed87c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:39:21.771800 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-d88b00c3-6fb5-466a-bc91-fc7e701ae094 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] 10.222.0.66 "GET /compute/v2.1/servers/f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e" status: 200 len: 1265 microversion: 2.1 time: 0.234330 Aug 04 03:39:21.779986 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-8d1c3fc3-fed3-4630-9661-c0a5ea32bdac tempest-VolumesTestJSON-2135614783 tempest-VolumesTestJSON-2135614783-project] 10.222.0.66 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.251587 Aug 04 03:39:21.789910 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 25/49] 10.222.0.66 () {58 vars in 1167 bytes} [Thu Aug 4 03:39:21 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 03:39:21.795795 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-b9169112-3dd4-4ae0-af82-ffd1d78dc997 tempest-VolumesTestJSON-2135614783 tempest-VolumesTestJSON-2135614783-project] Calling method '.version_select at 0x7f72e851aca0>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:39:21.800102 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 25/50] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:39:21 2022] GET /compute/v2.1/servers/f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e => generated 1265 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 03:39:21.965330 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-b9169112-3dd4-4ae0-af82-ffd1d78dc997 tempest-VolumesTestJSON-2135614783 tempest-VolumesTestJSON-2135614783-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.174204 Aug 04 03:39:21.965907 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 26/51] 10.222.0.66 () {58 vars in 1170 bytes} [Thu Aug 4 03:39:21 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 03:39:21.980308 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-e7dd9a2f-424c-4063-a3f0-bab5bd85e259 tempest-VolumesTestJSON-2135614783 tempest-VolumesTestJSON-2135614783-project] Calling method '.version_select at 0x7f72e8541e50>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:39:22.071984 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-41cec8f5-f21d-48af-9ace-b54bc8792c0c tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:39:22.072605 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-41cec8f5-f21d-48af-9ace-b54bc8792c0c tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] [instance: 60273216-f2ed-46cf-8836-1d85335d8920] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:39:22.346675 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-e7dd9a2f-424c-4063-a3f0-bab5bd85e259 tempest-VolumesTestJSON-2135614783 tempest-VolumesTestJSON-2135614783-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.370071 Aug 04 03:39:22.348133 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 26/52] 10.222.0.66 () {58 vars in 1155 bytes} [Thu Aug 4 03:39:21 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:39:22.362801 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-3107d4c9-8226-486c-b7ca-06df28fff6b4 tempest-VolumesTestJSON-2135614783 tempest-VolumesTestJSON-2135614783-project] Calling method '.version_select at 0x7f72e8430dc0>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:39:22.579651 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-3107d4c9-8226-486c-b7ca-06df28fff6b4 tempest-VolumesTestJSON-2135614783 tempest-VolumesTestJSON-2135614783-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.221593 Aug 04 03:39:22.581189 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 27/53] 10.222.0.66 () {58 vars in 1188 bytes} [Thu Aug 4 03:39:22 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 03:39:22.594689 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-8e5d48ce-bde7-4fed-b9ed-3b6c8315ca88 tempest-VolumesTestJSON-2135614783 tempest-VolumesTestJSON-2135614783-project] Calling method '.version_select at 0x7f72e8430670>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:39:22.785242 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-41cec8f5-f21d-48af-9ace-b54bc8792c0c tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec8d131a9764028a096314a4ecd58f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9ff6952b014d0a9abb28dcf0b818b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:39:22.801237 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-41cec8f5-f21d-48af-9ace-b54bc8792c0c tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] 10.222.0.66 "GET /compute/v2.1/servers/60273216-f2ed-46cf-8836-1d85335d8920" status: 200 len: 1222 microversion: 2.1 time: 0.731313 Aug 04 03:39:22.802656 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 27/54] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:39:22 2022] GET /compute/v2.1/servers/60273216-f2ed-46cf-8836-1d85335d8920 => generated 1222 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 03:39:22.840134 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-0d10876e-b188-4d0c-ba08-2a4bde39980f tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:39:22.840854 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-0d10876e-b188-4d0c-ba08-2a4bde39980f tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] [instance: f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:39:22.878217 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-0d10876e-b188-4d0c-ba08-2a4bde39980f tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:39:22.880840 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-0d10876e-b188-4d0c-ba08-2a4bde39980f tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:39:22.886832 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-0d10876e-b188-4d0c-ba08-2a4bde39980f tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:39:22.887778 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-0d10876e-b188-4d0c-ba08-2a4bde39980f tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:39:22.937454 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-8e5d48ce-bde7-4fed-b9ed-3b6c8315ca88 tempest-VolumesTestJSON-2135614783 tempest-VolumesTestJSON-2135614783-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.346993 Aug 04 03:39:22.938030 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 28/55] 10.222.0.66 () {58 vars in 1155 bytes} [Thu Aug 4 03:39:22 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:39:23.276772 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-3a38ea98-fb1c-45f3-a4a6-fc5aa312fe08 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-448064493", "imageRef": "0208f4b3-1d2f-42e4-a9b4-528bf5066fe1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f4a2360d-a859-43ed-85be-aea044bbfe33"}], "security_groups": [{"name": "tempest-securitygroup--631542287"}], "key_name": "tempest-keypair-874038558", "user_data": "}} {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 03:39:23.542403 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-0d10876e-b188-4d0c-ba08-2a4bde39980f tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f4252210bd412ba24305b00a6e77b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a97e25e7eae402f8f5c4222019ed87c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:39:23.577106 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-0d10876e-b188-4d0c-ba08-2a4bde39980f tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] 10.222.0.66 "GET /compute/v2.1/servers/f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e" status: 200 len: 1271 microversion: 2.1 time: 0.740381 Aug 04 03:39:23.578556 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 28/56] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:39:22 2022] GET /compute/v2.1/servers/f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e => generated 1271 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 03:39:23.658046 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.network.neutron [None req-3a38ea98-fb1c-45f3-a4a6-fc5aa312fe08 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] validate_networks() for [('f4a2360d-a859-43ed-85be-aea044bbfe33', None, None, None, None, None)] {{(pid=130262) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 03:39:23.826221 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-d222c789-2e39-44b4-b1d5-b046eff208e6 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:39:23.826830 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-d222c789-2e39-44b4-b1d5-b046eff208e6 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] [instance: 60273216-f2ed-46cf-8836-1d85335d8920] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:39:23.832845 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-d222c789-2e39-44b4-b1d5-b046eff208e6 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:39:23.833456 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-d222c789-2e39-44b4-b1d5-b046eff208e6 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:39:23.834226 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-d222c789-2e39-44b4-b1d5-b046eff208e6 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:39:23.834664 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-d222c789-2e39-44b4-b1d5-b046eff208e6 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:39:23.944253 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-d222c789-2e39-44b4-b1d5-b046eff208e6 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec8d131a9764028a096314a4ecd58f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9ff6952b014d0a9abb28dcf0b818b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:39:23.954336 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-d222c789-2e39-44b4-b1d5-b046eff208e6 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] 10.222.0.66 "GET /compute/v2.1/servers/60273216-f2ed-46cf-8836-1d85335d8920" status: 200 len: 1274 microversion: 2.1 time: 0.132025 Aug 04 03:39:23.955820 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 29/57] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:39:23 2022] GET /compute/v2.1/servers/60273216-f2ed-46cf-8836-1d85335d8920 => generated 1274 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 03:39:24.601691 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-2655e8c6-5dc0-438f-be25-25eec7c7e31b tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:39:24.607691 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-2655e8c6-5dc0-438f-be25-25eec7c7e31b tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] [instance: f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:39:24.615302 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-2655e8c6-5dc0-438f-be25-25eec7c7e31b tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:39:24.616070 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-2655e8c6-5dc0-438f-be25-25eec7c7e31b tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:39:24.617366 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-2655e8c6-5dc0-438f-be25-25eec7c7e31b tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:39:24.617960 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-2655e8c6-5dc0-438f-be25-25eec7c7e31b tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:39:24.865534 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-2655e8c6-5dc0-438f-be25-25eec7c7e31b tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f4252210bd412ba24305b00a6e77b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a97e25e7eae402f8f5c4222019ed87c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:39:24.874523 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-2655e8c6-5dc0-438f-be25-25eec7c7e31b tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] 10.222.0.66 "GET /compute/v2.1/servers/f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e" status: 200 len: 1271 microversion: 2.1 time: 0.276977 Aug 04 03:39:24.877549 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 30/58] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:39:24 2022] GET /compute/v2.1/servers/f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e => generated 1271 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:39:24.985571 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-f81f7f26-33e1-4929-bebe-3cc859fa36df tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:39:24.986488 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-f81f7f26-33e1-4929-bebe-3cc859fa36df tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] [instance: 60273216-f2ed-46cf-8836-1d85335d8920] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:39:25.004463 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-f81f7f26-33e1-4929-bebe-3cc859fa36df tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:39:25.006664 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-f81f7f26-33e1-4929-bebe-3cc859fa36df tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:39:25.009623 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-f81f7f26-33e1-4929-bebe-3cc859fa36df tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:39:25.011700 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-f81f7f26-33e1-4929-bebe-3cc859fa36df tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:39:25.061447 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.virt.hardware [None req-3a38ea98-fb1c-45f3-a4a6-fc5aa312fe08 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Flavor limits 0:0:0 {{(pid=130262) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 03:39:25.061959 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.virt.hardware [None req-3a38ea98-fb1c-45f3-a4a6-fc5aa312fe08 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Image limits 0:0:0 {{(pid=130262) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 03:39:25.062721 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.virt.hardware [None req-3a38ea98-fb1c-45f3-a4a6-fc5aa312fe08 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Flavor pref 0:0:0 {{(pid=130262) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 03:39:25.066954 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.virt.hardware [None req-3a38ea98-fb1c-45f3-a4a6-fc5aa312fe08 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Image pref 0:0:0 {{(pid=130262) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 03:39:25.066954 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.virt.hardware [None req-3a38ea98-fb1c-45f3-a4a6-fc5aa312fe08 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130262) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 03:39:25.075349 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-3a38ea98-fb1c-45f3-a4a6-fc5aa312fe08 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:39:25.076053 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-3a38ea98-fb1c-45f3-a4a6-fc5aa312fe08 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:39:25.077011 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-3a38ea98-fb1c-45f3-a4a6-fc5aa312fe08 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:39:25.077629 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-3a38ea98-fb1c-45f3-a4a6-fc5aa312fe08 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:39:25.100388 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.quota [None req-3a38ea98-fb1c-45f3-a4a6-fc5aa312fe08 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Getting quotas for project f46b8dc64007429b805971d4c6f5b471. Resources: {'instances', 'ram', 'cores'} {{(pid=130262) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 03:39:25.105269 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.quota [None req-3a38ea98-fb1c-45f3-a4a6-fc5aa312fe08 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Getting quotas for user 6dba436d0a67433f8c8ae7cd40d3f795 and project f46b8dc64007429b805971d4c6f5b471. Resources: {'instances', 'ram', 'cores'} {{(pid=130262) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 03:39:25.124818 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-3a38ea98-fb1c-45f3-a4a6-fc5aa312fe08 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Going to run 1 instances... {{(pid=130262) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 03:39:25.132407 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-3a38ea98-fb1c-45f3-a4a6-fc5aa312fe08 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] [instance: 9307fdad-ca63-449d-bc5c-7e9e167c59f3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0208f4b3-1d2f-42e4-a9b4-528bf5066fe1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130262) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 03:39:25.183147 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-f81f7f26-33e1-4929-bebe-3cc859fa36df tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec8d131a9764028a096314a4ecd58f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9ff6952b014d0a9abb28dcf0b818b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:39:25.197094 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-f81f7f26-33e1-4929-bebe-3cc859fa36df tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] 10.222.0.66 "GET /compute/v2.1/servers/60273216-f2ed-46cf-8836-1d85335d8920" status: 200 len: 1280 microversion: 2.1 time: 0.216971 Aug 04 03:39:25.201172 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 31/59] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:39:24 2022] GET /compute/v2.1/servers/60273216-f2ed-46cf-8836-1d85335d8920 => generated 1280 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 03:39:25.379640 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-3a38ea98-fb1c-45f3-a4a6-fc5aa312fe08 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.104356 Aug 04 03:39:25.382578 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 29/60] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 03:39:23 2022] POST /compute/v2.1/servers => generated 401 bytes in 2111 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 04 03:39:25.395512 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-ab64d938-f943-48ab-8cb9-2c0d70439610 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:39:25.396462 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-ab64d938-f943-48ab-8cb9-2c0d70439610 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] [instance: 9307fdad-ca63-449d-bc5c-7e9e167c59f3] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:39:25.867278 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-ab64d938-f943-48ab-8cb9-2c0d70439610 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dba436d0a67433f8c8ae7cd40d3f795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46b8dc64007429b805971d4c6f5b471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:39:25.875976 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-ab64d938-f943-48ab-8cb9-2c0d70439610 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] 10.222.0.66 "GET /compute/v2.1/servers/9307fdad-ca63-449d-bc5c-7e9e167c59f3" status: 200 len: 1236 microversion: 2.1 time: 0.485519 Aug 04 03:39:25.878477 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 32/61] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:39:25 2022] GET /compute/v2.1/servers/9307fdad-ca63-449d-bc5c-7e9e167c59f3 => generated 1236 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:39:25.900976 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-15569e8f-73be-4929-b962-0a33f1a9a5d8 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:39:25.901680 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-15569e8f-73be-4929-b962-0a33f1a9a5d8 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] [instance: f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:39:25.920509 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-15569e8f-73be-4929-b962-0a33f1a9a5d8 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:39:25.920968 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-15569e8f-73be-4929-b962-0a33f1a9a5d8 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:39:25.921896 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-15569e8f-73be-4929-b962-0a33f1a9a5d8 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:39:25.922333 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-15569e8f-73be-4929-b962-0a33f1a9a5d8 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:39:26.222622 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-ac3f8e73-da8c-45c1-b3d2-b495a61db12c tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:39:26.223398 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-ac3f8e73-da8c-45c1-b3d2-b495a61db12c tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] [instance: 60273216-f2ed-46cf-8836-1d85335d8920] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:39:26.232035 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-ac3f8e73-da8c-45c1-b3d2-b495a61db12c tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:39:26.232754 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-ac3f8e73-da8c-45c1-b3d2-b495a61db12c tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:39:26.233716 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-ac3f8e73-da8c-45c1-b3d2-b495a61db12c tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:39:26.234294 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-ac3f8e73-da8c-45c1-b3d2-b495a61db12c tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:39:26.524582 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-ac3f8e73-da8c-45c1-b3d2-b495a61db12c tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec8d131a9764028a096314a4ecd58f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9ff6952b014d0a9abb28dcf0b818b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:39:26.537937 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-15569e8f-73be-4929-b962-0a33f1a9a5d8 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f4252210bd412ba24305b00a6e77b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a97e25e7eae402f8f5c4222019ed87c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:39:26.543877 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-ac3f8e73-da8c-45c1-b3d2-b495a61db12c tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] 10.222.0.66 "GET /compute/v2.1/servers/60273216-f2ed-46cf-8836-1d85335d8920" status: 200 len: 1280 microversion: 2.1 time: 0.328469 Aug 04 03:39:26.558600 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-15569e8f-73be-4929-b962-0a33f1a9a5d8 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] 10.222.0.66 "GET /compute/v2.1/servers/f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e" status: 200 len: 1313 microversion: 2.1 time: 0.661501 Aug 04 03:39:26.577872 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 30/62] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:39:25 2022] GET /compute/v2.1/servers/f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e => generated 1313 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:39:26.578093 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 33/63] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:39:26 2022] GET /compute/v2.1/servers/60273216-f2ed-46cf-8836-1d85335d8920 => generated 1280 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:39:26.903602 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-ef2a2b38-a62d-4037-97ed-3122822bdfb4 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:39:26.904484 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-ef2a2b38-a62d-4037-97ed-3122822bdfb4 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] [instance: 9307fdad-ca63-449d-bc5c-7e9e167c59f3] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:39:27.058706 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-ef2a2b38-a62d-4037-97ed-3122822bdfb4 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dba436d0a67433f8c8ae7cd40d3f795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46b8dc64007429b805971d4c6f5b471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:39:27.079262 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-ef2a2b38-a62d-4037-97ed-3122822bdfb4 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] 10.222.0.66 "GET /compute/v2.1/servers/9307fdad-ca63-449d-bc5c-7e9e167c59f3" status: 200 len: 1236 microversion: 2.1 time: 0.171643 Aug 04 03:39:27.081396 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 31/64] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:39:26 2022] GET /compute/v2.1/servers/9307fdad-ca63-449d-bc5c-7e9e167c59f3 => generated 1236 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:39:27.581580 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-2ee8ef87-1e52-4a44-9b8b-696b41ed9e7d tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:39:27.583161 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-2ee8ef87-1e52-4a44-9b8b-696b41ed9e7d tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] [instance: 60273216-f2ed-46cf-8836-1d85335d8920] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:39:27.589652 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-505007ad-3131-4edc-aafb-f532d3a7b6b5 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:39:27.591621 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-505007ad-3131-4edc-aafb-f532d3a7b6b5 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] [instance: f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:39:27.637405 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-505007ad-3131-4edc-aafb-f532d3a7b6b5 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:39:27.637405 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-505007ad-3131-4edc-aafb-f532d3a7b6b5 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:39:27.637405 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-505007ad-3131-4edc-aafb-f532d3a7b6b5 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:39:27.637405 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-505007ad-3131-4edc-aafb-f532d3a7b6b5 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:39:27.639763 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-2ee8ef87-1e52-4a44-9b8b-696b41ed9e7d tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:39:27.639763 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-2ee8ef87-1e52-4a44-9b8b-696b41ed9e7d tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:39:27.639763 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-2ee8ef87-1e52-4a44-9b8b-696b41ed9e7d tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:39:27.639763 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-2ee8ef87-1e52-4a44-9b8b-696b41ed9e7d tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:39:28.403528 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-2ee8ef87-1e52-4a44-9b8b-696b41ed9e7d tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec8d131a9764028a096314a4ecd58f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9ff6952b014d0a9abb28dcf0b818b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:39:28.423458 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-2ee8ef87-1e52-4a44-9b8b-696b41ed9e7d tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] 10.222.0.66 "GET /compute/v2.1/servers/60273216-f2ed-46cf-8836-1d85335d8920" status: 200 len: 1322 microversion: 2.1 time: 0.841026 Aug 04 03:39:28.425735 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 34/65] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:39:27 2022] GET /compute/v2.1/servers/60273216-f2ed-46cf-8836-1d85335d8920 => generated 1322 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:39:28.431778 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-b4160b8d-f281-4120-8c11-333908e4ade6 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:39:28.432628 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-b4160b8d-f281-4120-8c11-333908e4ade6 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] [instance: 9307fdad-ca63-449d-bc5c-7e9e167c59f3] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:39:28.441107 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-b4160b8d-f281-4120-8c11-333908e4ade6 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:39:28.442129 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-b4160b8d-f281-4120-8c11-333908e4ade6 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:39:28.443146 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-b4160b8d-f281-4120-8c11-333908e4ade6 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:39:28.443846 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-b4160b8d-f281-4120-8c11-333908e4ade6 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:39:28.465104 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-505007ad-3131-4edc-aafb-f532d3a7b6b5 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f4252210bd412ba24305b00a6e77b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a97e25e7eae402f8f5c4222019ed87c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:39:28.480366 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-505007ad-3131-4edc-aafb-f532d3a7b6b5 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] 10.222.0.66 "GET /compute/v2.1/servers/f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e" status: 200 len: 1313 microversion: 2.1 time: 0.894442 Aug 04 03:39:28.481049 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 32/66] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:39:27 2022] GET /compute/v2.1/servers/f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e => generated 1313 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 03:39:28.539628 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-b4160b8d-f281-4120-8c11-333908e4ade6 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dba436d0a67433f8c8ae7cd40d3f795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46b8dc64007429b805971d4c6f5b471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:39:28.548023 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-b4160b8d-f281-4120-8c11-333908e4ade6 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] 10.222.0.66 "GET /compute/v2.1/servers/9307fdad-ca63-449d-bc5c-7e9e167c59f3" status: 200 len: 1288 microversion: 2.1 time: 0.120116 Aug 04 03:39:28.549189 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 35/67] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:39:28 2022] GET /compute/v2.1/servers/9307fdad-ca63-449d-bc5c-7e9e167c59f3 => generated 1288 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:39:29.468455 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-44f23326-5cdc-4569-bbeb-247746baee38 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:39:29.469912 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-44f23326-5cdc-4569-bbeb-247746baee38 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] [instance: 60273216-f2ed-46cf-8836-1d85335d8920] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:39:29.478037 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-44f23326-5cdc-4569-bbeb-247746baee38 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:39:29.478862 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-44f23326-5cdc-4569-bbeb-247746baee38 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:39:29.479915 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-44f23326-5cdc-4569-bbeb-247746baee38 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:39:29.480775 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-44f23326-5cdc-4569-bbeb-247746baee38 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:39:29.503115 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-fcb58538-5164-46d8-8d4d-b159cde67d8f tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:39:29.503723 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-fcb58538-5164-46d8-8d4d-b159cde67d8f tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] [instance: f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:39:29.529259 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-fcb58538-5164-46d8-8d4d-b159cde67d8f tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:39:29.529259 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-fcb58538-5164-46d8-8d4d-b159cde67d8f tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:39:29.529259 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-fcb58538-5164-46d8-8d4d-b159cde67d8f tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:39:29.538661 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-fcb58538-5164-46d8-8d4d-b159cde67d8f tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:39:29.884961 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-44f23326-5cdc-4569-bbeb-247746baee38 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec8d131a9764028a096314a4ecd58f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9ff6952b014d0a9abb28dcf0b818b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:39:29.899156 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-44f23326-5cdc-4569-bbeb-247746baee38 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] 10.222.0.66 "GET /compute/v2.1/servers/60273216-f2ed-46cf-8836-1d85335d8920" status: 200 len: 1322 microversion: 2.1 time: 0.438478 Aug 04 03:39:29.934026 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 33/68] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:39:29 2022] GET /compute/v2.1/servers/60273216-f2ed-46cf-8836-1d85335d8920 => generated 1322 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:39:29.950350 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-1b1e3aba-9651-4e62-899c-0b42d960d930 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:39:29.953375 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-1b1e3aba-9651-4e62-899c-0b42d960d930 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] [instance: 9307fdad-ca63-449d-bc5c-7e9e167c59f3] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:39:29.971573 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-1b1e3aba-9651-4e62-899c-0b42d960d930 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:39:29.972203 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-1b1e3aba-9651-4e62-899c-0b42d960d930 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:39:29.974447 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-1b1e3aba-9651-4e62-899c-0b42d960d930 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:39:29.975077 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-1b1e3aba-9651-4e62-899c-0b42d960d930 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:39:30.120299 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-fcb58538-5164-46d8-8d4d-b159cde67d8f tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f4252210bd412ba24305b00a6e77b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a97e25e7eae402f8f5c4222019ed87c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:39:30.132450 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-fcb58538-5164-46d8-8d4d-b159cde67d8f tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] 10.222.0.66 "GET /compute/v2.1/servers/f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e" status: 200 len: 1313 microversion: 2.1 time: 0.633398 Aug 04 03:39:30.137967 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 36/69] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:39:29 2022] GET /compute/v2.1/servers/f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e => generated 1313 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 03:39:30.199542 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-1b1e3aba-9651-4e62-899c-0b42d960d930 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dba436d0a67433f8c8ae7cd40d3f795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46b8dc64007429b805971d4c6f5b471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:39:30.214061 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-1b1e3aba-9651-4e62-899c-0b42d960d930 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] 10.222.0.66 "GET /compute/v2.1/servers/9307fdad-ca63-449d-bc5c-7e9e167c59f3" status: 200 len: 1288 microversion: 2.1 time: 0.277811 Aug 04 03:39:30.215739 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 34/70] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:39:29 2022] GET /compute/v2.1/servers/9307fdad-ca63-449d-bc5c-7e9e167c59f3 => generated 1288 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:39:30.383210 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG dbcounter [-] [130263] Writing DB stats nova_cell0:SELECT=4 {{(pid=130263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:39:30.730007 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [req-db1da07d-a6d2-47e5-bcc7-34a64fe5d40e req-fe46f173-9067-4d1e-94d9-f87b84c6c07b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8620bffd-405f-41cc-9388-abdb301923d5", "tag": "fda02e5d-f2e1-4658-81b6-f9d2c0fd627f"}]} {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 03:39:30.762172 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [req-db1da07d-a6d2-47e5-bcc7-34a64fe5d40e req-fe46f173-9067-4d1e-94d9-f87b84c6c07b service nova] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:39:30.777020 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [req-db1da07d-a6d2-47e5-bcc7-34a64fe5d40e req-fe46f173-9067-4d1e-94d9-f87b84c6c07b service nova] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:39:30.825432 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.compute.server_external_events [req-db1da07d-a6d2-47e5-bcc7-34a64fe5d40e req-fe46f173-9067-4d1e-94d9-f87b84c6c07b service nova] Creating event network-changed:fda02e5d-f2e1-4658-81b6-f9d2c0fd627f for instance 8620bffd-405f-41cc-9388-abdb301923d5 on hv-cinder-73306 Aug 04 03:39:30.827494 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [req-db1da07d-a6d2-47e5-bcc7-34a64fe5d40e req-fe46f173-9067-4d1e-94d9-f87b84c6c07b service nova] Acquired lock "compute-rpcapi-router" {{(pid=130263) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Aug 04 03:39:30.830794 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-61d02f87-e388-4bd7-9988-da0c18d62681 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:39:30.832206 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-61d02f87-e388-4bd7-9988-da0c18d62681 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:39:30.838389 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-61d02f87-e388-4bd7-9988-da0c18d62681 None None] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:39:30.839308 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-61d02f87-e388-4bd7-9988-da0c18d62681 None None] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:39:30.859190 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.compute.rpcapi [None req-61d02f87-e388-4bd7-9988-da0c18d62681 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 04 03:39:30.870151 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-61d02f87-e388-4bd7-9988-da0c18d62681 None None] Releasing lock "compute-rpcapi-router" {{(pid=130263) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Aug 04 03:39:30.890451 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-61d02f87-e388-4bd7-9988-da0c18d62681 None None] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.708146 Aug 04 03:39:30.893034 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 37/71] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 03:39:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 03:39:30.945119 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-de0dba39-bfd4-491e-a649-d15e1cdb61e0 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:39:30.945923 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-de0dba39-bfd4-491e-a649-d15e1cdb61e0 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] [instance: 60273216-f2ed-46cf-8836-1d85335d8920] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:39:30.965708 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-de0dba39-bfd4-491e-a649-d15e1cdb61e0 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:39:30.969663 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-de0dba39-bfd4-491e-a649-d15e1cdb61e0 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:39:30.970554 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-de0dba39-bfd4-491e-a649-d15e1cdb61e0 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:39:30.971081 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-de0dba39-bfd4-491e-a649-d15e1cdb61e0 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:39:31.289900 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [req-a327caab-158c-4d10-9db7-16b682d3f273 req-93f2f900-4ab7-4df4-90f0-d7d7931a5951 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e", "tag": "5a965454-938f-4b0b-a81b-3e2875b1b5f6"}]} {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 03:39:31.318203 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [req-a327caab-158c-4d10-9db7-16b682d3f273 req-93f2f900-4ab7-4df4-90f0-d7d7931a5951 service nova] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:39:31.320873 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [req-a327caab-158c-4d10-9db7-16b682d3f273 req-93f2f900-4ab7-4df4-90f0-d7d7931a5951 service nova] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:39:31.365266 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.compute.server_external_events [req-a327caab-158c-4d10-9db7-16b682d3f273 req-93f2f900-4ab7-4df4-90f0-d7d7931a5951 service nova] Creating event network-changed:5a965454-938f-4b0b-a81b-3e2875b1b5f6 for instance f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e on hv-cinder-73306 Aug 04 03:39:31.365266 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [req-a327caab-158c-4d10-9db7-16b682d3f273 req-93f2f900-4ab7-4df4-90f0-d7d7931a5951 service nova] Acquired lock "compute-rpcapi-router" {{(pid=130262) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Aug 04 03:39:31.365533 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-5a3f57bd-6d65-4e42-bfbd-07c21ba02765 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:39:31.365980 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-5a3f57bd-6d65-4e42-bfbd-07c21ba02765 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:39:31.366769 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-5a3f57bd-6d65-4e42-bfbd-07c21ba02765 None None] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:39:31.367194 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-5a3f57bd-6d65-4e42-bfbd-07c21ba02765 None None] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:39:31.377080 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.compute.rpcapi [None req-5a3f57bd-6d65-4e42-bfbd-07c21ba02765 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 04 03:39:31.378335 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-5a3f57bd-6d65-4e42-bfbd-07c21ba02765 None None] Releasing lock "compute-rpcapi-router" {{(pid=130262) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Aug 04 03:39:31.405846 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-5a3f57bd-6d65-4e42-bfbd-07c21ba02765 None None] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.763997 Aug 04 03:39:31.411342 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 35/72] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 03:39:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 03:39:31.422635 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-a33fb981-f575-4a24-a30a-cd03e1a33d9a tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:39:31.427922 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-a33fb981-f575-4a24-a30a-cd03e1a33d9a tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] [instance: f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:39:31.438558 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-a33fb981-f575-4a24-a30a-cd03e1a33d9a tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:39:31.441021 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-a33fb981-f575-4a24-a30a-cd03e1a33d9a tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:39:31.442134 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-a33fb981-f575-4a24-a30a-cd03e1a33d9a tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:39:31.445793 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-a33fb981-f575-4a24-a30a-cd03e1a33d9a tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:39:31.537938 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-de0dba39-bfd4-491e-a649-d15e1cdb61e0 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec8d131a9764028a096314a4ecd58f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9ff6952b014d0a9abb28dcf0b818b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:39:31.547494 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-de0dba39-bfd4-491e-a649-d15e1cdb61e0 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] 10.222.0.66 "GET /compute/v2.1/servers/60273216-f2ed-46cf-8836-1d85335d8920" status: 200 len: 1322 microversion: 2.1 time: 0.607302 Aug 04 03:39:31.548822 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 38/73] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:39:30 2022] GET /compute/v2.1/servers/60273216-f2ed-46cf-8836-1d85335d8920 => generated 1322 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 03:39:31.569234 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-fac772a2-2000-474f-8330-a7feab7d79e8 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:39:31.574156 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-fac772a2-2000-474f-8330-a7feab7d79e8 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] [instance: 9307fdad-ca63-449d-bc5c-7e9e167c59f3] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:39:31.589132 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-fac772a2-2000-474f-8330-a7feab7d79e8 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:39:31.599057 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-fac772a2-2000-474f-8330-a7feab7d79e8 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:39:31.599057 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-fac772a2-2000-474f-8330-a7feab7d79e8 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:39:31.599057 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-fac772a2-2000-474f-8330-a7feab7d79e8 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:39:31.987934 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-fac772a2-2000-474f-8330-a7feab7d79e8 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dba436d0a67433f8c8ae7cd40d3f795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46b8dc64007429b805971d4c6f5b471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:39:32.007439 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-fac772a2-2000-474f-8330-a7feab7d79e8 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] 10.222.0.66 "GET /compute/v2.1/servers/9307fdad-ca63-449d-bc5c-7e9e167c59f3" status: 200 len: 1294 microversion: 2.1 time: 0.457301 Aug 04 03:39:32.008375 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 39/74] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:39:31 2022] GET /compute/v2.1/servers/9307fdad-ca63-449d-bc5c-7e9e167c59f3 => generated 1294 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:39:32.312726 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-a33fb981-f575-4a24-a30a-cd03e1a33d9a tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f4252210bd412ba24305b00a6e77b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a97e25e7eae402f8f5c4222019ed87c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:39:32.320270 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-a33fb981-f575-4a24-a30a-cd03e1a33d9a tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] 10.222.0.66 "GET /compute/v2.1/servers/f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e" status: 200 len: 1313 microversion: 2.1 time: 0.907358 Aug 04 03:39:32.343152 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 36/75] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:39:31 2022] GET /compute/v2.1/servers/f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e => generated 1313 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:39:32.574547 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-8c277c1f-cf86-4d4c-8fe8-b77971400e88 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:39:32.577835 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-8c277c1f-cf86-4d4c-8fe8-b77971400e88 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] [instance: 60273216-f2ed-46cf-8836-1d85335d8920] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:39:32.591531 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-8c277c1f-cf86-4d4c-8fe8-b77971400e88 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:39:32.593006 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-8c277c1f-cf86-4d4c-8fe8-b77971400e88 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:39:32.596774 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-8c277c1f-cf86-4d4c-8fe8-b77971400e88 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:39:32.599495 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-8c277c1f-cf86-4d4c-8fe8-b77971400e88 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:39:32.763638 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-8c277c1f-cf86-4d4c-8fe8-b77971400e88 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec8d131a9764028a096314a4ecd58f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9ff6952b014d0a9abb28dcf0b818b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:39:32.773116 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-8c277c1f-cf86-4d4c-8fe8-b77971400e88 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] 10.222.0.66 "GET /compute/v2.1/servers/60273216-f2ed-46cf-8836-1d85335d8920" status: 200 len: 1322 microversion: 2.1 time: 0.206695 Aug 04 03:39:32.774341 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 40/76] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:39:32 2022] GET /compute/v2.1/servers/60273216-f2ed-46cf-8836-1d85335d8920 => generated 1322 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:39:33.033644 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-8d7b3f40-8e17-4c3b-a3dc-47621a4716ae tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:39:33.036914 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-8d7b3f40-8e17-4c3b-a3dc-47621a4716ae tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] [instance: 9307fdad-ca63-449d-bc5c-7e9e167c59f3] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:39:33.050502 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-8d7b3f40-8e17-4c3b-a3dc-47621a4716ae tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:39:33.051378 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-8d7b3f40-8e17-4c3b-a3dc-47621a4716ae tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:39:33.051758 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-8d7b3f40-8e17-4c3b-a3dc-47621a4716ae tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:39:33.052369 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-8d7b3f40-8e17-4c3b-a3dc-47621a4716ae tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:39:33.139913 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-8d7b3f40-8e17-4c3b-a3dc-47621a4716ae tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dba436d0a67433f8c8ae7cd40d3f795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46b8dc64007429b805971d4c6f5b471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:39:33.161380 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-8d7b3f40-8e17-4c3b-a3dc-47621a4716ae tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] 10.222.0.66 "GET /compute/v2.1/servers/9307fdad-ca63-449d-bc5c-7e9e167c59f3" status: 200 len: 1294 microversion: 2.1 time: 0.120668 Aug 04 03:39:33.161380 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 37/77] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:39:33 2022] GET /compute/v2.1/servers/9307fdad-ca63-449d-bc5c-7e9e167c59f3 => generated 1294 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:39:33.350760 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-f3ca80c9-b51e-4e68-9789-918fdd04d785 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:39:33.351372 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-f3ca80c9-b51e-4e68-9789-918fdd04d785 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] [instance: f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:39:33.357800 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-f3ca80c9-b51e-4e68-9789-918fdd04d785 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:39:33.359098 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-f3ca80c9-b51e-4e68-9789-918fdd04d785 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:39:33.359098 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-f3ca80c9-b51e-4e68-9789-918fdd04d785 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:39:33.359435 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-f3ca80c9-b51e-4e68-9789-918fdd04d785 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:39:33.444499 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [req-df2d87e2-e374-4428-a61e-e3ea2d2691d5 req-d46048c6-ddd9-499e-9c5b-849006ba11d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60273216-f2ed-46cf-8836-1d85335d8920", "tag": "6d9d0195-e01f-4042-aa96-3a5af9c8cf55"}]} {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 03:39:33.471986 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [req-df2d87e2-e374-4428-a61e-e3ea2d2691d5 req-d46048c6-ddd9-499e-9c5b-849006ba11d1 service nova] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:39:33.472507 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [req-df2d87e2-e374-4428-a61e-e3ea2d2691d5 req-d46048c6-ddd9-499e-9c5b-849006ba11d1 service nova] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:39:33.494346 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.compute.server_external_events [req-df2d87e2-e374-4428-a61e-e3ea2d2691d5 req-d46048c6-ddd9-499e-9c5b-849006ba11d1 service nova] Creating event network-changed:6d9d0195-e01f-4042-aa96-3a5af9c8cf55 for instance 60273216-f2ed-46cf-8836-1d85335d8920 on hv-cinder-73306 Aug 04 03:39:33.504603 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [req-df2d87e2-e374-4428-a61e-e3ea2d2691d5 req-d46048c6-ddd9-499e-9c5b-849006ba11d1 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063978 Aug 04 03:39:33.507318 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 38/78] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 03:39:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 03:39:33.584755 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-f3ca80c9-b51e-4e68-9789-918fdd04d785 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f4252210bd412ba24305b00a6e77b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a97e25e7eae402f8f5c4222019ed87c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:39:33.598821 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-f3ca80c9-b51e-4e68-9789-918fdd04d785 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] 10.222.0.66 "GET /compute/v2.1/servers/f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e" status: 200 len: 1313 microversion: 2.1 time: 0.249079 Aug 04 03:39:33.599839 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 41/79] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:39:33 2022] GET /compute/v2.1/servers/f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e => generated 1313 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:39:33.794676 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-f45a0080-cb80-4885-863a-0e6653a200c6 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:39:33.795549 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-f45a0080-cb80-4885-863a-0e6653a200c6 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] [instance: 60273216-f2ed-46cf-8836-1d85335d8920] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:39:33.806102 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-f45a0080-cb80-4885-863a-0e6653a200c6 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:39:33.810930 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-f45a0080-cb80-4885-863a-0e6653a200c6 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:39:33.812210 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-f45a0080-cb80-4885-863a-0e6653a200c6 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:39:33.815354 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-f45a0080-cb80-4885-863a-0e6653a200c6 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:39:34.003957 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-f45a0080-cb80-4885-863a-0e6653a200c6 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec8d131a9764028a096314a4ecd58f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9ff6952b014d0a9abb28dcf0b818b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:39:34.014780 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-f45a0080-cb80-4885-863a-0e6653a200c6 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] 10.222.0.66 "GET /compute/v2.1/servers/60273216-f2ed-46cf-8836-1d85335d8920" status: 200 len: 1322 microversion: 2.1 time: 0.224060 Aug 04 03:39:34.017181 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 39/80] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:39:33 2022] GET /compute/v2.1/servers/60273216-f2ed-46cf-8836-1d85335d8920 => generated 1322 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:39:34.181023 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-39c8d6eb-9fe4-4b48-9859-9d842c14e269 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:39:34.181871 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-39c8d6eb-9fe4-4b48-9859-9d842c14e269 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] [instance: 9307fdad-ca63-449d-bc5c-7e9e167c59f3] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:39:34.194279 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-39c8d6eb-9fe4-4b48-9859-9d842c14e269 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:39:34.194956 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-39c8d6eb-9fe4-4b48-9859-9d842c14e269 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:39:34.195875 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-39c8d6eb-9fe4-4b48-9859-9d842c14e269 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:39:34.196460 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-39c8d6eb-9fe4-4b48-9859-9d842c14e269 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:39:34.462075 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-39c8d6eb-9fe4-4b48-9859-9d842c14e269 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dba436d0a67433f8c8ae7cd40d3f795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46b8dc64007429b805971d4c6f5b471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:39:34.473719 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-39c8d6eb-9fe4-4b48-9859-9d842c14e269 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] 10.222.0.66 "GET /compute/v2.1/servers/9307fdad-ca63-449d-bc5c-7e9e167c59f3" status: 200 len: 1361 microversion: 2.1 time: 0.297081 Aug 04 03:39:34.485651 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 42/81] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:39:34 2022] GET /compute/v2.1/servers/9307fdad-ca63-449d-bc5c-7e9e167c59f3 => generated 1361 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:39:34.625061 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-47fd8ce1-32e3-49eb-92a7-cf7f4a433f58 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:39:34.626529 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-47fd8ce1-32e3-49eb-92a7-cf7f4a433f58 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] [instance: f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:39:34.636467 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-47fd8ce1-32e3-49eb-92a7-cf7f4a433f58 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:39:34.636467 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-47fd8ce1-32e3-49eb-92a7-cf7f4a433f58 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:39:34.636467 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-47fd8ce1-32e3-49eb-92a7-cf7f4a433f58 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:39:34.636467 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-47fd8ce1-32e3-49eb-92a7-cf7f4a433f58 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:39:34.827638 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-47fd8ce1-32e3-49eb-92a7-cf7f4a433f58 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f4252210bd412ba24305b00a6e77b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a97e25e7eae402f8f5c4222019ed87c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:39:34.837847 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-47fd8ce1-32e3-49eb-92a7-cf7f4a433f58 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] 10.222.0.66 "GET /compute/v2.1/servers/f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e" status: 200 len: 1313 microversion: 2.1 time: 0.217191 Aug 04 03:39:34.851088 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 40/82] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:39:34 2022] GET /compute/v2.1/servers/f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e => generated 1313 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:39:35.035843 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-0c804c76-1c1f-452c-981b-427a9a81b5f0 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:39:35.036649 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-0c804c76-1c1f-452c-981b-427a9a81b5f0 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] [instance: 60273216-f2ed-46cf-8836-1d85335d8920] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:39:35.048856 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-0c804c76-1c1f-452c-981b-427a9a81b5f0 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:39:35.049343 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-0c804c76-1c1f-452c-981b-427a9a81b5f0 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:39:35.058649 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-0c804c76-1c1f-452c-981b-427a9a81b5f0 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:39:35.059368 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-0c804c76-1c1f-452c-981b-427a9a81b5f0 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:39:35.255369 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-6abb7741-8801-4bf0-9094-98a468eb73d6 tempest-VolumesNegativeTest-899768555 tempest-VolumesNegativeTest-899768555-project] Action: 'create', calling method: .version_select at 0x7f72e8482940>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-418917277", "metadata": {"Type": "work"}}} {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 03:39:35.255369 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-6abb7741-8801-4bf0-9094-98a468eb73d6 tempest-VolumesNegativeTest-899768555 tempest-VolumesNegativeTest-899768555-project] Request method failure captured: Aug 04 03:39:35.255369 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 04 03:39:35.255369 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Accept: application/json Aug 04 03:39:35.255369 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Accept-Encoding: identity Aug 04 03:39:35.255369 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Connection: close Aug 04 03:39:35.255369 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Content-Length: 121 Aug 04 03:39:35.255369 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Content-Type: application/json Aug 04 03:39:35.255369 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Host: 10.222.0.66 Aug 04 03:39:35.255369 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Openstack-System-Scope: None Aug 04 03:39:35.255369 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: User-Agent: python-urllib3/1.26.11 Aug 04 03:39:35.255369 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Auth-Token: gAAAAABi6z92M9OfysLj5Ax997meT2TMITfsea5U7oyREF77Ikeslqy3-OmVR3pnDEawHkcBsvMY8-LZvG7pwinIFhfSPy2vgbB27sVph78JWTdkhF-Cg6PUb3JXpMAemuMuPUKjcGaUzYES_waBkvbVuLl9Ls0H6tDFNTHkpvoLSnv1gmr8nz0 Aug 04 03:39:35.255369 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Domain-Id: None Aug 04 03:39:35.255369 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Domain-Name: None Aug 04 03:39:35.255369 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Identity-Status: Confirmed Aug 04 03:39:35.255369 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Is-Admin-Project: True Aug 04 03:39:35.255369 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Project-Domain-Id: default Aug 04 03:39:35.255369 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Project-Domain-Name: Default Aug 04 03:39:35.255369 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Project-Id: b9514d1fd0134e6587239c332adb4742 Aug 04 03:39:35.255369 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Project-Name: tempest-VolumesNegativeTest-899768555 Aug 04 03:39:35.255369 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Role: member,reader Aug 04 03:39:35.255369 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Roles: member,reader Aug 04 03:39:35.256643 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/b9514d1fd0134e6587239c332adb4742"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/b9514d1fd0134e6587239c332adb4742"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/b9514d1fd0134e6587239c332adb4742"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_b9514d1fd0134e6587239c332adb4742"}]}] Aug 04 03:39:35.256643 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Tenant: tempest-VolumesNegativeTest-899768555 Aug 04 03:39:35.256643 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Tenant-Id: b9514d1fd0134e6587239c332adb4742 Aug 04 03:39:35.256643 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Tenant-Name: tempest-VolumesNegativeTest-899768555 Aug 04 03:39:35.256643 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-User: tempest-VolumesNegativeTest-899768555-project Aug 04 03:39:35.256643 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-User-Domain-Id: default Aug 04 03:39:35.256643 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-User-Domain-Name: Default Aug 04 03:39:35.256643 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-User-Id: 6bda96e73578467dab4985c7ec8d6cbf Aug 04 03:39:35.256643 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-User-Name: tempest-VolumesNegativeTest-899768555-project Aug 04 03:39:35.256643 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Aug 04 03:39:35.256643 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-418917277", "metadata": {"Type": "work"}}} Aug 04 03:39:35.256643 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: method: Aug 04 03:39:35.256643 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 04 03:39:35.257457 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-418917277', 'metadata': {'Type': 'work'}}}} Aug 04 03:39:35.257457 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 03:39:35.257457 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 03:39:35.257457 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 04 03:39:35.257457 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 04 03:39:35.257457 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 04 03:39:35.257457 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi raise error Aug 04 03:39:35.257457 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 04 03:39:35.257457 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Aug 04 03:39:35.257457 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 04 03:39:35.257457 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 04 03:39:35.257457 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Aug 04 03:39:35.257457 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 04 03:39:35.257457 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi '#$%' Aug 04 03:39:35.257457 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Aug 04 03:39:35.257457 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 03:39:35.257457 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Aug 04 03:39:35.257457 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 03:39:35.257457 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 03:39:35.257457 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 03:39:35.257457 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 03:39:35.257457 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 03:39:35.258865 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 03:39:35.258865 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 03:39:35.258865 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 03:39:35.258865 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 03:39:35.258865 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 04 03:39:35.258865 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 04 03:39:35.258865 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 04 03:39:35.258865 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 04 03:39:35.258865 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 04 03:39:35.258865 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 04 03:39:35.258865 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 04 03:39:35.258865 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Aug 04 03:39:35.258865 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 03:39:35.258865 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Aug 04 03:39:35.258865 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 03:39:35.258865 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 03:39:35.258865 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 03:39:35.258865 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 04 03:39:35.258865 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 04 03:39:35.259900 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 04 03:39:35.259900 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Aug 04 03:39:35.259900 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-6abb7741-8801-4bf0-9094-98a468eb73d6 tempest-VolumesNegativeTest-899768555 tempest-VolumesNegativeTest-899768555-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=130263) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 03:39:35.259900 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-6abb7741-8801-4bf0-9094-98a468eb73d6 tempest-VolumesNegativeTest-899768555 tempest-VolumesNegativeTest-899768555-project] 10.222.0.66 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.326779 Aug 04 03:39:35.264381 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 43/83] 10.222.0.66 () {60 vars in 1156 bytes} [Thu Aug 4 03:39:34 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 344 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 03:39:35.271146 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-e7f99ef8-85de-448f-abda-6195d79cff22 tempest-VolumesNegativeTest-899768555 tempest-VolumesNegativeTest-899768555-project] Action: 'create', calling method: .version_select at 0x7f72e844d280>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-7760545", "metadata": {"Type": "work"}}} {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 03:39:35.276487 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-e7f99ef8-85de-448f-abda-6195d79cff22 tempest-VolumesNegativeTest-899768555 tempest-VolumesNegativeTest-899768555-project] Request method failure captured: Aug 04 03:39:35.276487 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 04 03:39:35.276487 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Accept: application/json Aug 04 03:39:35.276487 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Accept-Encoding: identity Aug 04 03:39:35.276487 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Connection: close Aug 04 03:39:35.276487 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Content-Length: 117 Aug 04 03:39:35.276487 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Content-Type: application/json Aug 04 03:39:35.276487 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Host: 10.222.0.66 Aug 04 03:39:35.276487 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Openstack-System-Scope: None Aug 04 03:39:35.276487 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: User-Agent: python-urllib3/1.26.11 Aug 04 03:39:35.276487 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Auth-Token: gAAAAABi6z92M9OfysLj5Ax997meT2TMITfsea5U7oyREF77Ikeslqy3-OmVR3pnDEawHkcBsvMY8-LZvG7pwinIFhfSPy2vgbB27sVph78JWTdkhF-Cg6PUb3JXpMAemuMuPUKjcGaUzYES_waBkvbVuLl9Ls0H6tDFNTHkpvoLSnv1gmr8nz0 Aug 04 03:39:35.276487 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Domain-Id: None Aug 04 03:39:35.276487 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Domain-Name: None Aug 04 03:39:35.276487 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Identity-Status: Confirmed Aug 04 03:39:35.276487 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Is-Admin-Project: True Aug 04 03:39:35.276487 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Project-Domain-Id: default Aug 04 03:39:35.276487 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Project-Domain-Name: Default Aug 04 03:39:35.276487 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Project-Id: b9514d1fd0134e6587239c332adb4742 Aug 04 03:39:35.276487 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Project-Name: tempest-VolumesNegativeTest-899768555 Aug 04 03:39:35.276487 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Role: member,reader Aug 04 03:39:35.276487 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Roles: member,reader Aug 04 03:39:35.277911 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/b9514d1fd0134e6587239c332adb4742"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/b9514d1fd0134e6587239c332adb4742"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/b9514d1fd0134e6587239c332adb4742"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_b9514d1fd0134e6587239c332adb4742"}]}] Aug 04 03:39:35.277911 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Tenant: tempest-VolumesNegativeTest-899768555 Aug 04 03:39:35.277911 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Tenant-Id: b9514d1fd0134e6587239c332adb4742 Aug 04 03:39:35.277911 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Tenant-Name: tempest-VolumesNegativeTest-899768555 Aug 04 03:39:35.277911 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-User: tempest-VolumesNegativeTest-899768555-project Aug 04 03:39:35.277911 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-User-Domain-Id: default Aug 04 03:39:35.277911 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-User-Domain-Name: Default Aug 04 03:39:35.277911 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-User-Id: 6bda96e73578467dab4985c7ec8d6cbf Aug 04 03:39:35.277911 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-User-Name: tempest-VolumesNegativeTest-899768555-project Aug 04 03:39:35.277911 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Aug 04 03:39:35.277911 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-7760545", "metadata": {"Type": "work"}}} Aug 04 03:39:35.277911 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: method: Aug 04 03:39:35.277911 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 04 03:39:35.278562 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-7760545', 'metadata': {'Type': 'work'}}}} Aug 04 03:39:35.278562 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 03:39:35.278562 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 03:39:35.278562 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 04 03:39:35.278562 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 04 03:39:35.278562 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 04 03:39:35.278562 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi raise error Aug 04 03:39:35.278562 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 04 03:39:35.278562 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Aug 04 03:39:35.278562 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 04 03:39:35.278562 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 04 03:39:35.278562 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Aug 04 03:39:35.278562 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 04 03:39:35.278562 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi '0' Aug 04 03:39:35.278562 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Aug 04 03:39:35.278562 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 03:39:35.278562 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Aug 04 03:39:35.278562 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 03:39:35.278562 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 03:39:35.278562 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 03:39:35.278562 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 03:39:35.278562 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 03:39:35.279631 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 03:39:35.279631 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 03:39:35.279631 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 03:39:35.279631 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 03:39:35.279631 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 04 03:39:35.279631 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 04 03:39:35.279631 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 04 03:39:35.279631 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 04 03:39:35.279631 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 04 03:39:35.279631 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 04 03:39:35.279631 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 04 03:39:35.279631 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Aug 04 03:39:35.279631 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 03:39:35.279631 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Aug 04 03:39:35.279631 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 03:39:35.279631 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 03:39:35.279631 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 03:39:35.279631 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 04 03:39:35.279631 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 04 03:39:35.280596 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 04 03:39:35.280596 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Aug 04 03:39:35.282142 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-e7f99ef8-85de-448f-abda-6195d79cff22 tempest-VolumesNegativeTest-899768555 tempest-VolumesNegativeTest-899768555-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=130263) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 03:39:35.283413 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-e7f99ef8-85de-448f-abda-6195d79cff22 tempest-VolumesNegativeTest-899768555 tempest-VolumesNegativeTest-899768555-project] 10.222.0.66 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.017521 Aug 04 03:39:35.290947 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 44/84] 10.222.0.66 () {60 vars in 1156 bytes} [Thu Aug 4 03:39:35 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 03:39:35.297822 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-d9de6df5-0c97-47e1-9b9f-061ab2b77eb8 tempest-VolumesNegativeTest-899768555 tempest-VolumesNegativeTest-899768555-project] Action: 'create', calling method: .version_select at 0x7f72e840a790>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1120111020", "metadata": {"Type": "work"}}} {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 03:39:35.303128 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-d9de6df5-0c97-47e1-9b9f-061ab2b77eb8 tempest-VolumesNegativeTest-899768555 tempest-VolumesNegativeTest-899768555-project] Request method failure captured: Aug 04 03:39:35.303128 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 04 03:39:35.303128 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Accept: application/json Aug 04 03:39:35.303128 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Accept-Encoding: identity Aug 04 03:39:35.303128 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Connection: close Aug 04 03:39:35.303128 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Content-Length: 119 Aug 04 03:39:35.303128 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Content-Type: application/json Aug 04 03:39:35.303128 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Host: 10.222.0.66 Aug 04 03:39:35.303128 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Openstack-System-Scope: None Aug 04 03:39:35.303128 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: User-Agent: python-urllib3/1.26.11 Aug 04 03:39:35.303128 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Auth-Token: gAAAAABi6z92M9OfysLj5Ax997meT2TMITfsea5U7oyREF77Ikeslqy3-OmVR3pnDEawHkcBsvMY8-LZvG7pwinIFhfSPy2vgbB27sVph78JWTdkhF-Cg6PUb3JXpMAemuMuPUKjcGaUzYES_waBkvbVuLl9Ls0H6tDFNTHkpvoLSnv1gmr8nz0 Aug 04 03:39:35.303128 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Domain-Id: None Aug 04 03:39:35.303128 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Domain-Name: None Aug 04 03:39:35.303128 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Identity-Status: Confirmed Aug 04 03:39:35.303128 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Is-Admin-Project: True Aug 04 03:39:35.303128 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Project-Domain-Id: default Aug 04 03:39:35.303128 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Project-Domain-Name: Default Aug 04 03:39:35.303128 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Project-Id: b9514d1fd0134e6587239c332adb4742 Aug 04 03:39:35.303128 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Project-Name: tempest-VolumesNegativeTest-899768555 Aug 04 03:39:35.303128 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Role: member,reader Aug 04 03:39:35.303128 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Roles: member,reader Aug 04 03:39:35.304285 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/b9514d1fd0134e6587239c332adb4742"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/b9514d1fd0134e6587239c332adb4742"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/b9514d1fd0134e6587239c332adb4742"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_b9514d1fd0134e6587239c332adb4742"}]}] Aug 04 03:39:35.304285 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Tenant: tempest-VolumesNegativeTest-899768555 Aug 04 03:39:35.304285 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Tenant-Id: b9514d1fd0134e6587239c332adb4742 Aug 04 03:39:35.304285 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Tenant-Name: tempest-VolumesNegativeTest-899768555 Aug 04 03:39:35.304285 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-User: tempest-VolumesNegativeTest-899768555-project Aug 04 03:39:35.304285 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-User-Domain-Id: default Aug 04 03:39:35.304285 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-User-Domain-Name: Default Aug 04 03:39:35.304285 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-User-Id: 6bda96e73578467dab4985c7ec8d6cbf Aug 04 03:39:35.304285 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-User-Name: tempest-VolumesNegativeTest-899768555-project Aug 04 03:39:35.304285 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Aug 04 03:39:35.304285 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1120111020", "metadata": {"Type": "work"}}} Aug 04 03:39:35.304285 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: method: Aug 04 03:39:35.304285 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 04 03:39:35.304974 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1120111020', 'metadata': {'Type': 'work'}}}} Aug 04 03:39:35.304974 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 03:39:35.304974 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 03:39:35.304974 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 04 03:39:35.304974 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 04 03:39:35.304974 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 04 03:39:35.304974 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi raise error Aug 04 03:39:35.304974 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 04 03:39:35.304974 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Aug 04 03:39:35.304974 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 04 03:39:35.304974 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 04 03:39:35.304974 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Aug 04 03:39:35.304974 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 04 03:39:35.304974 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi '' Aug 04 03:39:35.304974 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Aug 04 03:39:35.304974 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 03:39:35.304974 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Aug 04 03:39:35.304974 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 03:39:35.304974 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 03:39:35.304974 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 03:39:35.304974 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 03:39:35.304974 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 03:39:35.306116 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 03:39:35.306116 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 03:39:35.306116 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 03:39:35.306116 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 03:39:35.306116 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 04 03:39:35.306116 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 04 03:39:35.306116 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 04 03:39:35.306116 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 04 03:39:35.306116 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 04 03:39:35.306116 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 04 03:39:35.306116 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 04 03:39:35.306116 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Aug 04 03:39:35.306116 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 03:39:35.306116 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Aug 04 03:39:35.306116 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 03:39:35.306116 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 03:39:35.306116 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 03:39:35.306116 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 04 03:39:35.306116 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 04 03:39:35.307033 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 04 03:39:35.307033 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Aug 04 03:39:35.307033 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-d9de6df5-0c97-47e1-9b9f-061ab2b77eb8 tempest-VolumesNegativeTest-899768555 tempest-VolumesNegativeTest-899768555-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=130263) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 03:39:35.314048 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-d9de6df5-0c97-47e1-9b9f-061ab2b77eb8 tempest-VolumesNegativeTest-899768555 tempest-VolumesNegativeTest-899768555-project] 10.222.0.66 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.013647 Aug 04 03:39:35.314048 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 45/85] 10.222.0.66 () {60 vars in 1156 bytes} [Thu Aug 4 03:39:35 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 03:39:35.321806 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-b442f0df-23a3-43d0-8d18-1b104a10d53e tempest-VolumesNegativeTest-899768555 tempest-VolumesNegativeTest-899768555-project] Calling method '.version_select at 0x7f72e8436e50>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:39:35.323033 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-0c804c76-1c1f-452c-981b-427a9a81b5f0 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec8d131a9764028a096314a4ecd58f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9ff6952b014d0a9abb28dcf0b818b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:39:35.335943 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-0c804c76-1c1f-452c-981b-427a9a81b5f0 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] 10.222.0.66 "GET /compute/v2.1/servers/60273216-f2ed-46cf-8836-1d85335d8920" status: 200 len: 1322 microversion: 2.1 time: 0.303832 Aug 04 03:39:35.337998 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 41/86] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:39:35 2022] GET /compute/v2.1/servers/60273216-f2ed-46cf-8836-1d85335d8920 => generated 1322 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 03:39:35.354843 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.wsgi [None req-b442f0df-23a3-43d0-8d18-1b104a10d53e tempest-VolumesNegativeTest-899768555 tempest-VolumesNegativeTest-899768555-project] HTTP exception thrown: Volume tempest-invalid-336352536 could not be found. Aug 04 03:39:35.356962 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-b442f0df-23a3-43d0-8d18-1b104a10d53e tempest-VolumesNegativeTest-899768555 tempest-VolumesNegativeTest-899768555-project] Request method failure captured: Aug 04 03:39:35.356962 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-336352536 HTTP/1.1 Aug 04 03:39:35.356962 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Accept: application/json Aug 04 03:39:35.356962 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Accept-Encoding: identity Aug 04 03:39:35.356962 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Connection: close Aug 04 03:39:35.356962 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Content-Length: 0 Aug 04 03:39:35.356962 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Content-Type: application/json Aug 04 03:39:35.356962 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Host: 10.222.0.66 Aug 04 03:39:35.356962 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Openstack-System-Scope: None Aug 04 03:39:35.356962 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: User-Agent: python-urllib3/1.26.11 Aug 04 03:39:35.356962 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Auth-Token: gAAAAABi6z92M9OfysLj5Ax997meT2TMITfsea5U7oyREF77Ikeslqy3-OmVR3pnDEawHkcBsvMY8-LZvG7pwinIFhfSPy2vgbB27sVph78JWTdkhF-Cg6PUb3JXpMAemuMuPUKjcGaUzYES_waBkvbVuLl9Ls0H6tDFNTHkpvoLSnv1gmr8nz0 Aug 04 03:39:35.356962 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Domain-Id: None Aug 04 03:39:35.356962 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Domain-Name: None Aug 04 03:39:35.356962 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Identity-Status: Confirmed Aug 04 03:39:35.356962 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Is-Admin-Project: True Aug 04 03:39:35.356962 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Project-Domain-Id: default Aug 04 03:39:35.356962 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Project-Domain-Name: Default Aug 04 03:39:35.356962 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Project-Id: b9514d1fd0134e6587239c332adb4742 Aug 04 03:39:35.356962 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Project-Name: tempest-VolumesNegativeTest-899768555 Aug 04 03:39:35.356962 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Role: member,reader Aug 04 03:39:35.356962 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Roles: member,reader Aug 04 03:39:35.358154 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/b9514d1fd0134e6587239c332adb4742"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/b9514d1fd0134e6587239c332adb4742"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/b9514d1fd0134e6587239c332adb4742"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_b9514d1fd0134e6587239c332adb4742"}]}] Aug 04 03:39:35.358154 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Tenant: tempest-VolumesNegativeTest-899768555 Aug 04 03:39:35.358154 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Tenant-Id: b9514d1fd0134e6587239c332adb4742 Aug 04 03:39:35.358154 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Tenant-Name: tempest-VolumesNegativeTest-899768555 Aug 04 03:39:35.358154 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-User: tempest-VolumesNegativeTest-899768555-project Aug 04 03:39:35.358154 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-User-Domain-Id: default Aug 04 03:39:35.358154 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-User-Domain-Name: Default Aug 04 03:39:35.358154 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-User-Id: 6bda96e73578467dab4985c7ec8d6cbf Aug 04 03:39:35.358154 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-User-Name: tempest-VolumesNegativeTest-899768555-project Aug 04 03:39:35.358154 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: method: Aug 04 03:39:35.358154 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: exception: Volume tempest-invalid-336352536 could not be found. Aug 04 03:39:35.358154 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: action_args: {'id': 'tempest-invalid-336352536'} Aug 04 03:39:35.358154 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 03:39:35.359638 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 03:39:35.359638 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 03:39:35.359638 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 03:39:35.359638 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 04 03:39:35.359638 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 04 03:39:35.359638 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 04 03:39:35.359638 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 04 03:39:35.359638 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 04 03:39:35.359638 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 04 03:39:35.359638 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 04 03:39:35.359638 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 04 03:39:35.359638 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 03:39:35.359638 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 03:39:35.359638 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 03:39:35.359638 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 03:39:35.359638 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-336352536 could not be found. (HTTP 404) (Request-ID: req-b69bf82f-53d7-4e75-a26d-ecb0d64ecec5) Aug 04 03:39:35.359638 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Aug 04 03:39:35.359638 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 03:39:35.359638 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Aug 04 03:39:35.361387 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 03:39:35.361387 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 04 03:39:35.361387 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 04 03:39:35.361387 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 04 03:39:35.361387 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 04 03:39:35.361387 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 04 03:39:35.361387 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 04 03:39:35.361387 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 04 03:39:35.361387 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 04 03:39:35.361387 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 03:39:35.361387 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 03:39:35.361387 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 04 03:39:35.361387 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 04 03:39:35.361387 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 04 03:39:35.361387 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 04 03:39:35.361387 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 04 03:39:35.361387 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 04 03:39:35.361387 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 04 03:39:35.361387 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 04 03:39:35.362834 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 03:39:35.362834 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 03:39:35.362834 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 03:39:35.362834 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 03:39:35.362834 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-336352536 could not be found. Aug 04 03:39:35.362834 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Aug 04 03:39:35.362834 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 03:39:35.362834 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Aug 04 03:39:35.362834 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 03:39:35.362834 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 03:39:35.362834 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 03:39:35.362834 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 03:39:35.362834 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 03:39:35.362834 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 03:39:35.362834 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 03:39:35.362834 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 03:39:35.362834 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 03:39:35.362834 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 04 03:39:35.362834 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 03:39:35.362834 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-336352536 could not be found. Aug 04 03:39:35.364513 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Aug 04 03:39:35.364513 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 03:39:35.364513 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Aug 04 03:39:35.364513 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 03:39:35.364513 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 03:39:35.364513 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 03:39:35.364513 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 03:39:35.364513 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 03:39:35.364513 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-336352536 could not be found. Aug 04 03:39:35.364513 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Aug 04 03:39:35.366339 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-b442f0df-23a3-43d0-8d18-1b104a10d53e tempest-VolumesNegativeTest-899768555 tempest-VolumesNegativeTest-899768555-project] Returning 404 to user: Volume tempest-invalid-336352536 could not be found. {{(pid=130263) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 03:39:35.367397 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-b442f0df-23a3-43d0-8d18-1b104a10d53e tempest-VolumesNegativeTest-899768555 tempest-VolumesNegativeTest-899768555-project] 10.222.0.66 "DELETE /compute/v2.1/os-volumes/tempest-invalid-336352536" status: 404 len: 98 microversion: 2.1 time: 0.050441 Aug 04 03:39:35.368651 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 46/87] 10.222.0.66 () {58 vars in 1215 bytes} [Thu Aug 4 03:39:35 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-336352536 => generated 98 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 04 03:39:35.378267 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-4b9a3ebe-6705-4db0-84c7-7e7018c83ebd tempest-VolumesNegativeTest-899768555 tempest-VolumesNegativeTest-899768555-project] 10.222.0.66 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003921 Aug 04 03:39:35.385805 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 42/88] 10.222.0.66 () {58 vars in 1140 bytes} [Thu Aug 4 03:39:35 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Aug 04 03:39:35.394823 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-3ba43126-b492-41dd-8298-84ade19b677f tempest-VolumesNegativeTest-899768555 tempest-VolumesNegativeTest-899768555-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004943 Aug 04 03:39:35.395889 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 47/89] 10.222.0.66 () {58 vars in 1137 bytes} [Thu Aug 4 03:39:35 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 9 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 04 03:39:35.407170 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-22cb8945-6829-4ed8-9e1f-9f7e03057652 tempest-VolumesNegativeTest-899768555 tempest-VolumesNegativeTest-899768555-project] Calling method '.version_select at 0x7f72e8402160>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:39:35.453668 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.wsgi [None req-22cb8945-6829-4ed8-9e1f-9f7e03057652 tempest-VolumesNegativeTest-899768555 tempest-VolumesNegativeTest-899768555-project] HTTP exception thrown: Volume f87a9c79-6d50-427f-b141-d9a55ef18be3 could not be found. Aug 04 03:39:35.455820 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-22cb8945-6829-4ed8-9e1f-9f7e03057652 tempest-VolumesNegativeTest-899768555 tempest-VolumesNegativeTest-899768555-project] Request method failure captured: Aug 04 03:39:35.455820 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: request: DELETE /compute/v2.1/os-volumes/f87a9c79-6d50-427f-b141-d9a55ef18be3 HTTP/1.1 Aug 04 03:39:35.455820 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: Accept: application/json Aug 04 03:39:35.455820 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: Accept-Encoding: identity Aug 04 03:39:35.455820 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: Connection: close Aug 04 03:39:35.455820 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: Content-Length: 0 Aug 04 03:39:35.455820 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: Content-Type: application/json Aug 04 03:39:35.455820 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: Host: 10.222.0.66 Aug 04 03:39:35.455820 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: Openstack-System-Scope: None Aug 04 03:39:35.455820 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: User-Agent: python-urllib3/1.26.11 Aug 04 03:39:35.455820 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Auth-Token: gAAAAABi6z92M9OfysLj5Ax997meT2TMITfsea5U7oyREF77Ikeslqy3-OmVR3pnDEawHkcBsvMY8-LZvG7pwinIFhfSPy2vgbB27sVph78JWTdkhF-Cg6PUb3JXpMAemuMuPUKjcGaUzYES_waBkvbVuLl9Ls0H6tDFNTHkpvoLSnv1gmr8nz0 Aug 04 03:39:35.455820 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Domain-Id: None Aug 04 03:39:35.455820 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Domain-Name: None Aug 04 03:39:35.455820 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Identity-Status: Confirmed Aug 04 03:39:35.455820 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Is-Admin-Project: True Aug 04 03:39:35.455820 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Project-Domain-Id: default Aug 04 03:39:35.455820 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Project-Domain-Name: Default Aug 04 03:39:35.455820 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Project-Id: b9514d1fd0134e6587239c332adb4742 Aug 04 03:39:35.455820 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Project-Name: tempest-VolumesNegativeTest-899768555 Aug 04 03:39:35.455820 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Role: member,reader Aug 04 03:39:35.455820 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Roles: member,reader Aug 04 03:39:35.457310 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/b9514d1fd0134e6587239c332adb4742"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/b9514d1fd0134e6587239c332adb4742"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/b9514d1fd0134e6587239c332adb4742"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_b9514d1fd0134e6587239c332adb4742"}]}] Aug 04 03:39:35.457310 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Tenant: tempest-VolumesNegativeTest-899768555 Aug 04 03:39:35.457310 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Tenant-Id: b9514d1fd0134e6587239c332adb4742 Aug 04 03:39:35.457310 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Tenant-Name: tempest-VolumesNegativeTest-899768555 Aug 04 03:39:35.457310 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-User: tempest-VolumesNegativeTest-899768555-project Aug 04 03:39:35.457310 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-User-Domain-Id: default Aug 04 03:39:35.457310 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-User-Domain-Name: Default Aug 04 03:39:35.457310 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-User-Id: 6bda96e73578467dab4985c7ec8d6cbf Aug 04 03:39:35.457310 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-User-Name: tempest-VolumesNegativeTest-899768555-project Aug 04 03:39:35.457310 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: method: Aug 04 03:39:35.457310 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: exception: Volume f87a9c79-6d50-427f-b141-d9a55ef18be3 could not be found. Aug 04 03:39:35.457310 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: action_args: {'id': 'f87a9c79-6d50-427f-b141-d9a55ef18be3'} Aug 04 03:39:35.457310 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 03:39:35.458156 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 03:39:35.458156 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 03:39:35.458156 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 03:39:35.458156 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 04 03:39:35.458156 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 04 03:39:35.458156 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 04 03:39:35.458156 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 04 03:39:35.458156 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 04 03:39:35.458156 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 04 03:39:35.458156 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 04 03:39:35.458156 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 04 03:39:35.458156 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 03:39:35.458156 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 03:39:35.458156 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 03:39:35.458156 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 03:39:35.458156 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f87a9c79-6d50-427f-b141-d9a55ef18be3 could not be found. (HTTP 404) (Request-ID: req-644c454c-1253-4972-b8bb-aa551421ac84) Aug 04 03:39:35.458156 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi Aug 04 03:39:35.458156 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 03:39:35.458156 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi Aug 04 03:39:35.459339 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 03:39:35.459339 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 04 03:39:35.459339 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 04 03:39:35.459339 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 04 03:39:35.459339 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 04 03:39:35.459339 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 04 03:39:35.459339 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 04 03:39:35.459339 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 04 03:39:35.459339 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 04 03:39:35.459339 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 03:39:35.459339 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 03:39:35.459339 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 04 03:39:35.459339 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 04 03:39:35.459339 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 04 03:39:35.459339 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 04 03:39:35.459339 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 04 03:39:35.459339 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 04 03:39:35.459339 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 04 03:39:35.459339 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 04 03:39:35.460754 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 03:39:35.460754 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 03:39:35.460754 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 03:39:35.460754 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 03:39:35.460754 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f87a9c79-6d50-427f-b141-d9a55ef18be3 could not be found. Aug 04 03:39:35.460754 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi Aug 04 03:39:35.460754 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 03:39:35.460754 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi Aug 04 03:39:35.460754 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 03:39:35.460754 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 03:39:35.460754 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 03:39:35.460754 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 03:39:35.460754 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 03:39:35.460754 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 03:39:35.460754 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 03:39:35.460754 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 03:39:35.460754 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 03:39:35.460754 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 04 03:39:35.460754 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 03:39:35.463081 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f87a9c79-6d50-427f-b141-d9a55ef18be3 could not be found. Aug 04 03:39:35.463081 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi Aug 04 03:39:35.463081 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 03:39:35.463081 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi Aug 04 03:39:35.463081 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 03:39:35.463081 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 03:39:35.463081 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 03:39:35.463081 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 03:39:35.463081 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 03:39:35.463081 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f87a9c79-6d50-427f-b141-d9a55ef18be3 could not be found. Aug 04 03:39:35.463081 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi Aug 04 03:39:35.463081 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-22cb8945-6829-4ed8-9e1f-9f7e03057652 tempest-VolumesNegativeTest-899768555 tempest-VolumesNegativeTest-899768555-project] Returning 404 to user: Volume f87a9c79-6d50-427f-b141-d9a55ef18be3 could not be found. {{(pid=130262) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 03:39:35.463081 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-22cb8945-6829-4ed8-9e1f-9f7e03057652 tempest-VolumesNegativeTest-899768555 tempest-VolumesNegativeTest-899768555-project] 10.222.0.66 "DELETE /compute/v2.1/os-volumes/f87a9c79-6d50-427f-b141-d9a55ef18be3" status: 404 len: 109 microversion: 2.1 time: 0.056992 Aug 04 03:39:35.463081 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 43/90] 10.222.0.66 () {58 vars in 1248 bytes} [Thu Aug 4 03:39:35 2022] DELETE /compute/v2.1/os-volumes/f87a9c79-6d50-427f-b141-d9a55ef18be3 => generated 109 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 03:39:35.471483 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-fc695849-e6b4-4c0d-a7a1-eeb77b33e3a3 tempest-VolumesNegativeTest-899768555 tempest-VolumesNegativeTest-899768555-project] Calling method '.version_select at 0x7f72e8505670>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:39:35.497635 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-2f2ea16d-eb5d-4e8b-bd39-cba25dbc6ffe tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:39:35.498244 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-2f2ea16d-eb5d-4e8b-bd39-cba25dbc6ffe tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] [instance: 9307fdad-ca63-449d-bc5c-7e9e167c59f3] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:39:35.511851 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-2f2ea16d-eb5d-4e8b-bd39-cba25dbc6ffe tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:39:35.512824 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-2f2ea16d-eb5d-4e8b-bd39-cba25dbc6ffe tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:39:35.514265 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-2f2ea16d-eb5d-4e8b-bd39-cba25dbc6ffe tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:39:35.515014 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-2f2ea16d-eb5d-4e8b-bd39-cba25dbc6ffe tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:39:35.515374 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.wsgi [None req-fc695849-e6b4-4c0d-a7a1-eeb77b33e3a3 tempest-VolumesNegativeTest-899768555 tempest-VolumesNegativeTest-899768555-project] HTTP exception thrown: Volume 6fade4a5-03a4-4762-a021-dd257e91a3c2 could not be found. Aug 04 03:39:35.517321 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-fc695849-e6b4-4c0d-a7a1-eeb77b33e3a3 tempest-VolumesNegativeTest-899768555 tempest-VolumesNegativeTest-899768555-project] Request method failure captured: Aug 04 03:39:35.517321 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: request: GET /compute/v2.1/os-volumes/6fade4a5-03a4-4762-a021-dd257e91a3c2 HTTP/1.1 Aug 04 03:39:35.517321 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Accept: application/json Aug 04 03:39:35.517321 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Accept-Encoding: identity Aug 04 03:39:35.517321 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Connection: close Aug 04 03:39:35.517321 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Content-Length: 0 Aug 04 03:39:35.517321 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Content-Type: application/json Aug 04 03:39:35.517321 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Host: 10.222.0.66 Aug 04 03:39:35.517321 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Openstack-System-Scope: None Aug 04 03:39:35.517321 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: User-Agent: python-urllib3/1.26.11 Aug 04 03:39:35.517321 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Auth-Token: gAAAAABi6z92M9OfysLj5Ax997meT2TMITfsea5U7oyREF77Ikeslqy3-OmVR3pnDEawHkcBsvMY8-LZvG7pwinIFhfSPy2vgbB27sVph78JWTdkhF-Cg6PUb3JXpMAemuMuPUKjcGaUzYES_waBkvbVuLl9Ls0H6tDFNTHkpvoLSnv1gmr8nz0 Aug 04 03:39:35.517321 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Domain-Id: None Aug 04 03:39:35.517321 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Domain-Name: None Aug 04 03:39:35.517321 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Identity-Status: Confirmed Aug 04 03:39:35.517321 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Is-Admin-Project: True Aug 04 03:39:35.517321 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Project-Domain-Id: default Aug 04 03:39:35.517321 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Project-Domain-Name: Default Aug 04 03:39:35.517321 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Project-Id: b9514d1fd0134e6587239c332adb4742 Aug 04 03:39:35.517321 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Project-Name: tempest-VolumesNegativeTest-899768555 Aug 04 03:39:35.517321 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Role: member,reader Aug 04 03:39:35.517321 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Roles: member,reader Aug 04 03:39:35.518354 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/b9514d1fd0134e6587239c332adb4742"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/b9514d1fd0134e6587239c332adb4742"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/b9514d1fd0134e6587239c332adb4742"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_b9514d1fd0134e6587239c332adb4742"}]}] Aug 04 03:39:35.518354 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Tenant: tempest-VolumesNegativeTest-899768555 Aug 04 03:39:35.518354 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Tenant-Id: b9514d1fd0134e6587239c332adb4742 Aug 04 03:39:35.518354 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Tenant-Name: tempest-VolumesNegativeTest-899768555 Aug 04 03:39:35.518354 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-User: tempest-VolumesNegativeTest-899768555-project Aug 04 03:39:35.518354 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-User-Domain-Id: default Aug 04 03:39:35.518354 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-User-Domain-Name: Default Aug 04 03:39:35.518354 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-User-Id: 6bda96e73578467dab4985c7ec8d6cbf Aug 04 03:39:35.518354 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-User-Name: tempest-VolumesNegativeTest-899768555-project Aug 04 03:39:35.518354 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: method: Aug 04 03:39:35.518354 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: exception: Volume 6fade4a5-03a4-4762-a021-dd257e91a3c2 could not be found. Aug 04 03:39:35.518354 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: action_args: {'id': '6fade4a5-03a4-4762-a021-dd257e91a3c2'} Aug 04 03:39:35.518354 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 03:39:35.519046 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 03:39:35.519046 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 03:39:35.519046 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 03:39:35.519046 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 04 03:39:35.519046 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 04 03:39:35.519046 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 04 03:39:35.519046 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 04 03:39:35.519046 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 04 03:39:35.519046 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 04 03:39:35.519046 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 04 03:39:35.519046 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 04 03:39:35.519046 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 03:39:35.519046 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 03:39:35.519046 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 03:39:35.519046 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 03:39:35.519046 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6fade4a5-03a4-4762-a021-dd257e91a3c2 could not be found. (HTTP 404) (Request-ID: req-7d508b50-26d2-4471-99d2-6c7a336da2f3) Aug 04 03:39:35.519046 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Aug 04 03:39:35.519046 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 03:39:35.519046 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Aug 04 03:39:35.520864 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 03:39:35.520864 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 04 03:39:35.520864 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 04 03:39:35.520864 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 04 03:39:35.520864 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 04 03:39:35.520864 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 04 03:39:35.520864 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 04 03:39:35.520864 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 04 03:39:35.520864 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 04 03:39:35.520864 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 04 03:39:35.520864 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 04 03:39:35.520864 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 04 03:39:35.520864 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 04 03:39:35.520864 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 04 03:39:35.520864 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 04 03:39:35.520864 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 04 03:39:35.520864 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 04 03:39:35.520864 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 04 03:39:35.520864 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 04 03:39:35.522095 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 04 03:39:35.522095 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 04 03:39:35.522095 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 04 03:39:35.522095 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 04 03:39:35.522095 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6fade4a5-03a4-4762-a021-dd257e91a3c2 could not be found. Aug 04 03:39:35.522095 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Aug 04 03:39:35.522095 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 03:39:35.522095 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Aug 04 03:39:35.522095 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 03:39:35.522095 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 03:39:35.522095 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 03:39:35.522095 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 03:39:35.522095 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 03:39:35.522095 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 04 03:39:35.522095 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 04 03:39:35.522095 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 03:39:35.522095 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 03:39:35.522095 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 04 03:39:35.522095 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 03:39:35.523036 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 6fade4a5-03a4-4762-a021-dd257e91a3c2 could not be found. Aug 04 03:39:35.523036 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Aug 04 03:39:35.523036 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 03:39:35.523036 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Aug 04 03:39:35.523036 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 03:39:35.523036 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 03:39:35.523036 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 03:39:35.523036 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 03:39:35.523036 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 03:39:35.523036 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6fade4a5-03a4-4762-a021-dd257e91a3c2 could not be found. Aug 04 03:39:35.523036 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Aug 04 03:39:35.523036 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-fc695849-e6b4-4c0d-a7a1-eeb77b33e3a3 tempest-VolumesNegativeTest-899768555 tempest-VolumesNegativeTest-899768555-project] Returning 404 to user: Volume 6fade4a5-03a4-4762-a021-dd257e91a3c2 could not be found. {{(pid=130263) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 03:39:35.523036 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-fc695849-e6b4-4c0d-a7a1-eeb77b33e3a3 tempest-VolumesNegativeTest-899768555 tempest-VolumesNegativeTest-899768555-project] 10.222.0.66 "GET /compute/v2.1/os-volumes/6fade4a5-03a4-4762-a021-dd257e91a3c2" status: 404 len: 109 microversion: 2.1 time: 0.051440 Aug 04 03:39:35.523036 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 48/91] 10.222.0.66 () {58 vars in 1245 bytes} [Thu Aug 4 03:39:35 2022] GET /compute/v2.1/os-volumes/6fade4a5-03a4-4762-a021-dd257e91a3c2 => generated 109 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 03:39:35.776275 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-2f2ea16d-eb5d-4e8b-bd39-cba25dbc6ffe tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dba436d0a67433f8c8ae7cd40d3f795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46b8dc64007429b805971d4c6f5b471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:39:35.785002 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-2f2ea16d-eb5d-4e8b-bd39-cba25dbc6ffe tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] 10.222.0.66 "GET /compute/v2.1/servers/9307fdad-ca63-449d-bc5c-7e9e167c59f3" status: 200 len: 1361 microversion: 2.1 time: 0.291158 Aug 04 03:39:35.786995 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 44/92] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:39:35 2022] GET /compute/v2.1/servers/9307fdad-ca63-449d-bc5c-7e9e167c59f3 => generated 1361 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:39:35.861340 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-340ecebc-5b83-4e4c-940d-81a0cf83fb15 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:39:35.862005 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-340ecebc-5b83-4e4c-940d-81a0cf83fb15 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] [instance: f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:39:35.870237 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-340ecebc-5b83-4e4c-940d-81a0cf83fb15 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:39:35.870586 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-340ecebc-5b83-4e4c-940d-81a0cf83fb15 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:39:35.871355 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-340ecebc-5b83-4e4c-940d-81a0cf83fb15 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:39:35.871861 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-340ecebc-5b83-4e4c-940d-81a0cf83fb15 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:39:35.876048 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG dbcounter [-] [130263] Writing DB stats nova_cell0:SELECT=24 {{(pid=130263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:39:36.067663 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-340ecebc-5b83-4e4c-940d-81a0cf83fb15 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f4252210bd412ba24305b00a6e77b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a97e25e7eae402f8f5c4222019ed87c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:39:36.076171 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-340ecebc-5b83-4e4c-940d-81a0cf83fb15 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] 10.222.0.66 "GET /compute/v2.1/servers/f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e" status: 200 len: 1313 microversion: 2.1 time: 0.218604 Aug 04 03:39:36.076743 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 49/93] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:39:35 2022] GET /compute/v2.1/servers/f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e => generated 1313 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:39:36.357551 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-15d68e79-c222-4a93-991c-c85fbb2499c5 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:39:36.358271 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-15d68e79-c222-4a93-991c-c85fbb2499c5 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] [instance: 60273216-f2ed-46cf-8836-1d85335d8920] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:39:36.368521 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-15d68e79-c222-4a93-991c-c85fbb2499c5 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:39:36.369074 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-15d68e79-c222-4a93-991c-c85fbb2499c5 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:39:36.369952 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-15d68e79-c222-4a93-991c-c85fbb2499c5 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:39:36.372934 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-15d68e79-c222-4a93-991c-c85fbb2499c5 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:39:36.548214 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-15d68e79-c222-4a93-991c-c85fbb2499c5 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec8d131a9764028a096314a4ecd58f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9ff6952b014d0a9abb28dcf0b818b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:39:36.558428 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-15d68e79-c222-4a93-991c-c85fbb2499c5 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] 10.222.0.66 "GET /compute/v2.1/servers/60273216-f2ed-46cf-8836-1d85335d8920" status: 200 len: 1322 microversion: 2.1 time: 0.205518 Aug 04 03:39:36.559402 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 45/94] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:39:36 2022] GET /compute/v2.1/servers/60273216-f2ed-46cf-8836-1d85335d8920 => generated 1322 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 03:39:36.814597 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-dcaa36a9-4278-432c-8c4a-7ade55564f57 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:39:36.818407 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-dcaa36a9-4278-432c-8c4a-7ade55564f57 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] [instance: 9307fdad-ca63-449d-bc5c-7e9e167c59f3] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:39:36.829264 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-dcaa36a9-4278-432c-8c4a-7ade55564f57 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:39:36.829921 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-dcaa36a9-4278-432c-8c4a-7ade55564f57 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:39:36.830695 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-dcaa36a9-4278-432c-8c4a-7ade55564f57 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:39:36.831132 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-dcaa36a9-4278-432c-8c4a-7ade55564f57 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:39:36.998086 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-dcaa36a9-4278-432c-8c4a-7ade55564f57 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dba436d0a67433f8c8ae7cd40d3f795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46b8dc64007429b805971d4c6f5b471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:39:37.007509 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-dcaa36a9-4278-432c-8c4a-7ade55564f57 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] 10.222.0.66 "GET /compute/v2.1/servers/9307fdad-ca63-449d-bc5c-7e9e167c59f3" status: 200 len: 1361 microversion: 2.1 time: 0.200476 Aug 04 03:39:37.009437 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 50/95] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:39:36 2022] GET /compute/v2.1/servers/9307fdad-ca63-449d-bc5c-7e9e167c59f3 => generated 1361 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:39:37.098761 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-d071d36b-6cbe-4d1c-ae98-3364c08e18d3 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:39:37.101115 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-d071d36b-6cbe-4d1c-ae98-3364c08e18d3 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] [instance: f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:39:37.102636 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG dbcounter [-] [130262] Writing DB stats nova_cell0:SELECT=18 {{(pid=130262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:39:37.106269 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-d071d36b-6cbe-4d1c-ae98-3364c08e18d3 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:39:37.106785 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-d071d36b-6cbe-4d1c-ae98-3364c08e18d3 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:39:37.107522 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-d071d36b-6cbe-4d1c-ae98-3364c08e18d3 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:39:37.107953 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-d071d36b-6cbe-4d1c-ae98-3364c08e18d3 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:39:37.283583 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-d071d36b-6cbe-4d1c-ae98-3364c08e18d3 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f4252210bd412ba24305b00a6e77b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a97e25e7eae402f8f5c4222019ed87c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:39:37.290916 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-d071d36b-6cbe-4d1c-ae98-3364c08e18d3 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] 10.222.0.66 "GET /compute/v2.1/servers/f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e" status: 200 len: 1313 microversion: 2.1 time: 0.196529 Aug 04 03:39:37.291485 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 46/96] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:39:37 2022] GET /compute/v2.1/servers/f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e => generated 1313 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:39:37.581414 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-9a813046-347d-4e0c-a9fe-9595b75b0239 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:39:37.582030 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-9a813046-347d-4e0c-a9fe-9595b75b0239 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] [instance: 60273216-f2ed-46cf-8836-1d85335d8920] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:39:37.588313 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-9a813046-347d-4e0c-a9fe-9595b75b0239 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:39:37.588960 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-9a813046-347d-4e0c-a9fe-9595b75b0239 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:39:37.589900 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-9a813046-347d-4e0c-a9fe-9595b75b0239 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:39:37.590346 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-9a813046-347d-4e0c-a9fe-9595b75b0239 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:39:37.594382 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG dbcounter [-] [130263] Writing DB stats nova_cell1:SELECT=100 {{(pid=130263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:39:37.804801 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-9a813046-347d-4e0c-a9fe-9595b75b0239 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec8d131a9764028a096314a4ecd58f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9ff6952b014d0a9abb28dcf0b818b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:39:37.807412 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-9a813046-347d-4e0c-a9fe-9595b75b0239 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] 10.222.0.66 "GET /compute/v2.1/servers/60273216-f2ed-46cf-8836-1d85335d8920" status: 200 len: 1322 microversion: 2.1 time: 0.230067 Aug 04 03:39:37.808169 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 51/97] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:39:37 2022] GET /compute/v2.1/servers/60273216-f2ed-46cf-8836-1d85335d8920 => generated 1322 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:39:38.033329 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-a7b8f95a-d91c-491e-8fe5-631d4030d077 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:39:38.033952 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-a7b8f95a-d91c-491e-8fe5-631d4030d077 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] [instance: 9307fdad-ca63-449d-bc5c-7e9e167c59f3] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:39:38.041804 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-a7b8f95a-d91c-491e-8fe5-631d4030d077 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:39:38.042255 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-a7b8f95a-d91c-491e-8fe5-631d4030d077 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:39:38.043017 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-a7b8f95a-d91c-491e-8fe5-631d4030d077 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:39:38.043478 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-a7b8f95a-d91c-491e-8fe5-631d4030d077 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:39:38.197954 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-a7b8f95a-d91c-491e-8fe5-631d4030d077 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dba436d0a67433f8c8ae7cd40d3f795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46b8dc64007429b805971d4c6f5b471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:39:38.201569 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG dbcounter [-] [130262] Writing DB stats nova_cell1:SELECT=100 {{(pid=130262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:39:38.207251 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-a7b8f95a-d91c-491e-8fe5-631d4030d077 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] 10.222.0.66 "GET /compute/v2.1/servers/9307fdad-ca63-449d-bc5c-7e9e167c59f3" status: 200 len: 1361 microversion: 2.1 time: 0.178875 Aug 04 03:39:38.208842 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 47/98] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:39:38 2022] GET /compute/v2.1/servers/9307fdad-ca63-449d-bc5c-7e9e167c59f3 => generated 1361 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:39:38.312183 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-75560ca3-de98-421e-a71b-c97648274506 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:39:38.312791 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-75560ca3-de98-421e-a71b-c97648274506 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] [instance: f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:39:38.319526 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-75560ca3-de98-421e-a71b-c97648274506 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:39:38.321184 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-75560ca3-de98-421e-a71b-c97648274506 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:39:38.321184 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-75560ca3-de98-421e-a71b-c97648274506 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:39:38.321378 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-75560ca3-de98-421e-a71b-c97648274506 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:39:38.471411 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-75560ca3-de98-421e-a71b-c97648274506 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f4252210bd412ba24305b00a6e77b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a97e25e7eae402f8f5c4222019ed87c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:39:38.482748 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-75560ca3-de98-421e-a71b-c97648274506 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] 10.222.0.66 "GET /compute/v2.1/servers/f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e" status: 200 len: 1313 microversion: 2.1 time: 0.174356 Aug 04 03:39:38.483495 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 52/99] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:39:38 2022] GET /compute/v2.1/servers/f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e => generated 1313 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 03:39:38.828224 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-eae9331b-d546-4de9-a641-1d1122a3cdcf tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:39:38.829449 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-eae9331b-d546-4de9-a641-1d1122a3cdcf tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] [instance: 60273216-f2ed-46cf-8836-1d85335d8920] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:39:38.844202 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-eae9331b-d546-4de9-a641-1d1122a3cdcf tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:39:38.844746 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-eae9331b-d546-4de9-a641-1d1122a3cdcf tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:39:38.845881 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-eae9331b-d546-4de9-a641-1d1122a3cdcf tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:39:38.846507 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-eae9331b-d546-4de9-a641-1d1122a3cdcf tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:39:39.029535 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-eae9331b-d546-4de9-a641-1d1122a3cdcf tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec8d131a9764028a096314a4ecd58f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9ff6952b014d0a9abb28dcf0b818b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:39:39.044183 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-eae9331b-d546-4de9-a641-1d1122a3cdcf tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] 10.222.0.66 "GET /compute/v2.1/servers/60273216-f2ed-46cf-8836-1d85335d8920" status: 200 len: 1322 microversion: 2.1 time: 0.217081 Aug 04 03:39:39.046865 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 48/100] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:39:38 2022] GET /compute/v2.1/servers/60273216-f2ed-46cf-8836-1d85335d8920 => generated 1322 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:39:39.228185 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-379f35f4-c7cb-49b3-8b58-d729d27b7dd4 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:39:39.230125 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-379f35f4-c7cb-49b3-8b58-d729d27b7dd4 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] [instance: 9307fdad-ca63-449d-bc5c-7e9e167c59f3] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:39:39.236664 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-379f35f4-c7cb-49b3-8b58-d729d27b7dd4 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:39:39.237645 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-379f35f4-c7cb-49b3-8b58-d729d27b7dd4 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:39:39.239380 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-379f35f4-c7cb-49b3-8b58-d729d27b7dd4 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:39:39.240436 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-379f35f4-c7cb-49b3-8b58-d729d27b7dd4 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:39:39.418612 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-379f35f4-c7cb-49b3-8b58-d729d27b7dd4 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dba436d0a67433f8c8ae7cd40d3f795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46b8dc64007429b805971d4c6f5b471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:39:39.428122 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-379f35f4-c7cb-49b3-8b58-d729d27b7dd4 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] 10.222.0.66 "GET /compute/v2.1/servers/9307fdad-ca63-449d-bc5c-7e9e167c59f3" status: 200 len: 1361 microversion: 2.1 time: 0.204001 Aug 04 03:39:39.428714 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 53/101] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:39:39 2022] GET /compute/v2.1/servers/9307fdad-ca63-449d-bc5c-7e9e167c59f3 => generated 1361 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:39:39.504772 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-592b1522-bd31-4a35-b546-f7e3b873a809 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:39:39.505984 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-592b1522-bd31-4a35-b546-f7e3b873a809 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] [instance: f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:39:39.512799 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-592b1522-bd31-4a35-b546-f7e3b873a809 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:39:39.513532 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-592b1522-bd31-4a35-b546-f7e3b873a809 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:39:39.514341 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-592b1522-bd31-4a35-b546-f7e3b873a809 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:39:39.514954 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-592b1522-bd31-4a35-b546-f7e3b873a809 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:39:39.679536 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-592b1522-bd31-4a35-b546-f7e3b873a809 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f4252210bd412ba24305b00a6e77b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a97e25e7eae402f8f5c4222019ed87c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:39:39.688044 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-592b1522-bd31-4a35-b546-f7e3b873a809 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] 10.222.0.66 "GET /compute/v2.1/servers/f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e" status: 200 len: 1313 microversion: 2.1 time: 0.187671 Aug 04 03:39:39.688630 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 49/102] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:39:39 2022] GET /compute/v2.1/servers/f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e => generated 1313 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:39:40.065058 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-996eed07-6d14-4eb4-b40f-d577b004c8b2 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:39:40.065915 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-996eed07-6d14-4eb4-b40f-d577b004c8b2 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] [instance: 60273216-f2ed-46cf-8836-1d85335d8920] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:39:40.069692 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG dbcounter [-] [130263] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=130263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:39:40.072994 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-996eed07-6d14-4eb4-b40f-d577b004c8b2 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:39:40.073464 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-996eed07-6d14-4eb4-b40f-d577b004c8b2 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:39:40.074218 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-996eed07-6d14-4eb4-b40f-d577b004c8b2 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:39:40.074924 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-996eed07-6d14-4eb4-b40f-d577b004c8b2 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:39:40.460736 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-0a9cab78-1f1c-4336-9523-b8746b4861ba tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:39:40.462168 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-0a9cab78-1f1c-4336-9523-b8746b4861ba tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] [instance: 9307fdad-ca63-449d-bc5c-7e9e167c59f3] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:39:40.496411 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-0a9cab78-1f1c-4336-9523-b8746b4861ba tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:39:40.499883 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-0a9cab78-1f1c-4336-9523-b8746b4861ba tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:39:40.504462 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-0a9cab78-1f1c-4336-9523-b8746b4861ba tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:39:40.509944 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-0a9cab78-1f1c-4336-9523-b8746b4861ba tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:39:40.519450 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-996eed07-6d14-4eb4-b40f-d577b004c8b2 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec8d131a9764028a096314a4ecd58f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9ff6952b014d0a9abb28dcf0b818b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:39:40.534906 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-996eed07-6d14-4eb4-b40f-d577b004c8b2 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] 10.222.0.66 "GET /compute/v2.1/servers/60273216-f2ed-46cf-8836-1d85335d8920" status: 200 len: 1322 microversion: 2.1 time: 0.472899 Aug 04 03:39:40.536637 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 54/103] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:39:40 2022] GET /compute/v2.1/servers/60273216-f2ed-46cf-8836-1d85335d8920 => generated 1322 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:39:40.709880 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-49a91bc3-b63a-41ce-92e7-07f77298b901 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:39:40.710897 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-49a91bc3-b63a-41ce-92e7-07f77298b901 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] [instance: f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:39:40.717239 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-49a91bc3-b63a-41ce-92e7-07f77298b901 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:39:40.723485 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-49a91bc3-b63a-41ce-92e7-07f77298b901 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:39:40.723485 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-49a91bc3-b63a-41ce-92e7-07f77298b901 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:39:40.723485 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-49a91bc3-b63a-41ce-92e7-07f77298b901 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:39:40.851101 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-0a9cab78-1f1c-4336-9523-b8746b4861ba tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dba436d0a67433f8c8ae7cd40d3f795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46b8dc64007429b805971d4c6f5b471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:39:40.867140 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-0a9cab78-1f1c-4336-9523-b8746b4861ba tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] 10.222.0.66 "GET /compute/v2.1/servers/9307fdad-ca63-449d-bc5c-7e9e167c59f3" status: 200 len: 1361 microversion: 2.1 time: 0.416156 Aug 04 03:39:40.868199 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 50/104] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:39:40 2022] GET /compute/v2.1/servers/9307fdad-ca63-449d-bc5c-7e9e167c59f3 => generated 1361 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:39:41.005185 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-49a91bc3-b63a-41ce-92e7-07f77298b901 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f4252210bd412ba24305b00a6e77b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a97e25e7eae402f8f5c4222019ed87c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:39:41.022477 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-49a91bc3-b63a-41ce-92e7-07f77298b901 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] 10.222.0.66 "GET /compute/v2.1/servers/f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e" status: 200 len: 1313 microversion: 2.1 time: 0.316771 Aug 04 03:39:41.023965 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 55/105] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:39:40 2022] GET /compute/v2.1/servers/f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e => generated 1313 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 03:39:41.106355 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [req-9b21f7bc-bdda-47d3-b555-7c02c2672143 req-3ffaf4cb-4699-4a18-971e-b7f0f887bf76 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9307fdad-ca63-449d-bc5c-7e9e167c59f3", "tag": "6a5932d2-1cb7-42bc-974f-e0c47bff324c"}]} {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 03:39:41.124456 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [req-9b21f7bc-bdda-47d3-b555-7c02c2672143 req-3ffaf4cb-4699-4a18-971e-b7f0f887bf76 service nova] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:39:41.125679 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [req-9b21f7bc-bdda-47d3-b555-7c02c2672143 req-3ffaf4cb-4699-4a18-971e-b7f0f887bf76 service nova] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:39:41.155537 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.compute.server_external_events [req-9b21f7bc-bdda-47d3-b555-7c02c2672143 req-3ffaf4cb-4699-4a18-971e-b7f0f887bf76 service nova] Creating event network-changed:6a5932d2-1cb7-42bc-974f-e0c47bff324c for instance 9307fdad-ca63-449d-bc5c-7e9e167c59f3 on hv-cinder-73306 Aug 04 03:39:41.180357 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [req-9b21f7bc-bdda-47d3-b555-7c02c2672143 req-3ffaf4cb-4699-4a18-971e-b7f0f887bf76 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080218 Aug 04 03:39:41.181901 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 51/106] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 03:39:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 03:39:41.560123 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-49800efa-d361-4a1a-94f6-d34186ccf456 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:39:41.560806 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-49800efa-d361-4a1a-94f6-d34186ccf456 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] [instance: 60273216-f2ed-46cf-8836-1d85335d8920] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:39:41.564001 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG dbcounter [-] [130263] Writing DB stats nova_cell0:SELECT=2 {{(pid=130263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:39:41.568108 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-49800efa-d361-4a1a-94f6-d34186ccf456 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:39:41.568723 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-49800efa-d361-4a1a-94f6-d34186ccf456 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:39:41.569685 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-49800efa-d361-4a1a-94f6-d34186ccf456 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:39:41.570319 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-49800efa-d361-4a1a-94f6-d34186ccf456 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:39:41.704070 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-49800efa-d361-4a1a-94f6-d34186ccf456 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec8d131a9764028a096314a4ecd58f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9ff6952b014d0a9abb28dcf0b818b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:39:41.712672 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-49800efa-d361-4a1a-94f6-d34186ccf456 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] 10.222.0.66 "GET /compute/v2.1/servers/60273216-f2ed-46cf-8836-1d85335d8920" status: 200 len: 1322 microversion: 2.1 time: 0.156525 Aug 04 03:39:41.713257 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 56/107] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:39:41 2022] GET /compute/v2.1/servers/60273216-f2ed-46cf-8836-1d85335d8920 => generated 1322 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:39:41.888223 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-49ea7ff1-a4ac-4359-adc5-06add794a9f0 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:39:41.888946 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-49ea7ff1-a4ac-4359-adc5-06add794a9f0 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] [instance: 9307fdad-ca63-449d-bc5c-7e9e167c59f3] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:39:41.891097 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG dbcounter [-] [130262] Writing DB stats nova_cell0:SELECT=6 {{(pid=130262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:39:41.907985 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-49ea7ff1-a4ac-4359-adc5-06add794a9f0 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:39:41.908572 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-49ea7ff1-a4ac-4359-adc5-06add794a9f0 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:39:41.920079 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-49ea7ff1-a4ac-4359-adc5-06add794a9f0 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:39:41.921678 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-49ea7ff1-a4ac-4359-adc5-06add794a9f0 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:39:42.043953 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-429cc1d2-5c8d-479a-8ab7-b305b6f9e691 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:39:42.044577 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-429cc1d2-5c8d-479a-8ab7-b305b6f9e691 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] [instance: f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:39:42.051055 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-429cc1d2-5c8d-479a-8ab7-b305b6f9e691 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:39:42.052715 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-429cc1d2-5c8d-479a-8ab7-b305b6f9e691 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:39:42.052715 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-429cc1d2-5c8d-479a-8ab7-b305b6f9e691 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:39:42.052715 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-429cc1d2-5c8d-479a-8ab7-b305b6f9e691 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:39:42.073212 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-49ea7ff1-a4ac-4359-adc5-06add794a9f0 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dba436d0a67433f8c8ae7cd40d3f795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46b8dc64007429b805971d4c6f5b471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:39:42.080583 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-49ea7ff1-a4ac-4359-adc5-06add794a9f0 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] 10.222.0.66 "GET /compute/v2.1/servers/9307fdad-ca63-449d-bc5c-7e9e167c59f3" status: 200 len: 1361 microversion: 2.1 time: 0.196437 Aug 04 03:39:42.081142 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 52/108] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:39:41 2022] GET /compute/v2.1/servers/9307fdad-ca63-449d-bc5c-7e9e167c59f3 => generated 1361 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:39:42.199088 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-429cc1d2-5c8d-479a-8ab7-b305b6f9e691 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f4252210bd412ba24305b00a6e77b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a97e25e7eae402f8f5c4222019ed87c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:39:42.207865 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-429cc1d2-5c8d-479a-8ab7-b305b6f9e691 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] 10.222.0.66 "GET /compute/v2.1/servers/f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e" status: 200 len: 1313 microversion: 2.1 time: 0.167037 Aug 04 03:39:42.208345 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 57/109] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:39:42 2022] GET /compute/v2.1/servers/f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e => generated 1313 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 03:39:42.733275 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-084f7c15-4373-4c38-bd74-a8249b9dec8b tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:39:42.733887 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-084f7c15-4373-4c38-bd74-a8249b9dec8b tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] [instance: 60273216-f2ed-46cf-8836-1d85335d8920] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:39:42.741108 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-084f7c15-4373-4c38-bd74-a8249b9dec8b tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:39:42.741603 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-084f7c15-4373-4c38-bd74-a8249b9dec8b tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:39:42.742367 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-084f7c15-4373-4c38-bd74-a8249b9dec8b tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:39:42.742910 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-084f7c15-4373-4c38-bd74-a8249b9dec8b tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:39:42.876457 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-084f7c15-4373-4c38-bd74-a8249b9dec8b tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec8d131a9764028a096314a4ecd58f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9ff6952b014d0a9abb28dcf0b818b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:39:42.884651 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-084f7c15-4373-4c38-bd74-a8249b9dec8b tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] 10.222.0.66 "GET /compute/v2.1/servers/60273216-f2ed-46cf-8836-1d85335d8920" status: 200 len: 1322 microversion: 2.1 time: 0.155706 Aug 04 03:39:42.885247 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 53/110] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:39:42 2022] GET /compute/v2.1/servers/60273216-f2ed-46cf-8836-1d85335d8920 => generated 1322 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:39:43.102452 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-2aa3820d-134f-4bd4-a011-db7bd8a41176 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:39:43.103210 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-2aa3820d-134f-4bd4-a011-db7bd8a41176 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] [instance: 9307fdad-ca63-449d-bc5c-7e9e167c59f3] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:39:43.109789 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-2aa3820d-134f-4bd4-a011-db7bd8a41176 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:39:43.110247 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-2aa3820d-134f-4bd4-a011-db7bd8a41176 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:39:43.111071 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-2aa3820d-134f-4bd4-a011-db7bd8a41176 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:39:43.111508 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-2aa3820d-134f-4bd4-a011-db7bd8a41176 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:39:43.239666 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-973ae362-9c0f-4a09-888d-d74d324dfd8f tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:39:43.240277 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-973ae362-9c0f-4a09-888d-d74d324dfd8f tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] [instance: f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:39:43.242659 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG dbcounter [-] [130262] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=6 {{(pid=130262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:39:43.247094 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-973ae362-9c0f-4a09-888d-d74d324dfd8f tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:39:43.247715 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-973ae362-9c0f-4a09-888d-d74d324dfd8f tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:39:43.248693 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-973ae362-9c0f-4a09-888d-d74d324dfd8f tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:39:43.249313 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-973ae362-9c0f-4a09-888d-d74d324dfd8f tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:39:43.271030 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-2aa3820d-134f-4bd4-a011-db7bd8a41176 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dba436d0a67433f8c8ae7cd40d3f795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46b8dc64007429b805971d4c6f5b471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:39:43.278941 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-2aa3820d-134f-4bd4-a011-db7bd8a41176 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] 10.222.0.66 "GET /compute/v2.1/servers/9307fdad-ca63-449d-bc5c-7e9e167c59f3" status: 200 len: 1361 microversion: 2.1 time: 0.180984 Aug 04 03:39:43.279578 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 58/111] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:39:43 2022] GET /compute/v2.1/servers/9307fdad-ca63-449d-bc5c-7e9e167c59f3 => generated 1361 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:39:43.421144 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-973ae362-9c0f-4a09-888d-d74d324dfd8f tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f4252210bd412ba24305b00a6e77b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a97e25e7eae402f8f5c4222019ed87c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:39:43.429777 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-973ae362-9c0f-4a09-888d-d74d324dfd8f tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] 10.222.0.66 "GET /compute/v2.1/servers/f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e" status: 200 len: 1313 microversion: 2.1 time: 0.194241 Aug 04 03:39:43.430530 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 54/112] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:39:43 2022] GET /compute/v2.1/servers/f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e => generated 1313 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:39:43.906540 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-1ebcdafa-8f51-4b46-a8e0-bad65650a9e3 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:39:43.907644 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-1ebcdafa-8f51-4b46-a8e0-bad65650a9e3 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] [instance: 60273216-f2ed-46cf-8836-1d85335d8920] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:39:43.917320 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-1ebcdafa-8f51-4b46-a8e0-bad65650a9e3 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:39:43.917868 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-1ebcdafa-8f51-4b46-a8e0-bad65650a9e3 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:39:43.918544 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-1ebcdafa-8f51-4b46-a8e0-bad65650a9e3 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:39:43.918968 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-1ebcdafa-8f51-4b46-a8e0-bad65650a9e3 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:39:44.301583 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-69b4b40a-2f03-4a7d-8403-7e5dfab82292 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:39:44.303002 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-69b4b40a-2f03-4a7d-8403-7e5dfab82292 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] [instance: 9307fdad-ca63-449d-bc5c-7e9e167c59f3] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:39:44.314194 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-69b4b40a-2f03-4a7d-8403-7e5dfab82292 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:39:44.315934 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-69b4b40a-2f03-4a7d-8403-7e5dfab82292 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:39:44.315934 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-69b4b40a-2f03-4a7d-8403-7e5dfab82292 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:39:44.315934 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-69b4b40a-2f03-4a7d-8403-7e5dfab82292 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:39:44.521219 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-1ebcdafa-8f51-4b46-a8e0-bad65650a9e3 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec8d131a9764028a096314a4ecd58f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9ff6952b014d0a9abb28dcf0b818b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:39:44.532988 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-1ebcdafa-8f51-4b46-a8e0-bad65650a9e3 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] 10.222.0.66 "GET /compute/v2.1/servers/60273216-f2ed-46cf-8836-1d85335d8920" status: 200 len: 1322 microversion: 2.1 time: 0.632385 Aug 04 03:39:44.533966 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 59/113] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:39:43 2022] GET /compute/v2.1/servers/60273216-f2ed-46cf-8836-1d85335d8920 => generated 1322 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:39:44.539256 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-8a1499b5-d4eb-41c6-a753-52ed448b0779 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:39:44.539858 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-8a1499b5-d4eb-41c6-a753-52ed448b0779 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] [instance: f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:39:44.546268 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-8a1499b5-d4eb-41c6-a753-52ed448b0779 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:39:44.546887 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-8a1499b5-d4eb-41c6-a753-52ed448b0779 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:39:44.547655 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-8a1499b5-d4eb-41c6-a753-52ed448b0779 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:39:44.548321 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-8a1499b5-d4eb-41c6-a753-52ed448b0779 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:39:44.698354 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-69b4b40a-2f03-4a7d-8403-7e5dfab82292 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dba436d0a67433f8c8ae7cd40d3f795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46b8dc64007429b805971d4c6f5b471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:39:44.706072 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-69b4b40a-2f03-4a7d-8403-7e5dfab82292 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] 10.222.0.66 "GET /compute/v2.1/servers/9307fdad-ca63-449d-bc5c-7e9e167c59f3" status: 200 len: 1361 microversion: 2.1 time: 0.409876 Aug 04 03:39:44.706667 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 55/114] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:39:44 2022] GET /compute/v2.1/servers/9307fdad-ca63-449d-bc5c-7e9e167c59f3 => generated 1361 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 03:39:44.729614 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-8a1499b5-d4eb-41c6-a753-52ed448b0779 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f4252210bd412ba24305b00a6e77b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a97e25e7eae402f8f5c4222019ed87c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:39:44.737620 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-8a1499b5-d4eb-41c6-a753-52ed448b0779 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] 10.222.0.66 "GET /compute/v2.1/servers/f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e" status: 200 len: 1313 microversion: 2.1 time: 0.202225 Aug 04 03:39:44.738185 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 60/115] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:39:44 2022] GET /compute/v2.1/servers/f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e => generated 1313 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:39:45.553999 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-94013391-fceb-4796-8dfb-6369d788c6e4 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:39:45.554621 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-94013391-fceb-4796-8dfb-6369d788c6e4 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] [instance: 60273216-f2ed-46cf-8836-1d85335d8920] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:39:45.560525 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-94013391-fceb-4796-8dfb-6369d788c6e4 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:39:45.560977 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-94013391-fceb-4796-8dfb-6369d788c6e4 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:39:45.561780 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-94013391-fceb-4796-8dfb-6369d788c6e4 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:39:45.562296 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-94013391-fceb-4796-8dfb-6369d788c6e4 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:39:45.693608 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-94013391-fceb-4796-8dfb-6369d788c6e4 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec8d131a9764028a096314a4ecd58f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9ff6952b014d0a9abb28dcf0b818b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:39:45.701803 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-94013391-fceb-4796-8dfb-6369d788c6e4 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] 10.222.0.66 "GET /compute/v2.1/servers/60273216-f2ed-46cf-8836-1d85335d8920" status: 200 len: 1322 microversion: 2.1 time: 0.151785 Aug 04 03:39:45.702373 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 56/116] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:39:45 2022] GET /compute/v2.1/servers/60273216-f2ed-46cf-8836-1d85335d8920 => generated 1322 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:39:45.727471 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-a4af495d-0f3f-403b-9609-fcf8522b7b79 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:39:45.728058 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-a4af495d-0f3f-403b-9609-fcf8522b7b79 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] [instance: 9307fdad-ca63-449d-bc5c-7e9e167c59f3] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:39:45.734045 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-a4af495d-0f3f-403b-9609-fcf8522b7b79 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:39:45.734484 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-a4af495d-0f3f-403b-9609-fcf8522b7b79 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:39:45.735236 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-a4af495d-0f3f-403b-9609-fcf8522b7b79 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:39:45.735663 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-a4af495d-0f3f-403b-9609-fcf8522b7b79 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:39:45.759093 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-f9451502-2d94-4b51-be32-af7fd96f1397 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:39:45.759703 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-f9451502-2d94-4b51-be32-af7fd96f1397 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] [instance: f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:39:45.765882 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-f9451502-2d94-4b51-be32-af7fd96f1397 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:39:45.766330 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-f9451502-2d94-4b51-be32-af7fd96f1397 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:39:45.767373 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-f9451502-2d94-4b51-be32-af7fd96f1397 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:39:45.767810 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-f9451502-2d94-4b51-be32-af7fd96f1397 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:39:45.955402 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-a4af495d-0f3f-403b-9609-fcf8522b7b79 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dba436d0a67433f8c8ae7cd40d3f795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46b8dc64007429b805971d4c6f5b471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:39:45.963657 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-a4af495d-0f3f-403b-9609-fcf8522b7b79 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] 10.222.0.66 "GET /compute/v2.1/servers/9307fdad-ca63-449d-bc5c-7e9e167c59f3" status: 200 len: 1361 microversion: 2.1 time: 0.240145 Aug 04 03:39:45.973503 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-f9451502-2d94-4b51-be32-af7fd96f1397 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f4252210bd412ba24305b00a6e77b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a97e25e7eae402f8f5c4222019ed87c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:39:45.973624 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 61/117] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:39:45 2022] GET /compute/v2.1/servers/9307fdad-ca63-449d-bc5c-7e9e167c59f3 => generated 1361 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:39:45.975852 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-f9451502-2d94-4b51-be32-af7fd96f1397 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] 10.222.0.66 "GET /compute/v2.1/servers/f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e" status: 200 len: 1313 microversion: 2.1 time: 0.221425 Aug 04 03:39:45.976403 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 57/118] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:39:45 2022] GET /compute/v2.1/servers/f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e => generated 1313 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 03:39:46.724095 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-262d6281-ef97-46c0-aa2c-32ddbefa349e tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:39:46.724716 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-262d6281-ef97-46c0-aa2c-32ddbefa349e tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] [instance: 60273216-f2ed-46cf-8836-1d85335d8920] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:39:46.739353 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-262d6281-ef97-46c0-aa2c-32ddbefa349e tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:39:46.741048 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-262d6281-ef97-46c0-aa2c-32ddbefa349e tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:39:46.742173 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-262d6281-ef97-46c0-aa2c-32ddbefa349e tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:39:46.743058 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-262d6281-ef97-46c0-aa2c-32ddbefa349e tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:39:46.891645 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-262d6281-ef97-46c0-aa2c-32ddbefa349e tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec8d131a9764028a096314a4ecd58f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9ff6952b014d0a9abb28dcf0b818b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:39:46.899399 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-262d6281-ef97-46c0-aa2c-32ddbefa349e tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] 10.222.0.66 "GET /compute/v2.1/servers/60273216-f2ed-46cf-8836-1d85335d8920" status: 200 len: 1322 microversion: 2.1 time: 0.179542 Aug 04 03:39:46.904721 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 62/119] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:39:46 2022] GET /compute/v2.1/servers/60273216-f2ed-46cf-8836-1d85335d8920 => generated 1322 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:39:46.984820 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-5e1b95ef-5c03-4f4f-b8b9-2740f19fbaa1 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:39:46.985528 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-5e1b95ef-5c03-4f4f-b8b9-2740f19fbaa1 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] [instance: 9307fdad-ca63-449d-bc5c-7e9e167c59f3] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:39:46.992459 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-5e1b95ef-5c03-4f4f-b8b9-2740f19fbaa1 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:39:46.993453 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-5e1b95ef-5c03-4f4f-b8b9-2740f19fbaa1 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:39:46.994274 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-5e1b95ef-5c03-4f4f-b8b9-2740f19fbaa1 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:39:46.994713 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-5e1b95ef-5c03-4f4f-b8b9-2740f19fbaa1 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:39:46.997765 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-094108b6-acf5-4397-b67c-934f303250f0 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:39:46.998375 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-094108b6-acf5-4397-b67c-934f303250f0 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] [instance: f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:39:47.005677 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-094108b6-acf5-4397-b67c-934f303250f0 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:39:47.006151 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-094108b6-acf5-4397-b67c-934f303250f0 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:39:47.006913 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-094108b6-acf5-4397-b67c-934f303250f0 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:39:47.007348 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-094108b6-acf5-4397-b67c-934f303250f0 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:39:47.210326 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-094108b6-acf5-4397-b67c-934f303250f0 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f4252210bd412ba24305b00a6e77b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a97e25e7eae402f8f5c4222019ed87c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:39:47.218668 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-5e1b95ef-5c03-4f4f-b8b9-2740f19fbaa1 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dba436d0a67433f8c8ae7cd40d3f795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46b8dc64007429b805971d4c6f5b471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:39:47.223398 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-5e1b95ef-5c03-4f4f-b8b9-2740f19fbaa1 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] 10.222.0.66 "GET /compute/v2.1/servers/9307fdad-ca63-449d-bc5c-7e9e167c59f3" status: 200 len: 1361 microversion: 2.1 time: 0.242115 Aug 04 03:39:47.224359 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 58/120] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:39:46 2022] GET /compute/v2.1/servers/9307fdad-ca63-449d-bc5c-7e9e167c59f3 => generated 1361 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:39:47.235875 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-094108b6-acf5-4397-b67c-934f303250f0 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] 10.222.0.66 "GET /compute/v2.1/servers/f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e" status: 200 len: 1313 microversion: 2.1 time: 0.237975 Aug 04 03:39:47.235875 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 63/121] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:39:46 2022] GET /compute/v2.1/servers/f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e => generated 1313 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 03:39:47.920149 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-4b6346ea-8409-4c8f-875f-eb4956689c21 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:39:47.920792 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-4b6346ea-8409-4c8f-875f-eb4956689c21 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] [instance: 60273216-f2ed-46cf-8836-1d85335d8920] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:39:47.927514 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-4b6346ea-8409-4c8f-875f-eb4956689c21 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:39:47.927958 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-4b6346ea-8409-4c8f-875f-eb4956689c21 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:39:47.928717 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-4b6346ea-8409-4c8f-875f-eb4956689c21 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:39:47.929147 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-4b6346ea-8409-4c8f-875f-eb4956689c21 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:39:48.066056 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-4b6346ea-8409-4c8f-875f-eb4956689c21 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec8d131a9764028a096314a4ecd58f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9ff6952b014d0a9abb28dcf0b818b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:39:48.076703 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-4b6346ea-8409-4c8f-875f-eb4956689c21 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] 10.222.0.66 "GET /compute/v2.1/servers/60273216-f2ed-46cf-8836-1d85335d8920" status: 200 len: 1322 microversion: 2.1 time: 0.158736 Aug 04 03:39:48.085613 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 64/122] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:39:47 2022] GET /compute/v2.1/servers/60273216-f2ed-46cf-8836-1d85335d8920 => generated 1322 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:39:48.249356 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-b3e6cc97-f3ba-41c7-9993-18915bc1f5a3 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:39:48.250004 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-b3e6cc97-f3ba-41c7-9993-18915bc1f5a3 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] [instance: 9307fdad-ca63-449d-bc5c-7e9e167c59f3] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:39:48.258815 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-b3e6cc97-f3ba-41c7-9993-18915bc1f5a3 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:39:48.259239 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-cfaa5e29-b821-4999-8080-2da6f9e6aad0 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:39:48.259357 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-b3e6cc97-f3ba-41c7-9993-18915bc1f5a3 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:39:48.259868 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-cfaa5e29-b821-4999-8080-2da6f9e6aad0 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] [instance: f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:39:48.263044 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-b3e6cc97-f3ba-41c7-9993-18915bc1f5a3 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:39:48.264320 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-b3e6cc97-f3ba-41c7-9993-18915bc1f5a3 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:39:48.278140 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-cfaa5e29-b821-4999-8080-2da6f9e6aad0 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:39:48.279851 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-cfaa5e29-b821-4999-8080-2da6f9e6aad0 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:39:48.281990 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-cfaa5e29-b821-4999-8080-2da6f9e6aad0 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:39:48.285940 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-cfaa5e29-b821-4999-8080-2da6f9e6aad0 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:39:48.491683 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-b3e6cc97-f3ba-41c7-9993-18915bc1f5a3 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dba436d0a67433f8c8ae7cd40d3f795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46b8dc64007429b805971d4c6f5b471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:39:48.499812 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-cfaa5e29-b821-4999-8080-2da6f9e6aad0 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f4252210bd412ba24305b00a6e77b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a97e25e7eae402f8f5c4222019ed87c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:39:48.500495 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-b3e6cc97-f3ba-41c7-9993-18915bc1f5a3 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] 10.222.0.66 "GET /compute/v2.1/servers/9307fdad-ca63-449d-bc5c-7e9e167c59f3" status: 200 len: 1361 microversion: 2.1 time: 0.257300 Aug 04 03:39:48.502574 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 59/123] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:39:48 2022] GET /compute/v2.1/servers/9307fdad-ca63-449d-bc5c-7e9e167c59f3 => generated 1361 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:39:48.523387 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-cfaa5e29-b821-4999-8080-2da6f9e6aad0 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] 10.222.0.66 "GET /compute/v2.1/servers/f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e" status: 200 len: 1313 microversion: 2.1 time: 0.259238 Aug 04 03:39:48.523387 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 65/124] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:39:48 2022] GET /compute/v2.1/servers/f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e => generated 1313 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:39:49.096090 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-5e5d3ede-d265-4039-af61-1bef287203a4 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:39:49.096822 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-5e5d3ede-d265-4039-af61-1bef287203a4 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] [instance: 60273216-f2ed-46cf-8836-1d85335d8920] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:39:49.103540 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-5e5d3ede-d265-4039-af61-1bef287203a4 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:39:49.103986 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-5e5d3ede-d265-4039-af61-1bef287203a4 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:39:49.104742 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-5e5d3ede-d265-4039-af61-1bef287203a4 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:39:49.105168 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-5e5d3ede-d265-4039-af61-1bef287203a4 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:39:49.272087 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-5e5d3ede-d265-4039-af61-1bef287203a4 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec8d131a9764028a096314a4ecd58f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9ff6952b014d0a9abb28dcf0b818b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:39:49.281228 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-5e5d3ede-d265-4039-af61-1bef287203a4 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] 10.222.0.66 "GET /compute/v2.1/servers/60273216-f2ed-46cf-8836-1d85335d8920" status: 200 len: 1322 microversion: 2.1 time: 0.188900 Aug 04 03:39:49.281814 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 60/125] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:39:49 2022] GET /compute/v2.1/servers/60273216-f2ed-46cf-8836-1d85335d8920 => generated 1322 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:39:49.539697 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-be16fc01-ca68-4571-b63b-59f2c04f7941 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:39:49.542683 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-b237e30c-f45f-49e6-a42c-75e087ab0760 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:39:49.543279 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-b237e30c-f45f-49e6-a42c-75e087ab0760 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] [instance: f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:39:49.546677 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-be16fc01-ca68-4571-b63b-59f2c04f7941 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] [instance: 9307fdad-ca63-449d-bc5c-7e9e167c59f3] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:39:49.550455 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-b237e30c-f45f-49e6-a42c-75e087ab0760 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:39:49.550995 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-b237e30c-f45f-49e6-a42c-75e087ab0760 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:39:49.551981 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-b237e30c-f45f-49e6-a42c-75e087ab0760 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:39:49.552600 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-b237e30c-f45f-49e6-a42c-75e087ab0760 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:39:49.552859 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-be16fc01-ca68-4571-b63b-59f2c04f7941 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:39:49.553355 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-be16fc01-ca68-4571-b63b-59f2c04f7941 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:39:49.554128 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-be16fc01-ca68-4571-b63b-59f2c04f7941 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:39:49.554571 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-be16fc01-ca68-4571-b63b-59f2c04f7941 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:39:49.757838 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-b237e30c-f45f-49e6-a42c-75e087ab0760 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f4252210bd412ba24305b00a6e77b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a97e25e7eae402f8f5c4222019ed87c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:39:49.764884 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-be16fc01-ca68-4571-b63b-59f2c04f7941 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dba436d0a67433f8c8ae7cd40d3f795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46b8dc64007429b805971d4c6f5b471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:39:49.766290 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-b237e30c-f45f-49e6-a42c-75e087ab0760 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] 10.222.0.66 "GET /compute/v2.1/servers/f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e" status: 200 len: 1313 microversion: 2.1 time: 0.232642 Aug 04 03:39:49.766872 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 61/126] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:39:49 2022] GET /compute/v2.1/servers/f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e => generated 1313 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:39:49.773605 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-be16fc01-ca68-4571-b63b-59f2c04f7941 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] 10.222.0.66 "GET /compute/v2.1/servers/9307fdad-ca63-449d-bc5c-7e9e167c59f3" status: 200 len: 1361 microversion: 2.1 time: 0.241565 Aug 04 03:39:49.788182 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 66/127] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:39:49 2022] GET /compute/v2.1/servers/9307fdad-ca63-449d-bc5c-7e9e167c59f3 => generated 1361 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:39:50.302855 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-59b2897f-c111-448a-8cbe-331bb1fd41f9 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:39:50.303470 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-59b2897f-c111-448a-8cbe-331bb1fd41f9 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] [instance: 60273216-f2ed-46cf-8836-1d85335d8920] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:39:50.309839 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-59b2897f-c111-448a-8cbe-331bb1fd41f9 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:39:50.310290 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-59b2897f-c111-448a-8cbe-331bb1fd41f9 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:39:50.311061 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-59b2897f-c111-448a-8cbe-331bb1fd41f9 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:39:50.311983 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-59b2897f-c111-448a-8cbe-331bb1fd41f9 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:39:50.461373 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-59b2897f-c111-448a-8cbe-331bb1fd41f9 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec8d131a9764028a096314a4ecd58f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9ff6952b014d0a9abb28dcf0b818b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:39:50.468927 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-59b2897f-c111-448a-8cbe-331bb1fd41f9 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] 10.222.0.66 "GET /compute/v2.1/servers/60273216-f2ed-46cf-8836-1d85335d8920" status: 200 len: 1322 microversion: 2.1 time: 0.170665 Aug 04 03:39:50.469520 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 62/128] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:39:50 2022] GET /compute/v2.1/servers/60273216-f2ed-46cf-8836-1d85335d8920 => generated 1322 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 03:39:50.787288 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-91424d6c-3c22-476c-aded-353b3fef9414 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:39:50.787903 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-91424d6c-3c22-476c-aded-353b3fef9414 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] [instance: f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:39:50.796371 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-91424d6c-3c22-476c-aded-353b3fef9414 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:39:50.796517 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-cf54906d-b0aa-43b7-8329-773c6ca3130a tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:39:50.796619 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-91424d6c-3c22-476c-aded-353b3fef9414 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:39:50.796712 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-cf54906d-b0aa-43b7-8329-773c6ca3130a tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] [instance: 9307fdad-ca63-449d-bc5c-7e9e167c59f3] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:39:50.796808 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-91424d6c-3c22-476c-aded-353b3fef9414 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:39:50.796808 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-91424d6c-3c22-476c-aded-353b3fef9414 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:39:50.801457 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-cf54906d-b0aa-43b7-8329-773c6ca3130a tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:39:50.801909 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-cf54906d-b0aa-43b7-8329-773c6ca3130a tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:39:50.802724 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-cf54906d-b0aa-43b7-8329-773c6ca3130a tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:39:50.803160 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-cf54906d-b0aa-43b7-8329-773c6ca3130a tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:39:51.000169 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-91424d6c-3c22-476c-aded-353b3fef9414 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f4252210bd412ba24305b00a6e77b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a97e25e7eae402f8f5c4222019ed87c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:39:51.000492 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-cf54906d-b0aa-43b7-8329-773c6ca3130a tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dba436d0a67433f8c8ae7cd40d3f795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46b8dc64007429b805971d4c6f5b471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:39:51.001403 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG dbcounter [-] [130263] Writing DB stats nova_cell1:SELECT=100 {{(pid=130263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:39:51.006748 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-91424d6c-3c22-476c-aded-353b3fef9414 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] 10.222.0.66 "GET /compute/v2.1/servers/f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e" status: 200 len: 1313 microversion: 2.1 time: 0.223312 Aug 04 03:39:51.007837 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 67/129] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:39:50 2022] GET /compute/v2.1/servers/f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e => generated 1313 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:39:51.022182 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-cf54906d-b0aa-43b7-8329-773c6ca3130a tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] 10.222.0.66 "GET /compute/v2.1/servers/9307fdad-ca63-449d-bc5c-7e9e167c59f3" status: 200 len: 1361 microversion: 2.1 time: 0.231313 Aug 04 03:39:51.029239 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 63/130] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:39:50 2022] GET /compute/v2.1/servers/9307fdad-ca63-449d-bc5c-7e9e167c59f3 => generated 1361 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 03:39:51.493486 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-78975b56-99a1-460c-af1c-d622d3b28c8d tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:39:51.493486 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-78975b56-99a1-460c-af1c-d622d3b28c8d tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] [instance: 60273216-f2ed-46cf-8836-1d85335d8920] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:39:51.499469 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-78975b56-99a1-460c-af1c-d622d3b28c8d tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:39:51.499917 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-78975b56-99a1-460c-af1c-d622d3b28c8d tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:39:51.501063 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-78975b56-99a1-460c-af1c-d622d3b28c8d tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:39:51.501063 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-78975b56-99a1-460c-af1c-d622d3b28c8d tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:39:51.664330 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-78975b56-99a1-460c-af1c-d622d3b28c8d tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec8d131a9764028a096314a4ecd58f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9ff6952b014d0a9abb28dcf0b818b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:39:51.671802 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-78975b56-99a1-460c-af1c-d622d3b28c8d tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] 10.222.0.66 "GET /compute/v2.1/servers/60273216-f2ed-46cf-8836-1d85335d8920" status: 200 len: 1322 microversion: 2.1 time: 0.184182 Aug 04 03:39:51.672366 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 68/131] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:39:51 2022] GET /compute/v2.1/servers/60273216-f2ed-46cf-8836-1d85335d8920 => generated 1322 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:39:52.029182 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-baf9eef3-1fba-4202-82ac-651a8c2dba36 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:39:52.030021 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-baf9eef3-1fba-4202-82ac-651a8c2dba36 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] [instance: f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:39:52.037431 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-baf9eef3-1fba-4202-82ac-651a8c2dba36 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:39:52.039622 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-baf9eef3-1fba-4202-82ac-651a8c2dba36 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:39:52.040539 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-baf9eef3-1fba-4202-82ac-651a8c2dba36 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:39:52.040846 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-baf9eef3-1fba-4202-82ac-651a8c2dba36 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:39:52.043360 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-251731c1-4546-4361-916c-7a07eda56d61 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:39:52.044501 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-251731c1-4546-4361-916c-7a07eda56d61 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] [instance: 9307fdad-ca63-449d-bc5c-7e9e167c59f3] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:39:52.051670 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-251731c1-4546-4361-916c-7a07eda56d61 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:39:52.052364 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-251731c1-4546-4361-916c-7a07eda56d61 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:39:52.053517 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-251731c1-4546-4361-916c-7a07eda56d61 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:39:52.054165 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-251731c1-4546-4361-916c-7a07eda56d61 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:39:52.263375 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-251731c1-4546-4361-916c-7a07eda56d61 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dba436d0a67433f8c8ae7cd40d3f795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46b8dc64007429b805971d4c6f5b471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:39:52.271921 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-baf9eef3-1fba-4202-82ac-651a8c2dba36 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f4252210bd412ba24305b00a6e77b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a97e25e7eae402f8f5c4222019ed87c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:39:52.283696 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-251731c1-4546-4361-916c-7a07eda56d61 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] 10.222.0.66 "GET /compute/v2.1/servers/9307fdad-ca63-449d-bc5c-7e9e167c59f3" status: 200 len: 1361 microversion: 2.1 time: 0.244679 Aug 04 03:39:52.284492 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 69/132] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:39:52 2022] GET /compute/v2.1/servers/9307fdad-ca63-449d-bc5c-7e9e167c59f3 => generated 1361 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 03:39:52.284602 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-baf9eef3-1fba-4202-82ac-651a8c2dba36 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] 10.222.0.66 "GET /compute/v2.1/servers/f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e" status: 200 len: 1313 microversion: 2.1 time: 0.257941 Aug 04 03:39:52.285353 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 64/133] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:39:52 2022] GET /compute/v2.1/servers/f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e => generated 1313 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:39:52.693814 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-5a3a8ae5-7a2a-4fe8-af9d-ae7efe214996 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:39:52.694438 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-5a3a8ae5-7a2a-4fe8-af9d-ae7efe214996 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] [instance: 60273216-f2ed-46cf-8836-1d85335d8920] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:39:52.701176 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-5a3a8ae5-7a2a-4fe8-af9d-ae7efe214996 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:39:52.701663 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-5a3a8ae5-7a2a-4fe8-af9d-ae7efe214996 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:39:52.702434 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-5a3a8ae5-7a2a-4fe8-af9d-ae7efe214996 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:39:52.702872 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-5a3a8ae5-7a2a-4fe8-af9d-ae7efe214996 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:39:52.840191 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-5a3a8ae5-7a2a-4fe8-af9d-ae7efe214996 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec8d131a9764028a096314a4ecd58f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9ff6952b014d0a9abb28dcf0b818b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:39:52.854826 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-5a3a8ae5-7a2a-4fe8-af9d-ae7efe214996 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] 10.222.0.66 "GET /compute/v2.1/servers/60273216-f2ed-46cf-8836-1d85335d8920" status: 200 len: 1322 microversion: 2.1 time: 0.162452 Aug 04 03:39:52.855610 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 70/134] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:39:52 2022] GET /compute/v2.1/servers/60273216-f2ed-46cf-8836-1d85335d8920 => generated 1322 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:39:53.315537 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-1a124a7a-42b8-45ae-a417-fe6688d10bc8 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:39:53.316021 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-4d06e6a8-d32a-4f45-a34d-df643b3fd8b0 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:39:53.316539 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-4d06e6a8-d32a-4f45-a34d-df643b3fd8b0 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] [instance: f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:39:53.322853 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-4d06e6a8-d32a-4f45-a34d-df643b3fd8b0 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:39:53.323226 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-4d06e6a8-d32a-4f45-a34d-df643b3fd8b0 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:39:53.324002 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-4d06e6a8-d32a-4f45-a34d-df643b3fd8b0 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:39:53.324439 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-4d06e6a8-d32a-4f45-a34d-df643b3fd8b0 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:39:53.325359 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-1a124a7a-42b8-45ae-a417-fe6688d10bc8 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] [instance: 9307fdad-ca63-449d-bc5c-7e9e167c59f3] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:39:53.344513 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-1a124a7a-42b8-45ae-a417-fe6688d10bc8 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:39:53.344513 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-1a124a7a-42b8-45ae-a417-fe6688d10bc8 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:39:53.344513 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-1a124a7a-42b8-45ae-a417-fe6688d10bc8 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:39:53.344513 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-1a124a7a-42b8-45ae-a417-fe6688d10bc8 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:39:53.364059 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG dbcounter [-] [130262] Writing DB stats nova_cell1:SELECT=100 {{(pid=130262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:39:53.540643 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-1a124a7a-42b8-45ae-a417-fe6688d10bc8 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dba436d0a67433f8c8ae7cd40d3f795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46b8dc64007429b805971d4c6f5b471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:39:53.548402 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-1a124a7a-42b8-45ae-a417-fe6688d10bc8 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] 10.222.0.66 "GET /compute/v2.1/servers/9307fdad-ca63-449d-bc5c-7e9e167c59f3" status: 200 len: 1361 microversion: 2.1 time: 0.236575 Aug 04 03:39:53.548521 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-4d06e6a8-d32a-4f45-a34d-df643b3fd8b0 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f4252210bd412ba24305b00a6e77b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a97e25e7eae402f8f5c4222019ed87c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:39:53.566600 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 65/135] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:39:53 2022] GET /compute/v2.1/servers/9307fdad-ca63-449d-bc5c-7e9e167c59f3 => generated 1361 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:39:53.568399 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-4d06e6a8-d32a-4f45-a34d-df643b3fd8b0 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] 10.222.0.66 "GET /compute/v2.1/servers/f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e" status: 200 len: 1313 microversion: 2.1 time: 0.256392 Aug 04 03:39:53.569308 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 71/136] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:39:53 2022] GET /compute/v2.1/servers/f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e => generated 1313 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:39:53.877450 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-32d95e97-8e34-48d5-85c0-ad5e2de207b6 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:39:53.878330 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-32d95e97-8e34-48d5-85c0-ad5e2de207b6 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] [instance: 60273216-f2ed-46cf-8836-1d85335d8920] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:39:53.885424 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-32d95e97-8e34-48d5-85c0-ad5e2de207b6 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:39:53.885878 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-32d95e97-8e34-48d5-85c0-ad5e2de207b6 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:39:53.886648 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-32d95e97-8e34-48d5-85c0-ad5e2de207b6 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:39:53.887086 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-32d95e97-8e34-48d5-85c0-ad5e2de207b6 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:39:54.049674 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-32d95e97-8e34-48d5-85c0-ad5e2de207b6 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec8d131a9764028a096314a4ecd58f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9ff6952b014d0a9abb28dcf0b818b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:39:54.058670 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-32d95e97-8e34-48d5-85c0-ad5e2de207b6 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] 10.222.0.66 "GET /compute/v2.1/servers/60273216-f2ed-46cf-8836-1d85335d8920" status: 200 len: 1322 microversion: 2.1 time: 0.185414 Aug 04 03:39:54.059337 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 66/137] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:39:53 2022] GET /compute/v2.1/servers/60273216-f2ed-46cf-8836-1d85335d8920 => generated 1322 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:39:54.572365 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-c2e7faae-3625-41f6-afd0-23241aef0a9f tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:39:54.572973 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-c2e7faae-3625-41f6-afd0-23241aef0a9f tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] [instance: 9307fdad-ca63-449d-bc5c-7e9e167c59f3] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:39:54.579207 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-c2e7faae-3625-41f6-afd0-23241aef0a9f tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:39:54.579662 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-c2e7faae-3625-41f6-afd0-23241aef0a9f tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:39:54.580433 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-c2e7faae-3625-41f6-afd0-23241aef0a9f tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:39:54.580858 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-c2e7faae-3625-41f6-afd0-23241aef0a9f tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:39:54.589096 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-7cf41069-5759-4c90-8794-ebcebce5873f tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:39:54.590003 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-7cf41069-5759-4c90-8794-ebcebce5873f tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] [instance: f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:39:54.596456 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-7cf41069-5759-4c90-8794-ebcebce5873f tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:39:54.597137 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-7cf41069-5759-4c90-8794-ebcebce5873f tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:39:54.598850 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-7cf41069-5759-4c90-8794-ebcebce5873f tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:39:54.599428 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-7cf41069-5759-4c90-8794-ebcebce5873f tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:39:54.805743 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-c2e7faae-3625-41f6-afd0-23241aef0a9f tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dba436d0a67433f8c8ae7cd40d3f795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46b8dc64007429b805971d4c6f5b471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:39:54.814596 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-c2e7faae-3625-41f6-afd0-23241aef0a9f tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] 10.222.0.66 "GET /compute/v2.1/servers/9307fdad-ca63-449d-bc5c-7e9e167c59f3" status: 200 len: 1361 microversion: 2.1 time: 0.245944 Aug 04 03:39:54.815181 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 72/138] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:39:54 2022] GET /compute/v2.1/servers/9307fdad-ca63-449d-bc5c-7e9e167c59f3 => generated 1361 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:39:54.823985 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-7cf41069-5759-4c90-8794-ebcebce5873f tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f4252210bd412ba24305b00a6e77b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a97e25e7eae402f8f5c4222019ed87c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:39:54.832483 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-7cf41069-5759-4c90-8794-ebcebce5873f tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] 10.222.0.66 "GET /compute/v2.1/servers/f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e" status: 200 len: 1313 microversion: 2.1 time: 0.246785 Aug 04 03:39:54.833041 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 67/139] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:39:54 2022] GET /compute/v2.1/servers/f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e => generated 1313 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 03:39:54.944311 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [req-92a82041-74c3-4ead-ab5f-596ffaa3f5f4 req-2c464eda-fbf0-4b58-9eaa-e64b2c4b83d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8620bffd-405f-41cc-9388-abdb301923d5", "name": "network-vif-plugged", "status": "completed", "tag": "fda02e5d-f2e1-4658-81b6-f9d2c0fd627f"}]} {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 03:39:54.954032 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [req-92a82041-74c3-4ead-ab5f-596ffaa3f5f4 req-2c464eda-fbf0-4b58-9eaa-e64b2c4b83d6 service nova] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:39:54.954474 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [req-92a82041-74c3-4ead-ab5f-596ffaa3f5f4 req-2c464eda-fbf0-4b58-9eaa-e64b2c4b83d6 service nova] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:39:54.966447 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.compute.server_external_events [req-92a82041-74c3-4ead-ab5f-596ffaa3f5f4 req-2c464eda-fbf0-4b58-9eaa-e64b2c4b83d6 service nova] Creating event network-vif-plugged:fda02e5d-f2e1-4658-81b6-f9d2c0fd627f for instance 8620bffd-405f-41cc-9388-abdb301923d5 on hv-cinder-73306 Aug 04 03:39:54.971975 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [req-92a82041-74c3-4ead-ab5f-596ffaa3f5f4 req-2c464eda-fbf0-4b58-9eaa-e64b2c4b83d6 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087590 Aug 04 03:39:54.973442 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 73/140] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 03:39:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 03:39:55.078720 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-89d0ed55-1690-4a0f-abc8-647f787a88d9 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:39:55.079372 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-89d0ed55-1690-4a0f-abc8-647f787a88d9 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] [instance: 60273216-f2ed-46cf-8836-1d85335d8920] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:39:55.085782 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-89d0ed55-1690-4a0f-abc8-647f787a88d9 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:39:55.086231 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-89d0ed55-1690-4a0f-abc8-647f787a88d9 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:39:55.086998 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-89d0ed55-1690-4a0f-abc8-647f787a88d9 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:39:55.087440 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-89d0ed55-1690-4a0f-abc8-647f787a88d9 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:39:55.216012 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-89d0ed55-1690-4a0f-abc8-647f787a88d9 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec8d131a9764028a096314a4ecd58f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9ff6952b014d0a9abb28dcf0b818b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:39:55.224689 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-89d0ed55-1690-4a0f-abc8-647f787a88d9 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] 10.222.0.66 "GET /compute/v2.1/servers/60273216-f2ed-46cf-8836-1d85335d8920" status: 200 len: 1322 microversion: 2.1 time: 0.149734 Aug 04 03:39:55.225271 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 68/141] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:39:55 2022] GET /compute/v2.1/servers/60273216-f2ed-46cf-8836-1d85335d8920 => generated 1322 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:39:55.842640 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-a67f26b7-be4d-4f25-9840-e991706280ed tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:39:55.843249 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-a67f26b7-be4d-4f25-9840-e991706280ed tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] [instance: 9307fdad-ca63-449d-bc5c-7e9e167c59f3] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:39:55.850415 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-a67f26b7-be4d-4f25-9840-e991706280ed tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:39:55.850862 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-a67f26b7-be4d-4f25-9840-e991706280ed tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:39:55.851605 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-a67f26b7-be4d-4f25-9840-e991706280ed tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:39:55.852037 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-a67f26b7-be4d-4f25-9840-e991706280ed tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:39:55.856532 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-89b4c532-1094-4ce0-a80f-f4b5c7b2cc6e tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:39:55.857145 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-89b4c532-1094-4ce0-a80f-f4b5c7b2cc6e tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] [instance: f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:39:55.863555 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-89b4c532-1094-4ce0-a80f-f4b5c7b2cc6e tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:39:55.864006 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-89b4c532-1094-4ce0-a80f-f4b5c7b2cc6e tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:39:55.864771 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-89b4c532-1094-4ce0-a80f-f4b5c7b2cc6e tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:39:55.865214 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-89b4c532-1094-4ce0-a80f-f4b5c7b2cc6e tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:39:56.059460 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-89b4c532-1094-4ce0-a80f-f4b5c7b2cc6e tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f4252210bd412ba24305b00a6e77b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a97e25e7eae402f8f5c4222019ed87c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:39:56.064096 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-a67f26b7-be4d-4f25-9840-e991706280ed tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dba436d0a67433f8c8ae7cd40d3f795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46b8dc64007429b805971d4c6f5b471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:39:56.069070 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-89b4c532-1094-4ce0-a80f-f4b5c7b2cc6e tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] 10.222.0.66 "GET /compute/v2.1/servers/f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e" status: 200 len: 1313 microversion: 2.1 time: 0.216236 Aug 04 03:39:56.069701 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 69/142] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:39:55 2022] GET /compute/v2.1/servers/f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e => generated 1313 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 03:39:56.073361 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-a67f26b7-be4d-4f25-9840-e991706280ed tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] 10.222.0.66 "GET /compute/v2.1/servers/9307fdad-ca63-449d-bc5c-7e9e167c59f3" status: 200 len: 1361 microversion: 2.1 time: 0.234920 Aug 04 03:39:56.073950 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 74/143] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:39:55 2022] GET /compute/v2.1/servers/9307fdad-ca63-449d-bc5c-7e9e167c59f3 => generated 1361 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:39:56.245121 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-ba853e72-9f04-4746-973f-a216f3c5592a tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:39:56.245866 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-ba853e72-9f04-4746-973f-a216f3c5592a tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] [instance: 60273216-f2ed-46cf-8836-1d85335d8920] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:39:56.251943 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-ba853e72-9f04-4746-973f-a216f3c5592a tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:39:56.252393 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-ba853e72-9f04-4746-973f-a216f3c5592a tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:39:56.253156 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-ba853e72-9f04-4746-973f-a216f3c5592a tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:39:56.254305 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-ba853e72-9f04-4746-973f-a216f3c5592a tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:39:56.383619 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-ba853e72-9f04-4746-973f-a216f3c5592a tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec8d131a9764028a096314a4ecd58f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9ff6952b014d0a9abb28dcf0b818b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:39:56.390867 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-ba853e72-9f04-4746-973f-a216f3c5592a tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] 10.222.0.66 "GET /compute/v2.1/servers/60273216-f2ed-46cf-8836-1d85335d8920" status: 200 len: 1322 microversion: 2.1 time: 0.149747 Aug 04 03:39:56.391415 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 70/144] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:39:56 2022] GET /compute/v2.1/servers/60273216-f2ed-46cf-8836-1d85335d8920 => generated 1322 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:39:57.094912 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-f76ecaa9-6ce3-4248-9d76-4fcf6408b9d7 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:39:57.095415 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-9833ce2b-23dc-4f8a-a618-23bb37ead63a tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:39:57.095787 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-f76ecaa9-6ce3-4248-9d76-4fcf6408b9d7 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] [instance: 9307fdad-ca63-449d-bc5c-7e9e167c59f3] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:39:57.095998 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-9833ce2b-23dc-4f8a-a618-23bb37ead63a tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] [instance: f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:39:57.102632 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-f76ecaa9-6ce3-4248-9d76-4fcf6408b9d7 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:39:57.102761 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-9833ce2b-23dc-4f8a-a618-23bb37ead63a tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:39:57.103072 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-f76ecaa9-6ce3-4248-9d76-4fcf6408b9d7 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:39:57.103171 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-9833ce2b-23dc-4f8a-a618-23bb37ead63a tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:39:57.103825 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-f76ecaa9-6ce3-4248-9d76-4fcf6408b9d7 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:39:57.103931 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-9833ce2b-23dc-4f8a-a618-23bb37ead63a tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:39:57.104253 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-f76ecaa9-6ce3-4248-9d76-4fcf6408b9d7 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:39:57.104343 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-9833ce2b-23dc-4f8a-a618-23bb37ead63a tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:39:57.301161 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-f76ecaa9-6ce3-4248-9d76-4fcf6408b9d7 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dba436d0a67433f8c8ae7cd40d3f795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46b8dc64007429b805971d4c6f5b471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:39:57.305184 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-9833ce2b-23dc-4f8a-a618-23bb37ead63a tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f4252210bd412ba24305b00a6e77b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a97e25e7eae402f8f5c4222019ed87c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:39:57.308923 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-f76ecaa9-6ce3-4248-9d76-4fcf6408b9d7 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] 10.222.0.66 "GET /compute/v2.1/servers/9307fdad-ca63-449d-bc5c-7e9e167c59f3" status: 200 len: 1361 microversion: 2.1 time: 0.217743 Aug 04 03:39:57.309599 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 75/145] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:39:57 2022] GET /compute/v2.1/servers/9307fdad-ca63-449d-bc5c-7e9e167c59f3 => generated 1361 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:39:57.312868 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-9833ce2b-23dc-4f8a-a618-23bb37ead63a tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] 10.222.0.66 "GET /compute/v2.1/servers/f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e" status: 200 len: 1313 microversion: 2.1 time: 0.221223 Aug 04 03:39:57.313450 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 71/146] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:39:57 2022] GET /compute/v2.1/servers/f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e => generated 1313 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 03:39:57.411542 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-33471e83-b02c-4d55-8418-c23ed3309b92 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:39:57.412172 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-33471e83-b02c-4d55-8418-c23ed3309b92 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] [instance: 60273216-f2ed-46cf-8836-1d85335d8920] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:39:57.418111 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-33471e83-b02c-4d55-8418-c23ed3309b92 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:39:57.418557 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-33471e83-b02c-4d55-8418-c23ed3309b92 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:39:57.419309 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-33471e83-b02c-4d55-8418-c23ed3309b92 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:39:57.419747 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-33471e83-b02c-4d55-8418-c23ed3309b92 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:39:57.552345 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-33471e83-b02c-4d55-8418-c23ed3309b92 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec8d131a9764028a096314a4ecd58f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9ff6952b014d0a9abb28dcf0b818b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:39:57.559709 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-33471e83-b02c-4d55-8418-c23ed3309b92 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] 10.222.0.66 "GET /compute/v2.1/servers/60273216-f2ed-46cf-8836-1d85335d8920" status: 200 len: 1322 microversion: 2.1 time: 0.152583 Aug 04 03:39:57.560266 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 76/147] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:39:57 2022] GET /compute/v2.1/servers/60273216-f2ed-46cf-8836-1d85335d8920 => generated 1322 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:39:58.329715 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-fbde5d2c-1a39-4fb1-802d-9947942cd300 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:39:58.330335 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-fbde5d2c-1a39-4fb1-802d-9947942cd300 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] [instance: 9307fdad-ca63-449d-bc5c-7e9e167c59f3] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:39:58.334443 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-dcdc0cfd-320d-4618-b7f8-ea4ff008dd4c tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:39:58.335046 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-dcdc0cfd-320d-4618-b7f8-ea4ff008dd4c tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] [instance: f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:39:58.336831 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-fbde5d2c-1a39-4fb1-802d-9947942cd300 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:39:58.337663 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-fbde5d2c-1a39-4fb1-802d-9947942cd300 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:39:58.338207 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-fbde5d2c-1a39-4fb1-802d-9947942cd300 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:39:58.338663 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-fbde5d2c-1a39-4fb1-802d-9947942cd300 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:39:58.341471 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-dcdc0cfd-320d-4618-b7f8-ea4ff008dd4c tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:39:58.341913 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-dcdc0cfd-320d-4618-b7f8-ea4ff008dd4c tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:39:58.342665 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-dcdc0cfd-320d-4618-b7f8-ea4ff008dd4c tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:39:58.343097 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-dcdc0cfd-320d-4618-b7f8-ea4ff008dd4c tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:39:58.531637 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-fbde5d2c-1a39-4fb1-802d-9947942cd300 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dba436d0a67433f8c8ae7cd40d3f795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46b8dc64007429b805971d4c6f5b471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:39:58.535737 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-dcdc0cfd-320d-4618-b7f8-ea4ff008dd4c tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f4252210bd412ba24305b00a6e77b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a97e25e7eae402f8f5c4222019ed87c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:39:58.541218 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-fbde5d2c-1a39-4fb1-802d-9947942cd300 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] 10.222.0.66 "GET /compute/v2.1/servers/9307fdad-ca63-449d-bc5c-7e9e167c59f3" status: 200 len: 1361 microversion: 2.1 time: 0.214362 Aug 04 03:39:58.541800 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 72/148] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:39:58 2022] GET /compute/v2.1/servers/9307fdad-ca63-449d-bc5c-7e9e167c59f3 => generated 1361 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:39:58.544362 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-dcdc0cfd-320d-4618-b7f8-ea4ff008dd4c tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] 10.222.0.66 "GET /compute/v2.1/servers/f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e" status: 200 len: 1313 microversion: 2.1 time: 0.213796 Aug 04 03:39:58.545104 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 77/149] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:39:58 2022] GET /compute/v2.1/servers/f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e => generated 1313 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 03:39:58.580227 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-aa2d3f88-f50f-424c-80e7-f5951fef9f91 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:39:58.580833 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-aa2d3f88-f50f-424c-80e7-f5951fef9f91 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] [instance: 60273216-f2ed-46cf-8836-1d85335d8920] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:39:58.588527 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-aa2d3f88-f50f-424c-80e7-f5951fef9f91 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:39:58.588969 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-aa2d3f88-f50f-424c-80e7-f5951fef9f91 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:39:58.589783 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-aa2d3f88-f50f-424c-80e7-f5951fef9f91 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:39:58.590216 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-aa2d3f88-f50f-424c-80e7-f5951fef9f91 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:39:58.716953 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-aa2d3f88-f50f-424c-80e7-f5951fef9f91 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec8d131a9764028a096314a4ecd58f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9ff6952b014d0a9abb28dcf0b818b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:39:58.724710 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-aa2d3f88-f50f-424c-80e7-f5951fef9f91 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] 10.222.0.66 "GET /compute/v2.1/servers/60273216-f2ed-46cf-8836-1d85335d8920" status: 200 len: 1322 microversion: 2.1 time: 0.148196 Aug 04 03:39:58.728477 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 73/150] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:39:58 2022] GET /compute/v2.1/servers/60273216-f2ed-46cf-8836-1d85335d8920 => generated 1322 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:39:59.562354 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-2072d12f-59ed-4f40-8040-09846084d60d tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:39:59.563897 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-2072d12f-59ed-4f40-8040-09846084d60d tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] [instance: 9307fdad-ca63-449d-bc5c-7e9e167c59f3] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:39:59.565144 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-416f51fc-f232-4b63-ac3a-1a12b6a12619 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:39:59.565938 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-416f51fc-f232-4b63-ac3a-1a12b6a12619 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] [instance: f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:39:59.571974 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-2072d12f-59ed-4f40-8040-09846084d60d tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:39:59.572432 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-2072d12f-59ed-4f40-8040-09846084d60d tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:39:59.573229 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-2072d12f-59ed-4f40-8040-09846084d60d tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:39:59.574062 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-2072d12f-59ed-4f40-8040-09846084d60d tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:39:59.574954 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-416f51fc-f232-4b63-ac3a-1a12b6a12619 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:39:59.575403 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-416f51fc-f232-4b63-ac3a-1a12b6a12619 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:39:59.576312 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-416f51fc-f232-4b63-ac3a-1a12b6a12619 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:39:59.576751 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-416f51fc-f232-4b63-ac3a-1a12b6a12619 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:39:59.785149 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-2072d12f-59ed-4f40-8040-09846084d60d tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dba436d0a67433f8c8ae7cd40d3f795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46b8dc64007429b805971d4c6f5b471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:39:59.788963 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-416f51fc-f232-4b63-ac3a-1a12b6a12619 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f4252210bd412ba24305b00a6e77b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a97e25e7eae402f8f5c4222019ed87c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:39:59.792636 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-2072d12f-59ed-4f40-8040-09846084d60d tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] 10.222.0.66 "GET /compute/v2.1/servers/9307fdad-ca63-449d-bc5c-7e9e167c59f3" status: 200 len: 1361 microversion: 2.1 time: 0.234338 Aug 04 03:39:59.793226 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 78/151] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:39:59 2022] GET /compute/v2.1/servers/9307fdad-ca63-449d-bc5c-7e9e167c59f3 => generated 1361 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:39:59.797005 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-416f51fc-f232-4b63-ac3a-1a12b6a12619 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] 10.222.0.66 "GET /compute/v2.1/servers/f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e" status: 200 len: 1313 microversion: 2.1 time: 0.235778 Aug 04 03:39:59.797584 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 74/152] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:39:59 2022] GET /compute/v2.1/servers/f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e => generated 1313 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:39:59.797700 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-02168e30-6f80-4a3b-8df8-236de56fb90a tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:39:59.798216 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-02168e30-6f80-4a3b-8df8-236de56fb90a tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] [instance: 60273216-f2ed-46cf-8836-1d85335d8920] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:39:59.804483 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-02168e30-6f80-4a3b-8df8-236de56fb90a tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:39:59.804939 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-02168e30-6f80-4a3b-8df8-236de56fb90a tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:39:59.805730 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-02168e30-6f80-4a3b-8df8-236de56fb90a tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:39:59.806168 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-02168e30-6f80-4a3b-8df8-236de56fb90a tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:39:59.937553 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-02168e30-6f80-4a3b-8df8-236de56fb90a tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec8d131a9764028a096314a4ecd58f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9ff6952b014d0a9abb28dcf0b818b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:39:59.945171 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-02168e30-6f80-4a3b-8df8-236de56fb90a tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] 10.222.0.66 "GET /compute/v2.1/servers/60273216-f2ed-46cf-8836-1d85335d8920" status: 200 len: 1322 microversion: 2.1 time: 0.150995 Aug 04 03:39:59.945762 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 79/153] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:39:59 2022] GET /compute/v2.1/servers/60273216-f2ed-46cf-8836-1d85335d8920 => generated 1322 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:40:00.814060 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-4e0bc227-2623-40d5-b94d-1a2d68d88738 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:40:00.814957 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-4e0bc227-2623-40d5-b94d-1a2d68d88738 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] [instance: 9307fdad-ca63-449d-bc5c-7e9e167c59f3] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:40:00.818975 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-273112ee-386c-44eb-90bf-165687dd23fe tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:40:00.819767 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-273112ee-386c-44eb-90bf-165687dd23fe tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] [instance: f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:40:00.822073 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-4e0bc227-2623-40d5-b94d-1a2d68d88738 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:00.822734 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-4e0bc227-2623-40d5-b94d-1a2d68d88738 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:00.824028 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-4e0bc227-2623-40d5-b94d-1a2d68d88738 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:00.824929 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-4e0bc227-2623-40d5-b94d-1a2d68d88738 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:00.826447 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-273112ee-386c-44eb-90bf-165687dd23fe tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:00.826974 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-273112ee-386c-44eb-90bf-165687dd23fe tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:00.827835 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-273112ee-386c-44eb-90bf-165687dd23fe tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:00.828337 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-273112ee-386c-44eb-90bf-165687dd23fe tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:01.026909 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-273112ee-386c-44eb-90bf-165687dd23fe tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f4252210bd412ba24305b00a6e77b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a97e25e7eae402f8f5c4222019ed87c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:40:01.035546 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-273112ee-386c-44eb-90bf-165687dd23fe tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] 10.222.0.66 "GET /compute/v2.1/servers/f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e" status: 200 len: 1313 microversion: 2.1 time: 0.221066 Aug 04 03:40:01.036404 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 80/154] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:40:00 2022] GET /compute/v2.1/servers/f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e => generated 1313 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 03:40:01.041483 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-99126585-2152-4057-bf4a-304308273eaf tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:40:01.042083 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-99126585-2152-4057-bf4a-304308273eaf tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] [instance: 60273216-f2ed-46cf-8836-1d85335d8920] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:40:01.044330 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-4e0bc227-2623-40d5-b94d-1a2d68d88738 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dba436d0a67433f8c8ae7cd40d3f795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46b8dc64007429b805971d4c6f5b471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:40:01.048383 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-99126585-2152-4057-bf4a-304308273eaf tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:01.048996 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-99126585-2152-4057-bf4a-304308273eaf tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:01.049788 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-99126585-2152-4057-bf4a-304308273eaf tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:01.050220 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-99126585-2152-4057-bf4a-304308273eaf tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:01.054286 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-4e0bc227-2623-40d5-b94d-1a2d68d88738 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] 10.222.0.66 "GET /compute/v2.1/servers/9307fdad-ca63-449d-bc5c-7e9e167c59f3" status: 200 len: 1361 microversion: 2.1 time: 0.244479 Aug 04 03:40:01.054845 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 75/155] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:40:00 2022] GET /compute/v2.1/servers/9307fdad-ca63-449d-bc5c-7e9e167c59f3 => generated 1361 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 03:40:01.271626 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [req-ab9ca0e8-4123-4ffd-9c05-36a918a7454d req-857113c0-ec67-46fb-b2ea-41ed2e2d6117 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60273216-f2ed-46cf-8836-1d85335d8920", "name": "network-vif-plugged", "status": "completed", "tag": "6d9d0195-e01f-4042-aa96-3a5af9c8cf55"}]} {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 03:40:01.291066 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [req-ab9ca0e8-4123-4ffd-9c05-36a918a7454d req-857113c0-ec67-46fb-b2ea-41ed2e2d6117 service nova] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:01.291507 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [req-ab9ca0e8-4123-4ffd-9c05-36a918a7454d req-857113c0-ec67-46fb-b2ea-41ed2e2d6117 service nova] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:01.308689 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.compute.server_external_events [req-ab9ca0e8-4123-4ffd-9c05-36a918a7454d req-857113c0-ec67-46fb-b2ea-41ed2e2d6117 service nova] Creating event network-vif-plugged:6d9d0195-e01f-4042-aa96-3a5af9c8cf55 for instance 60273216-f2ed-46cf-8836-1d85335d8920 on hv-cinder-73306 Aug 04 03:40:01.315872 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [req-ab9ca0e8-4123-4ffd-9c05-36a918a7454d req-857113c0-ec67-46fb-b2ea-41ed2e2d6117 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053151 Aug 04 03:40:01.317144 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 76/156] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 03:40:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 03:40:01.370466 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-99126585-2152-4057-bf4a-304308273eaf tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec8d131a9764028a096314a4ecd58f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9ff6952b014d0a9abb28dcf0b818b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:40:01.389218 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-99126585-2152-4057-bf4a-304308273eaf tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] 10.222.0.66 "GET /compute/v2.1/servers/60273216-f2ed-46cf-8836-1d85335d8920" status: 200 len: 1322 microversion: 2.1 time: 0.351200 Aug 04 03:40:01.389802 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 81/157] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:40:01 2022] GET /compute/v2.1/servers/60273216-f2ed-46cf-8836-1d85335d8920 => generated 1322 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:40:02.064765 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-cf1c17c2-fac2-4692-95f2-206f16444041 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:40:02.068443 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-cf1c17c2-fac2-4692-95f2-206f16444041 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] [instance: f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:40:02.075797 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-131c7a9c-8699-4c04-95d4-635eaeebf17e tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:40:02.077028 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-131c7a9c-8699-4c04-95d4-635eaeebf17e tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] [instance: 9307fdad-ca63-449d-bc5c-7e9e167c59f3] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:40:02.092259 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-131c7a9c-8699-4c04-95d4-635eaeebf17e tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:02.092774 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-131c7a9c-8699-4c04-95d4-635eaeebf17e tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:02.093577 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-131c7a9c-8699-4c04-95d4-635eaeebf17e tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:02.094006 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-131c7a9c-8699-4c04-95d4-635eaeebf17e tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:02.095081 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-cf1c17c2-fac2-4692-95f2-206f16444041 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:02.095722 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-cf1c17c2-fac2-4692-95f2-206f16444041 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:02.096485 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-cf1c17c2-fac2-4692-95f2-206f16444041 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:02.097244 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-cf1c17c2-fac2-4692-95f2-206f16444041 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:02.313657 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-131c7a9c-8699-4c04-95d4-635eaeebf17e tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dba436d0a67433f8c8ae7cd40d3f795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46b8dc64007429b805971d4c6f5b471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:40:02.320048 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-cf1c17c2-fac2-4692-95f2-206f16444041 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f4252210bd412ba24305b00a6e77b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a97e25e7eae402f8f5c4222019ed87c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:40:02.326058 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-131c7a9c-8699-4c04-95d4-635eaeebf17e tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] 10.222.0.66 "GET /compute/v2.1/servers/9307fdad-ca63-449d-bc5c-7e9e167c59f3" status: 200 len: 1361 microversion: 2.1 time: 0.253072 Aug 04 03:40:02.326151 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 82/158] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:40:02 2022] GET /compute/v2.1/servers/9307fdad-ca63-449d-bc5c-7e9e167c59f3 => generated 1361 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:40:02.340422 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-cf1c17c2-fac2-4692-95f2-206f16444041 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] 10.222.0.66 "GET /compute/v2.1/servers/f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e" status: 200 len: 1313 microversion: 2.1 time: 0.285397 Aug 04 03:40:02.341013 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 77/159] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:40:02 2022] GET /compute/v2.1/servers/f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e => generated 1313 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 03:40:02.411172 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-b9416245-844a-4cd8-a807-66750ccd1456 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:40:02.411775 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-b9416245-844a-4cd8-a807-66750ccd1456 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] [instance: 60273216-f2ed-46cf-8836-1d85335d8920] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:40:02.417639 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-b9416245-844a-4cd8-a807-66750ccd1456 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:02.418079 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-b9416245-844a-4cd8-a807-66750ccd1456 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:02.418831 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-b9416245-844a-4cd8-a807-66750ccd1456 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:02.419256 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-b9416245-844a-4cd8-a807-66750ccd1456 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:02.558658 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-b9416245-844a-4cd8-a807-66750ccd1456 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec8d131a9764028a096314a4ecd58f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9ff6952b014d0a9abb28dcf0b818b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:40:02.569138 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-b9416245-844a-4cd8-a807-66750ccd1456 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] 10.222.0.66 "GET /compute/v2.1/servers/60273216-f2ed-46cf-8836-1d85335d8920" status: 200 len: 1322 microversion: 2.1 time: 0.161455 Aug 04 03:40:02.569794 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 83/160] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:40:02 2022] GET /compute/v2.1/servers/60273216-f2ed-46cf-8836-1d85335d8920 => generated 1322 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:40:03.346271 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-ec4b96b1-9e80-4b1f-a4da-c460dbe42f1a tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:40:03.346877 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-ec4b96b1-9e80-4b1f-a4da-c460dbe42f1a tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] [instance: 9307fdad-ca63-449d-bc5c-7e9e167c59f3] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:40:03.353682 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-ec4b96b1-9e80-4b1f-a4da-c460dbe42f1a tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:03.354168 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-ec4b96b1-9e80-4b1f-a4da-c460dbe42f1a tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:03.354935 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-ec4b96b1-9e80-4b1f-a4da-c460dbe42f1a tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:03.355419 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-ec4b96b1-9e80-4b1f-a4da-c460dbe42f1a tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:03.364535 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-a7ae5c93-7503-49c7-8870-b852fd965d25 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:40:03.365858 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-a7ae5c93-7503-49c7-8870-b852fd965d25 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] [instance: f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:40:03.372882 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-a7ae5c93-7503-49c7-8870-b852fd965d25 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:03.373446 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-a7ae5c93-7503-49c7-8870-b852fd965d25 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:03.374270 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-a7ae5c93-7503-49c7-8870-b852fd965d25 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:03.374926 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-a7ae5c93-7503-49c7-8870-b852fd965d25 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:03.592328 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-ec4b96b1-9e80-4b1f-a4da-c460dbe42f1a tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dba436d0a67433f8c8ae7cd40d3f795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46b8dc64007429b805971d4c6f5b471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:40:03.596309 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-a7ae5c93-7503-49c7-8870-b852fd965d25 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f4252210bd412ba24305b00a6e77b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a97e25e7eae402f8f5c4222019ed87c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:40:03.600554 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-ec4b96b1-9e80-4b1f-a4da-c460dbe42f1a tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] 10.222.0.66 "GET /compute/v2.1/servers/9307fdad-ca63-449d-bc5c-7e9e167c59f3" status: 200 len: 1361 microversion: 2.1 time: 0.258255 Aug 04 03:40:03.601246 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 78/161] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:40:03 2022] GET /compute/v2.1/servers/9307fdad-ca63-449d-bc5c-7e9e167c59f3 => generated 1361 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:40:03.603827 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-a7ae5c93-7503-49c7-8870-b852fd965d25 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] 10.222.0.66 "GET /compute/v2.1/servers/f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e" status: 200 len: 1313 microversion: 2.1 time: 0.247037 Aug 04 03:40:03.604620 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 84/162] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:40:03 2022] GET /compute/v2.1/servers/f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e => generated 1313 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 03:40:03.608651 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-432f6748-fec9-413a-a7d3-599a2894b384 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:40:03.610362 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-432f6748-fec9-413a-a7d3-599a2894b384 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] [instance: 60273216-f2ed-46cf-8836-1d85335d8920] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:40:03.615862 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-432f6748-fec9-413a-a7d3-599a2894b384 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:03.616307 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-432f6748-fec9-413a-a7d3-599a2894b384 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:03.617095 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-432f6748-fec9-413a-a7d3-599a2894b384 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:03.617549 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-432f6748-fec9-413a-a7d3-599a2894b384 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:03.758433 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-432f6748-fec9-413a-a7d3-599a2894b384 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec8d131a9764028a096314a4ecd58f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9ff6952b014d0a9abb28dcf0b818b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:40:03.765862 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-432f6748-fec9-413a-a7d3-599a2894b384 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] 10.222.0.66 "GET /compute/v2.1/servers/60273216-f2ed-46cf-8836-1d85335d8920" status: 200 len: 1322 microversion: 2.1 time: 0.160834 Aug 04 03:40:03.766406 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 79/163] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:40:03 2022] GET /compute/v2.1/servers/60273216-f2ed-46cf-8836-1d85335d8920 => generated 1322 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:40:04.627556 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-5aba51bd-af07-4124-82ea-b8495bc1b630 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:40:04.628148 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-5aba51bd-af07-4124-82ea-b8495bc1b630 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] [instance: 9307fdad-ca63-449d-bc5c-7e9e167c59f3] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:40:04.633713 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-d61ad91f-4cc3-431e-abf1-3d730d04c3e9 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:40:04.634440 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-d61ad91f-4cc3-431e-abf1-3d730d04c3e9 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] [instance: f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:40:04.634674 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-5aba51bd-af07-4124-82ea-b8495bc1b630 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:04.635131 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-5aba51bd-af07-4124-82ea-b8495bc1b630 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:04.635901 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-5aba51bd-af07-4124-82ea-b8495bc1b630 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:04.636338 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-5aba51bd-af07-4124-82ea-b8495bc1b630 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:04.641107 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-d61ad91f-4cc3-431e-abf1-3d730d04c3e9 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:04.641503 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG dbcounter [-] [130263] Writing DB stats nova_cell1:SELECT=100 {{(pid=130263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:40:04.642185 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-d61ad91f-4cc3-431e-abf1-3d730d04c3e9 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:04.642950 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-d61ad91f-4cc3-431e-abf1-3d730d04c3e9 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:04.643383 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-d61ad91f-4cc3-431e-abf1-3d730d04c3e9 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:04.845050 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-5aba51bd-af07-4124-82ea-b8495bc1b630 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dba436d0a67433f8c8ae7cd40d3f795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46b8dc64007429b805971d4c6f5b471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:40:04.850072 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-d61ad91f-4cc3-431e-abf1-3d730d04c3e9 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f4252210bd412ba24305b00a6e77b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a97e25e7eae402f8f5c4222019ed87c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:40:04.853644 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-5aba51bd-af07-4124-82ea-b8495bc1b630 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] 10.222.0.66 "GET /compute/v2.1/servers/9307fdad-ca63-449d-bc5c-7e9e167c59f3" status: 200 len: 1361 microversion: 2.1 time: 0.229845 Aug 04 03:40:04.854213 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 85/164] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:40:04 2022] GET /compute/v2.1/servers/9307fdad-ca63-449d-bc5c-7e9e167c59f3 => generated 1361 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:40:04.858957 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-860889b7-aefb-42c4-8ff7-7d5a44e451eb tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:40:04.859565 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-860889b7-aefb-42c4-8ff7-7d5a44e451eb tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] [instance: 60273216-f2ed-46cf-8836-1d85335d8920] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:40:04.864834 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-d61ad91f-4cc3-431e-abf1-3d730d04c3e9 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] 10.222.0.66 "GET /compute/v2.1/servers/f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e" status: 200 len: 1313 microversion: 2.1 time: 0.235015 Aug 04 03:40:04.865743 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 80/165] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:40:04 2022] GET /compute/v2.1/servers/f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e => generated 1313 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:40:04.868354 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-860889b7-aefb-42c4-8ff7-7d5a44e451eb tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:04.868785 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-860889b7-aefb-42c4-8ff7-7d5a44e451eb tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:04.873092 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-860889b7-aefb-42c4-8ff7-7d5a44e451eb tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:04.873092 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-860889b7-aefb-42c4-8ff7-7d5a44e451eb tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:05.012882 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-860889b7-aefb-42c4-8ff7-7d5a44e451eb tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec8d131a9764028a096314a4ecd58f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9ff6952b014d0a9abb28dcf0b818b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:40:05.020422 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-860889b7-aefb-42c4-8ff7-7d5a44e451eb tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] 10.222.0.66 "GET /compute/v2.1/servers/60273216-f2ed-46cf-8836-1d85335d8920" status: 200 len: 1322 microversion: 2.1 time: 0.165061 Aug 04 03:40:05.020980 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 86/166] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:40:04 2022] GET /compute/v2.1/servers/60273216-f2ed-46cf-8836-1d85335d8920 => generated 1322 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:40:05.874548 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-17f0d096-c96f-428c-ac07-85fe0a8dd3ae tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:40:05.875187 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-17f0d096-c96f-428c-ac07-85fe0a8dd3ae tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] [instance: 9307fdad-ca63-449d-bc5c-7e9e167c59f3] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:40:05.881714 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-17f0d096-c96f-428c-ac07-85fe0a8dd3ae tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:05.882155 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-17f0d096-c96f-428c-ac07-85fe0a8dd3ae tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:05.882904 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-17f0d096-c96f-428c-ac07-85fe0a8dd3ae tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:05.883326 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-17f0d096-c96f-428c-ac07-85fe0a8dd3ae tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:05.886287 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-5ff10688-7f2b-45e1-8109-33af6d3e4ed2 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:40:05.886927 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-5ff10688-7f2b-45e1-8109-33af6d3e4ed2 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] [instance: f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:40:05.892893 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-5ff10688-7f2b-45e1-8109-33af6d3e4ed2 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:05.893383 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-5ff10688-7f2b-45e1-8109-33af6d3e4ed2 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:05.894712 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-5ff10688-7f2b-45e1-8109-33af6d3e4ed2 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:05.895807 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-5ff10688-7f2b-45e1-8109-33af6d3e4ed2 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:06.091284 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-17f0d096-c96f-428c-ac07-85fe0a8dd3ae tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dba436d0a67433f8c8ae7cd40d3f795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46b8dc64007429b805971d4c6f5b471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:40:06.099340 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-5ff10688-7f2b-45e1-8109-33af6d3e4ed2 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f4252210bd412ba24305b00a6e77b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a97e25e7eae402f8f5c4222019ed87c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:40:06.099948 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-17f0d096-c96f-428c-ac07-85fe0a8dd3ae tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] 10.222.0.66 "GET /compute/v2.1/servers/9307fdad-ca63-449d-bc5c-7e9e167c59f3" status: 200 len: 1361 microversion: 2.1 time: 0.229136 Aug 04 03:40:06.100830 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 81/167] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:40:05 2022] GET /compute/v2.1/servers/9307fdad-ca63-449d-bc5c-7e9e167c59f3 => generated 1361 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:40:06.105537 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-e1dfa556-063d-4063-8db5-642d95e8220a tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:40:06.106145 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-e1dfa556-063d-4063-8db5-642d95e8220a tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] [instance: 60273216-f2ed-46cf-8836-1d85335d8920] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:40:06.109380 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-5ff10688-7f2b-45e1-8109-33af6d3e4ed2 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] 10.222.0.66 "GET /compute/v2.1/servers/f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e" status: 200 len: 1313 microversion: 2.1 time: 0.227251 Aug 04 03:40:06.112651 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-e1dfa556-063d-4063-8db5-642d95e8220a tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:06.114360 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-e1dfa556-063d-4063-8db5-642d95e8220a tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:06.115286 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-e1dfa556-063d-4063-8db5-642d95e8220a tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:06.115853 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-e1dfa556-063d-4063-8db5-642d95e8220a tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:06.122509 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 87/168] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:40:05 2022] GET /compute/v2.1/servers/f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e => generated 1313 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 03:40:06.141774 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG dbcounter [-] [130262] Writing DB stats nova_cell1:SELECT=100 {{(pid=130262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:40:06.260974 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-e1dfa556-063d-4063-8db5-642d95e8220a tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec8d131a9764028a096314a4ecd58f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9ff6952b014d0a9abb28dcf0b818b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:40:06.268295 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-e1dfa556-063d-4063-8db5-642d95e8220a tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] 10.222.0.66 "GET /compute/v2.1/servers/60273216-f2ed-46cf-8836-1d85335d8920" status: 200 len: 1322 microversion: 2.1 time: 0.166481 Aug 04 03:40:06.268843 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 82/169] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:40:06 2022] GET /compute/v2.1/servers/60273216-f2ed-46cf-8836-1d85335d8920 => generated 1322 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:40:07.123208 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-77f4ca22-5058-49cc-bc0b-b26a7747c0a0 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:40:07.123888 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-77f4ca22-5058-49cc-bc0b-b26a7747c0a0 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] [instance: 9307fdad-ca63-449d-bc5c-7e9e167c59f3] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:40:07.130626 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-77f4ca22-5058-49cc-bc0b-b26a7747c0a0 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:07.131074 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-77f4ca22-5058-49cc-bc0b-b26a7747c0a0 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:07.131832 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-77f4ca22-5058-49cc-bc0b-b26a7747c0a0 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:07.132259 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-77f4ca22-5058-49cc-bc0b-b26a7747c0a0 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:07.132961 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-ad138963-d2b1-42da-a34b-8fbcd78a2725 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:40:07.134773 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-ad138963-d2b1-42da-a34b-8fbcd78a2725 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] [instance: f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:40:07.141131 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-ad138963-d2b1-42da-a34b-8fbcd78a2725 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:07.141771 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-ad138963-d2b1-42da-a34b-8fbcd78a2725 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:07.142573 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-ad138963-d2b1-42da-a34b-8fbcd78a2725 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:07.143005 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-ad138963-d2b1-42da-a34b-8fbcd78a2725 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:07.345047 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-ad138963-d2b1-42da-a34b-8fbcd78a2725 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f4252210bd412ba24305b00a6e77b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a97e25e7eae402f8f5c4222019ed87c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:40:07.353545 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-77f4ca22-5058-49cc-bc0b-b26a7747c0a0 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dba436d0a67433f8c8ae7cd40d3f795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46b8dc64007429b805971d4c6f5b471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:40:07.354072 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-ad138963-d2b1-42da-a34b-8fbcd78a2725 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] 10.222.0.66 "GET /compute/v2.1/servers/f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e" status: 200 len: 1313 microversion: 2.1 time: 0.225789 Aug 04 03:40:07.354746 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 83/170] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:40:07 2022] GET /compute/v2.1/servers/f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e => generated 1313 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 03:40:07.360154 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-8d9eebab-33b9-4d5f-a0bf-b06d8e9e0d3e tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:40:07.360929 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-8d9eebab-33b9-4d5f-a0bf-b06d8e9e0d3e tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] [instance: 60273216-f2ed-46cf-8836-1d85335d8920] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:40:07.368329 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-8d9eebab-33b9-4d5f-a0bf-b06d8e9e0d3e tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:07.368716 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-8d9eebab-33b9-4d5f-a0bf-b06d8e9e0d3e tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:07.369538 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-8d9eebab-33b9-4d5f-a0bf-b06d8e9e0d3e tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:07.370190 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-8d9eebab-33b9-4d5f-a0bf-b06d8e9e0d3e tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:07.371899 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-77f4ca22-5058-49cc-bc0b-b26a7747c0a0 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] 10.222.0.66 "GET /compute/v2.1/servers/9307fdad-ca63-449d-bc5c-7e9e167c59f3" status: 200 len: 1361 microversion: 2.1 time: 0.252050 Aug 04 03:40:07.385180 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 88/171] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:40:07 2022] GET /compute/v2.1/servers/9307fdad-ca63-449d-bc5c-7e9e167c59f3 => generated 1361 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:40:07.512982 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-8d9eebab-33b9-4d5f-a0bf-b06d8e9e0d3e tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec8d131a9764028a096314a4ecd58f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9ff6952b014d0a9abb28dcf0b818b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:40:07.520883 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-8d9eebab-33b9-4d5f-a0bf-b06d8e9e0d3e tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] 10.222.0.66 "GET /compute/v2.1/servers/60273216-f2ed-46cf-8836-1d85335d8920" status: 200 len: 1322 microversion: 2.1 time: 0.164980 Aug 04 03:40:07.521488 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 84/172] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:40:07 2022] GET /compute/v2.1/servers/60273216-f2ed-46cf-8836-1d85335d8920 => generated 1322 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:40:08.376641 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-6ace5f26-412b-45d4-88cf-356e0ea18ebe tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:40:08.377328 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-6ace5f26-412b-45d4-88cf-356e0ea18ebe tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] [instance: f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:40:08.384201 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-6ace5f26-412b-45d4-88cf-356e0ea18ebe tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:08.384730 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-6ace5f26-412b-45d4-88cf-356e0ea18ebe tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:08.385566 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-6ace5f26-412b-45d4-88cf-356e0ea18ebe tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:08.386011 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-6ace5f26-412b-45d4-88cf-356e0ea18ebe tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:08.395107 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-00888ad6-835b-4a5b-92cb-768809f97ecb tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:40:08.396038 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-00888ad6-835b-4a5b-92cb-768809f97ecb tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] [instance: 9307fdad-ca63-449d-bc5c-7e9e167c59f3] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:40:08.402882 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-00888ad6-835b-4a5b-92cb-768809f97ecb tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:08.403339 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-00888ad6-835b-4a5b-92cb-768809f97ecb tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:08.404178 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-00888ad6-835b-4a5b-92cb-768809f97ecb tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:08.404618 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-00888ad6-835b-4a5b-92cb-768809f97ecb tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:08.619453 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-6ace5f26-412b-45d4-88cf-356e0ea18ebe tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f4252210bd412ba24305b00a6e77b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a97e25e7eae402f8f5c4222019ed87c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:40:08.624677 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-00888ad6-835b-4a5b-92cb-768809f97ecb tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dba436d0a67433f8c8ae7cd40d3f795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46b8dc64007429b805971d4c6f5b471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:40:08.629799 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-6ace5f26-412b-45d4-88cf-356e0ea18ebe tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] 10.222.0.66 "GET /compute/v2.1/servers/f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e" status: 200 len: 1313 microversion: 2.1 time: 0.256336 Aug 04 03:40:08.631309 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 89/173] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:40:08 2022] GET /compute/v2.1/servers/f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e => generated 1313 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:40:08.634434 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-00888ad6-835b-4a5b-92cb-768809f97ecb tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] 10.222.0.66 "GET /compute/v2.1/servers/9307fdad-ca63-449d-bc5c-7e9e167c59f3" status: 200 len: 1361 microversion: 2.1 time: 0.244311 Aug 04 03:40:08.635524 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 85/174] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:40:08 2022] GET /compute/v2.1/servers/9307fdad-ca63-449d-bc5c-7e9e167c59f3 => generated 1361 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 03:40:08.635637 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-23096957-e3ef-4cf9-8867-9d150b4f4d66 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:40:08.636400 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-23096957-e3ef-4cf9-8867-9d150b4f4d66 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] [instance: 60273216-f2ed-46cf-8836-1d85335d8920] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:40:08.642922 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-23096957-e3ef-4cf9-8867-9d150b4f4d66 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:08.643583 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-23096957-e3ef-4cf9-8867-9d150b4f4d66 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:08.644963 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-23096957-e3ef-4cf9-8867-9d150b4f4d66 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:08.645742 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-23096957-e3ef-4cf9-8867-9d150b4f4d66 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:08.777295 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-23096957-e3ef-4cf9-8867-9d150b4f4d66 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec8d131a9764028a096314a4ecd58f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9ff6952b014d0a9abb28dcf0b818b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:40:08.786727 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-23096957-e3ef-4cf9-8867-9d150b4f4d66 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] 10.222.0.66 "GET /compute/v2.1/servers/60273216-f2ed-46cf-8836-1d85335d8920" status: 200 len: 1322 microversion: 2.1 time: 0.154908 Aug 04 03:40:08.787290 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 90/175] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:40:08 2022] GET /compute/v2.1/servers/60273216-f2ed-46cf-8836-1d85335d8920 => generated 1322 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:40:09.656270 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-4c074582-4351-425f-896e-c575dc860413 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:40:09.659374 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-0e886016-6076-4260-b759-040fcc59f0f3 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:40:09.662229 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-0e886016-6076-4260-b759-040fcc59f0f3 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] [instance: f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:40:09.662722 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-4c074582-4351-425f-896e-c575dc860413 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] [instance: 9307fdad-ca63-449d-bc5c-7e9e167c59f3] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:40:09.674538 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-0e886016-6076-4260-b759-040fcc59f0f3 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:09.677325 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-4c074582-4351-425f-896e-c575dc860413 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:09.677768 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-0e886016-6076-4260-b759-040fcc59f0f3 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:09.678623 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-0e886016-6076-4260-b759-040fcc59f0f3 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:09.679113 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-4c074582-4351-425f-896e-c575dc860413 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:09.679716 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-0e886016-6076-4260-b759-040fcc59f0f3 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:09.680705 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-4c074582-4351-425f-896e-c575dc860413 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:09.681144 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-4c074582-4351-425f-896e-c575dc860413 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:09.894870 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-0e886016-6076-4260-b759-040fcc59f0f3 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f4252210bd412ba24305b00a6e77b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a97e25e7eae402f8f5c4222019ed87c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:40:09.896893 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-4c074582-4351-425f-896e-c575dc860413 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dba436d0a67433f8c8ae7cd40d3f795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46b8dc64007429b805971d4c6f5b471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:40:09.903141 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-0e886016-6076-4260-b759-040fcc59f0f3 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] 10.222.0.66 "GET /compute/v2.1/servers/f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e" status: 200 len: 1313 microversion: 2.1 time: 0.254097 Aug 04 03:40:09.917155 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 86/176] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:40:09 2022] GET /compute/v2.1/servers/f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e => generated 1313 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:40:09.918036 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-4c074582-4351-425f-896e-c575dc860413 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] 10.222.0.66 "GET /compute/v2.1/servers/9307fdad-ca63-449d-bc5c-7e9e167c59f3" status: 200 len: 1361 microversion: 2.1 time: 0.253780 Aug 04 03:40:09.918142 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-d9a6e245-1ada-420b-89a9-af672786d28e tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:40:09.918142 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-d9a6e245-1ada-420b-89a9-af672786d28e tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] [instance: 60273216-f2ed-46cf-8836-1d85335d8920] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:40:09.918142 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-d9a6e245-1ada-420b-89a9-af672786d28e tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:09.918142 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-d9a6e245-1ada-420b-89a9-af672786d28e tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:09.918385 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-d9a6e245-1ada-420b-89a9-af672786d28e tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:09.918385 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-d9a6e245-1ada-420b-89a9-af672786d28e tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:09.918941 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 91/177] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:40:09 2022] GET /compute/v2.1/servers/9307fdad-ca63-449d-bc5c-7e9e167c59f3 => generated 1361 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:40:10.068144 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-d9a6e245-1ada-420b-89a9-af672786d28e tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec8d131a9764028a096314a4ecd58f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9ff6952b014d0a9abb28dcf0b818b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:40:10.080212 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-d9a6e245-1ada-420b-89a9-af672786d28e tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] 10.222.0.66 "GET /compute/v2.1/servers/60273216-f2ed-46cf-8836-1d85335d8920" status: 200 len: 1322 microversion: 2.1 time: 0.174611 Aug 04 03:40:10.080551 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 87/178] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:40:09 2022] GET /compute/v2.1/servers/60273216-f2ed-46cf-8836-1d85335d8920 => generated 1322 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:40:10.926470 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-2e4a2c5a-ba4b-4364-8346-60120b5adb58 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:40:10.927043 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-0c0c89fa-f8d2-4541-956f-ae29a7a94fc5 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:40:10.927394 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-2e4a2c5a-ba4b-4364-8346-60120b5adb58 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] [instance: 9307fdad-ca63-449d-bc5c-7e9e167c59f3] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:40:10.935344 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-0c0c89fa-f8d2-4541-956f-ae29a7a94fc5 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] [instance: f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:40:10.936625 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-2e4a2c5a-ba4b-4364-8346-60120b5adb58 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:10.937267 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-2e4a2c5a-ba4b-4364-8346-60120b5adb58 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:10.937949 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-0c0c89fa-f8d2-4541-956f-ae29a7a94fc5 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:10.938395 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-0c0c89fa-f8d2-4541-956f-ae29a7a94fc5 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:10.938597 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-2e4a2c5a-ba4b-4364-8346-60120b5adb58 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:10.939151 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-0c0c89fa-f8d2-4541-956f-ae29a7a94fc5 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:10.939575 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-0c0c89fa-f8d2-4541-956f-ae29a7a94fc5 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:10.939956 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-2e4a2c5a-ba4b-4364-8346-60120b5adb58 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:11.140764 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-0c0c89fa-f8d2-4541-956f-ae29a7a94fc5 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f4252210bd412ba24305b00a6e77b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a97e25e7eae402f8f5c4222019ed87c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:40:11.151913 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-2e4a2c5a-ba4b-4364-8346-60120b5adb58 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dba436d0a67433f8c8ae7cd40d3f795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46b8dc64007429b805971d4c6f5b471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:40:11.159706 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-2e4a2c5a-ba4b-4364-8346-60120b5adb58 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] 10.222.0.66 "GET /compute/v2.1/servers/9307fdad-ca63-449d-bc5c-7e9e167c59f3" status: 200 len: 1361 microversion: 2.1 time: 0.237639 Aug 04 03:40:11.160802 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 92/179] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:40:10 2022] GET /compute/v2.1/servers/9307fdad-ca63-449d-bc5c-7e9e167c59f3 => generated 1361 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:40:11.167373 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [req-243790ae-6441-44eb-823c-d16fb97f8148 req-f462ffe9-0c65-424e-a37e-09118ebf9fab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e", "name": "network-vif-plugged", "status": "completed", "tag": "5a965454-938f-4b0b-a81b-3e2875b1b5f6"}]} {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 03:40:11.174639 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-0c0c89fa-f8d2-4541-956f-ae29a7a94fc5 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] 10.222.0.66 "GET /compute/v2.1/servers/f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e" status: 200 len: 1313 microversion: 2.1 time: 0.238296 Aug 04 03:40:11.192012 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 88/180] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:40:10 2022] GET /compute/v2.1/servers/f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e => generated 1313 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:40:11.192795 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [req-243790ae-6441-44eb-823c-d16fb97f8148 req-f462ffe9-0c65-424e-a37e-09118ebf9fab service nova] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:11.192795 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [req-243790ae-6441-44eb-823c-d16fb97f8148 req-f462ffe9-0c65-424e-a37e-09118ebf9fab service nova] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:11.192966 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-ecaea743-324a-4b3c-a9fd-acaf18f5ae8c tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:40:11.192966 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-ecaea743-324a-4b3c-a9fd-acaf18f5ae8c tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] [instance: 60273216-f2ed-46cf-8836-1d85335d8920] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:40:11.193117 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-ecaea743-324a-4b3c-a9fd-acaf18f5ae8c tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:11.193549 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-ecaea743-324a-4b3c-a9fd-acaf18f5ae8c tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:11.194357 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-ecaea743-324a-4b3c-a9fd-acaf18f5ae8c tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:11.194944 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-ecaea743-324a-4b3c-a9fd-acaf18f5ae8c tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:11.197585 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.compute.server_external_events [req-243790ae-6441-44eb-823c-d16fb97f8148 req-f462ffe9-0c65-424e-a37e-09118ebf9fab service nova] Creating event network-vif-plugged:5a965454-938f-4b0b-a81b-3e2875b1b5f6 for instance f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e on hv-cinder-73306 Aug 04 03:40:11.203289 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [req-243790ae-6441-44eb-823c-d16fb97f8148 req-f462ffe9-0c65-424e-a37e-09118ebf9fab service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040970 Aug 04 03:40:11.204006 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 93/181] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 03:40:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 03:40:11.329751 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-ecaea743-324a-4b3c-a9fd-acaf18f5ae8c tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec8d131a9764028a096314a4ecd58f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9ff6952b014d0a9abb28dcf0b818b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:40:11.337451 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-ecaea743-324a-4b3c-a9fd-acaf18f5ae8c tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] 10.222.0.66 "GET /compute/v2.1/servers/60273216-f2ed-46cf-8836-1d85335d8920" status: 200 len: 1322 microversion: 2.1 time: 0.159701 Aug 04 03:40:11.338006 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 89/182] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:40:11 2022] GET /compute/v2.1/servers/60273216-f2ed-46cf-8836-1d85335d8920 => generated 1322 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:40:12.182667 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-645da941-4c40-4881-914e-05e896941f8d tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:40:12.183301 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-645da941-4c40-4881-914e-05e896941f8d tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] [instance: 9307fdad-ca63-449d-bc5c-7e9e167c59f3] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:40:12.185259 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG dbcounter [-] [130263] Writing DB stats nova_api:SELECT=79 {{(pid=130263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:40:12.190351 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-645da941-4c40-4881-914e-05e896941f8d tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:12.191473 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-645da941-4c40-4881-914e-05e896941f8d tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:12.192230 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-645da941-4c40-4881-914e-05e896941f8d tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:12.192667 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-645da941-4c40-4881-914e-05e896941f8d tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:12.200342 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-66792f1a-c99c-4909-8ef6-1f3fc4c27d27 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:40:12.201535 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-66792f1a-c99c-4909-8ef6-1f3fc4c27d27 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] [instance: f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:40:12.208157 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-66792f1a-c99c-4909-8ef6-1f3fc4c27d27 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:12.208604 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-66792f1a-c99c-4909-8ef6-1f3fc4c27d27 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:12.209551 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-66792f1a-c99c-4909-8ef6-1f3fc4c27d27 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:12.210140 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-66792f1a-c99c-4909-8ef6-1f3fc4c27d27 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:12.405756 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-66792f1a-c99c-4909-8ef6-1f3fc4c27d27 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f4252210bd412ba24305b00a6e77b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a97e25e7eae402f8f5c4222019ed87c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:40:12.410143 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-645da941-4c40-4881-914e-05e896941f8d tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dba436d0a67433f8c8ae7cd40d3f795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46b8dc64007429b805971d4c6f5b471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:40:12.413897 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-66792f1a-c99c-4909-8ef6-1f3fc4c27d27 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] 10.222.0.66 "GET /compute/v2.1/servers/f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e" status: 200 len: 1313 microversion: 2.1 time: 0.217712 Aug 04 03:40:12.417261 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 90/183] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:40:12 2022] GET /compute/v2.1/servers/f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e => generated 1313 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:40:12.419537 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-0d090117-9391-4862-8f05-32d2e4777ed5 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:40:12.419652 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-645da941-4c40-4881-914e-05e896941f8d tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] 10.222.0.66 "GET /compute/v2.1/servers/9307fdad-ca63-449d-bc5c-7e9e167c59f3" status: 200 len: 1361 microversion: 2.1 time: 0.241462 Aug 04 03:40:12.420145 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-0d090117-9391-4862-8f05-32d2e4777ed5 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] [instance: 60273216-f2ed-46cf-8836-1d85335d8920] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:40:12.420621 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 94/184] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:40:12 2022] GET /compute/v2.1/servers/9307fdad-ca63-449d-bc5c-7e9e167c59f3 => generated 1361 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:40:12.427798 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-0d090117-9391-4862-8f05-32d2e4777ed5 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:12.428530 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-0d090117-9391-4862-8f05-32d2e4777ed5 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:12.429332 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-0d090117-9391-4862-8f05-32d2e4777ed5 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:12.429769 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-0d090117-9391-4862-8f05-32d2e4777ed5 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:12.563283 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-0d090117-9391-4862-8f05-32d2e4777ed5 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec8d131a9764028a096314a4ecd58f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9ff6952b014d0a9abb28dcf0b818b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:40:12.570545 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-0d090117-9391-4862-8f05-32d2e4777ed5 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] 10.222.0.66 "GET /compute/v2.1/servers/60273216-f2ed-46cf-8836-1d85335d8920" status: 200 len: 1322 microversion: 2.1 time: 0.154708 Aug 04 03:40:12.571102 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 91/185] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:40:12 2022] GET /compute/v2.1/servers/60273216-f2ed-46cf-8836-1d85335d8920 => generated 1322 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:40:13.436083 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-920eb064-80c0-49d0-912a-e464e8ceaff0 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:40:13.437327 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-920eb064-80c0-49d0-912a-e464e8ceaff0 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] [instance: f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:40:13.439546 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-b3e293ca-7ef1-452e-bf56-583f078d5c6a tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:40:13.440684 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-b3e293ca-7ef1-452e-bf56-583f078d5c6a tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] [instance: 9307fdad-ca63-449d-bc5c-7e9e167c59f3] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:40:13.443790 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG dbcounter [-] [130262] Writing DB stats nova_api:SELECT=76 {{(pid=130262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:40:13.444513 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-920eb064-80c0-49d0-912a-e464e8ceaff0 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:13.444991 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-920eb064-80c0-49d0-912a-e464e8ceaff0 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:13.445790 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-920eb064-80c0-49d0-912a-e464e8ceaff0 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:13.446608 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-920eb064-80c0-49d0-912a-e464e8ceaff0 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:13.449949 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-b3e293ca-7ef1-452e-bf56-583f078d5c6a tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:13.449949 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-b3e293ca-7ef1-452e-bf56-583f078d5c6a tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:13.449949 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-b3e293ca-7ef1-452e-bf56-583f078d5c6a tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:13.449949 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-b3e293ca-7ef1-452e-bf56-583f078d5c6a tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:13.641973 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-b3e293ca-7ef1-452e-bf56-583f078d5c6a tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dba436d0a67433f8c8ae7cd40d3f795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46b8dc64007429b805971d4c6f5b471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:40:13.646179 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-920eb064-80c0-49d0-912a-e464e8ceaff0 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f4252210bd412ba24305b00a6e77b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a97e25e7eae402f8f5c4222019ed87c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:40:13.651022 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-b3e293ca-7ef1-452e-bf56-583f078d5c6a tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] 10.222.0.66 "GET /compute/v2.1/servers/9307fdad-ca63-449d-bc5c-7e9e167c59f3" status: 200 len: 1361 microversion: 2.1 time: 0.215099 Aug 04 03:40:13.654409 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 92/186] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:40:13 2022] GET /compute/v2.1/servers/9307fdad-ca63-449d-bc5c-7e9e167c59f3 => generated 1361 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 03:40:13.654568 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-920eb064-80c0-49d0-912a-e464e8ceaff0 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] 10.222.0.66 "GET /compute/v2.1/servers/f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e" status: 200 len: 1313 microversion: 2.1 time: 0.221790 Aug 04 03:40:13.654568 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 95/187] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:40:13 2022] GET /compute/v2.1/servers/f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e => generated 1313 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:40:13.655932 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-4f7203ac-3912-4bcc-ac09-d09188ef7c10 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:40:13.656521 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-4f7203ac-3912-4bcc-ac09-d09188ef7c10 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] [instance: 60273216-f2ed-46cf-8836-1d85335d8920] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:40:13.669032 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-4f7203ac-3912-4bcc-ac09-d09188ef7c10 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:13.669530 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-4f7203ac-3912-4bcc-ac09-d09188ef7c10 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:13.670298 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-4f7203ac-3912-4bcc-ac09-d09188ef7c10 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:13.670740 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-4f7203ac-3912-4bcc-ac09-d09188ef7c10 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:13.809383 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-4f7203ac-3912-4bcc-ac09-d09188ef7c10 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec8d131a9764028a096314a4ecd58f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9ff6952b014d0a9abb28dcf0b818b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:40:13.817055 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-4f7203ac-3912-4bcc-ac09-d09188ef7c10 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] 10.222.0.66 "GET /compute/v2.1/servers/60273216-f2ed-46cf-8836-1d85335d8920" status: 200 len: 1515 microversion: 2.1 time: 0.164488 Aug 04 03:40:13.818076 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 93/188] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:40:13 2022] GET /compute/v2.1/servers/60273216-f2ed-46cf-8836-1d85335d8920 => generated 1515 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:40:13.838896 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-6f0e5183-6221-4e18-bc7b-9d8ed8c80b97 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 03:40:13.841250 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-6f0e5183-6221-4e18-bc7b-9d8ed8c80b97 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] [instance: 60273216-f2ed-46cf-8836-1d85335d8920] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:40:13.847945 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-6f0e5183-6221-4e18-bc7b-9d8ed8c80b97 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:13.848462 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-6f0e5183-6221-4e18-bc7b-9d8ed8c80b97 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:13.849254 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-6f0e5183-6221-4e18-bc7b-9d8ed8c80b97 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:13.849743 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-6f0e5183-6221-4e18-bc7b-9d8ed8c80b97 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:13.913194 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.objects.instance [None req-6f0e5183-6221-4e18-bc7b-9d8ed8c80b97 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lazy-loading 'flavor' on Instance uuid 60273216-f2ed-46cf-8836-1d85335d8920 {{(pid=130263) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 03:40:14.286575 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-6f0e5183-6221-4e18-bc7b-9d8ed8c80b97 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] 10.222.0.66 "POST /compute/v2.1/servers/60273216-f2ed-46cf-8836-1d85335d8920/action" status: 200 len: 32 microversion: 2.1 time: 0.451676 Aug 04 03:40:14.287185 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 96/189] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 03:40:13 2022] POST /compute/v2.1/servers/60273216-f2ed-46cf-8836-1d85335d8920/action => generated 32 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 03:40:14.296269 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-79df3204-18a4-402f-87f8-806f7805ffe7 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:40:14.296928 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-79df3204-18a4-402f-87f8-806f7805ffe7 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] [instance: 60273216-f2ed-46cf-8836-1d85335d8920] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:40:14.303848 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-79df3204-18a4-402f-87f8-806f7805ffe7 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:14.304293 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-79df3204-18a4-402f-87f8-806f7805ffe7 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:14.306599 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-79df3204-18a4-402f-87f8-806f7805ffe7 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:14.306599 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-79df3204-18a4-402f-87f8-806f7805ffe7 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:14.446264 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-79df3204-18a4-402f-87f8-806f7805ffe7 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec8d131a9764028a096314a4ecd58f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9ff6952b014d0a9abb28dcf0b818b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:40:14.453917 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-79df3204-18a4-402f-87f8-806f7805ffe7 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] 10.222.0.66 "GET /compute/v2.1/servers/60273216-f2ed-46cf-8836-1d85335d8920" status: 200 len: 1521 microversion: 2.1 time: 0.161393 Aug 04 03:40:14.454476 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 94/190] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:40:14 2022] GET /compute/v2.1/servers/60273216-f2ed-46cf-8836-1d85335d8920 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:40:14.674501 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-70ef1ca5-24bf-45a8-8a69-22afea66d54d tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:40:14.675107 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-b8f6d3ab-5e89-4c90-997e-b7213b48c1e6 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:40:14.676094 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-b8f6d3ab-5e89-4c90-997e-b7213b48c1e6 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] [instance: f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:40:14.676656 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-70ef1ca5-24bf-45a8-8a69-22afea66d54d tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] [instance: 9307fdad-ca63-449d-bc5c-7e9e167c59f3] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:40:14.682863 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-b8f6d3ab-5e89-4c90-997e-b7213b48c1e6 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:14.683231 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-b8f6d3ab-5e89-4c90-997e-b7213b48c1e6 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:14.683984 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-b8f6d3ab-5e89-4c90-997e-b7213b48c1e6 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:14.684408 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-b8f6d3ab-5e89-4c90-997e-b7213b48c1e6 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:14.684553 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-70ef1ca5-24bf-45a8-8a69-22afea66d54d tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:14.685011 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-70ef1ca5-24bf-45a8-8a69-22afea66d54d tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:14.685819 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-70ef1ca5-24bf-45a8-8a69-22afea66d54d tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:14.686262 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-70ef1ca5-24bf-45a8-8a69-22afea66d54d tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:14.877009 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-b8f6d3ab-5e89-4c90-997e-b7213b48c1e6 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f4252210bd412ba24305b00a6e77b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a97e25e7eae402f8f5c4222019ed87c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:40:14.881261 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-70ef1ca5-24bf-45a8-8a69-22afea66d54d tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dba436d0a67433f8c8ae7cd40d3f795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46b8dc64007429b805971d4c6f5b471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:40:14.884614 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-b8f6d3ab-5e89-4c90-997e-b7213b48c1e6 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] 10.222.0.66 "GET /compute/v2.1/servers/f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e" status: 200 len: 1313 microversion: 2.1 time: 0.213841 Aug 04 03:40:14.885407 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 95/191] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:40:14 2022] GET /compute/v2.1/servers/f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e => generated 1313 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 03:40:14.888920 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-70ef1ca5-24bf-45a8-8a69-22afea66d54d tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] 10.222.0.66 "GET /compute/v2.1/servers/9307fdad-ca63-449d-bc5c-7e9e167c59f3" status: 200 len: 1361 microversion: 2.1 time: 0.218702 Aug 04 03:40:14.889628 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 97/192] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:40:14 2022] GET /compute/v2.1/servers/9307fdad-ca63-449d-bc5c-7e9e167c59f3 => generated 1361 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:40:15.473682 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-d31fff85-5f24-4f6a-aad1-1f97127b5a83 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:40:15.474288 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-d31fff85-5f24-4f6a-aad1-1f97127b5a83 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] [instance: 60273216-f2ed-46cf-8836-1d85335d8920] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:40:15.480181 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-d31fff85-5f24-4f6a-aad1-1f97127b5a83 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:15.480620 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-d31fff85-5f24-4f6a-aad1-1f97127b5a83 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:15.481400 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-d31fff85-5f24-4f6a-aad1-1f97127b5a83 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:15.481857 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-d31fff85-5f24-4f6a-aad1-1f97127b5a83 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:15.611034 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-d31fff85-5f24-4f6a-aad1-1f97127b5a83 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec8d131a9764028a096314a4ecd58f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9ff6952b014d0a9abb28dcf0b818b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:40:15.619244 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-d31fff85-5f24-4f6a-aad1-1f97127b5a83 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] 10.222.0.66 "GET /compute/v2.1/servers/60273216-f2ed-46cf-8836-1d85335d8920" status: 200 len: 1521 microversion: 2.1 time: 0.149911 Aug 04 03:40:15.619799 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 96/193] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:40:15 2022] GET /compute/v2.1/servers/60273216-f2ed-46cf-8836-1d85335d8920 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:40:15.906850 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-47aa7f92-dc5e-414a-b8f6-bc341420377a tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:40:15.907586 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-47aa7f92-dc5e-414a-b8f6-bc341420377a tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] [instance: f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:40:15.910965 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-e43edd79-2f34-4eb3-88e3-010e1d0ab5e5 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:40:15.911592 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-e43edd79-2f34-4eb3-88e3-010e1d0ab5e5 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] [instance: 9307fdad-ca63-449d-bc5c-7e9e167c59f3] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:40:15.914372 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-47aa7f92-dc5e-414a-b8f6-bc341420377a tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:15.914823 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-47aa7f92-dc5e-414a-b8f6-bc341420377a tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:15.915582 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-47aa7f92-dc5e-414a-b8f6-bc341420377a tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:15.916018 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-47aa7f92-dc5e-414a-b8f6-bc341420377a tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:15.917414 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-e43edd79-2f34-4eb3-88e3-010e1d0ab5e5 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:15.917860 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-e43edd79-2f34-4eb3-88e3-010e1d0ab5e5 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:15.918607 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-e43edd79-2f34-4eb3-88e3-010e1d0ab5e5 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:15.919038 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-e43edd79-2f34-4eb3-88e3-010e1d0ab5e5 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:16.111093 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-47aa7f92-dc5e-414a-b8f6-bc341420377a tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f4252210bd412ba24305b00a6e77b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a97e25e7eae402f8f5c4222019ed87c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:40:16.208058 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-e43edd79-2f34-4eb3-88e3-010e1d0ab5e5 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dba436d0a67433f8c8ae7cd40d3f795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46b8dc64007429b805971d4c6f5b471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:40:16.208288 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-47aa7f92-dc5e-414a-b8f6-bc341420377a tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] 10.222.0.66 "GET /compute/v2.1/servers/f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e" status: 200 len: 1313 microversion: 2.1 time: 0.216596 Aug 04 03:40:16.208288 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 98/194] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:40:15 2022] GET /compute/v2.1/servers/f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e => generated 1313 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:40:16.208607 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-e43edd79-2f34-4eb3-88e3-010e1d0ab5e5 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] 10.222.0.66 "GET /compute/v2.1/servers/9307fdad-ca63-449d-bc5c-7e9e167c59f3" status: 200 len: 1361 microversion: 2.1 time: 0.216404 Aug 04 03:40:16.208607 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 97/195] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:40:15 2022] GET /compute/v2.1/servers/9307fdad-ca63-449d-bc5c-7e9e167c59f3 => generated 1361 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 03:40:16.639483 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-249f6445-bc3d-4433-b60b-cf806eb41674 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:40:16.641841 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-249f6445-bc3d-4433-b60b-cf806eb41674 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] [instance: 60273216-f2ed-46cf-8836-1d85335d8920] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:40:16.646587 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-249f6445-bc3d-4433-b60b-cf806eb41674 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:16.647031 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-249f6445-bc3d-4433-b60b-cf806eb41674 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:16.647773 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-249f6445-bc3d-4433-b60b-cf806eb41674 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:16.648199 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-249f6445-bc3d-4433-b60b-cf806eb41674 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:16.774348 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-249f6445-bc3d-4433-b60b-cf806eb41674 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec8d131a9764028a096314a4ecd58f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9ff6952b014d0a9abb28dcf0b818b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:40:16.781800 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-249f6445-bc3d-4433-b60b-cf806eb41674 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] 10.222.0.66 "GET /compute/v2.1/servers/60273216-f2ed-46cf-8836-1d85335d8920" status: 200 len: 1521 microversion: 2.1 time: 0.146085 Aug 04 03:40:16.782449 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 99/196] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:40:16 2022] GET /compute/v2.1/servers/60273216-f2ed-46cf-8836-1d85335d8920 => generated 1521 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:40:17.212819 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-f77341f2-fe38-441d-962a-e2c14b783a69 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:40:17.213590 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-f77341f2-fe38-441d-962a-e2c14b783a69 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] [instance: 9307fdad-ca63-449d-bc5c-7e9e167c59f3] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:40:17.220356 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-f77341f2-fe38-441d-962a-e2c14b783a69 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:17.220930 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-f77341f2-fe38-441d-962a-e2c14b783a69 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:17.221431 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-41795153-1d0c-4666-a275-8aedde7a591d tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:40:17.221877 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-f77341f2-fe38-441d-962a-e2c14b783a69 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:17.222325 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-f77341f2-fe38-441d-962a-e2c14b783a69 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:17.222532 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-41795153-1d0c-4666-a275-8aedde7a591d tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] [instance: f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:40:17.228359 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-41795153-1d0c-4666-a275-8aedde7a591d tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:17.228809 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-41795153-1d0c-4666-a275-8aedde7a591d tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:17.229577 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-41795153-1d0c-4666-a275-8aedde7a591d tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:17.230003 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-41795153-1d0c-4666-a275-8aedde7a591d tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:17.251837 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG dbcounter [-] [130263] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=130263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:40:17.590843 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-f77341f2-fe38-441d-962a-e2c14b783a69 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dba436d0a67433f8c8ae7cd40d3f795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46b8dc64007429b805971d4c6f5b471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:40:17.595163 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-41795153-1d0c-4666-a275-8aedde7a591d tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f4252210bd412ba24305b00a6e77b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a97e25e7eae402f8f5c4222019ed87c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:40:17.599307 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-f77341f2-fe38-441d-962a-e2c14b783a69 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] 10.222.0.66 "GET /compute/v2.1/servers/9307fdad-ca63-449d-bc5c-7e9e167c59f3" status: 200 len: 1361 microversion: 2.1 time: 0.390342 Aug 04 03:40:17.600356 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 98/197] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:40:17 2022] GET /compute/v2.1/servers/9307fdad-ca63-449d-bc5c-7e9e167c59f3 => generated 1361 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:40:17.604456 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-41795153-1d0c-4666-a275-8aedde7a591d tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] 10.222.0.66 "GET /compute/v2.1/servers/f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e" status: 200 len: 1313 microversion: 2.1 time: 0.386559 Aug 04 03:40:17.610006 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 100/198] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:40:17 2022] GET /compute/v2.1/servers/f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e => generated 1313 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:40:17.803255 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-62fd99bc-9457-4eef-a129-88209f994833 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:40:17.803793 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-62fd99bc-9457-4eef-a129-88209f994833 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] [instance: 60273216-f2ed-46cf-8836-1d85335d8920] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:40:17.809822 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-62fd99bc-9457-4eef-a129-88209f994833 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:17.810270 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-62fd99bc-9457-4eef-a129-88209f994833 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:17.811024 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-62fd99bc-9457-4eef-a129-88209f994833 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:17.811460 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-62fd99bc-9457-4eef-a129-88209f994833 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:17.815406 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG dbcounter [-] [130262] Writing DB stats nova_cell1:SELECT=100 {{(pid=130262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:40:17.939349 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-62fd99bc-9457-4eef-a129-88209f994833 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec8d131a9764028a096314a4ecd58f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9ff6952b014d0a9abb28dcf0b818b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:40:17.947426 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-62fd99bc-9457-4eef-a129-88209f994833 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] 10.222.0.66 "GET /compute/v2.1/servers/60273216-f2ed-46cf-8836-1d85335d8920" status: 200 len: 1521 microversion: 2.1 time: 0.148373 Aug 04 03:40:17.947974 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 99/199] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:40:17 2022] GET /compute/v2.1/servers/60273216-f2ed-46cf-8836-1d85335d8920 => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:40:18.621067 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-9827b4f8-0ca5-4d1e-8819-9a84a41080a7 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:40:18.621752 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-9827b4f8-0ca5-4d1e-8819-9a84a41080a7 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] [instance: 9307fdad-ca63-449d-bc5c-7e9e167c59f3] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:40:18.629101 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-9827b4f8-0ca5-4d1e-8819-9a84a41080a7 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:18.629980 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-9827b4f8-0ca5-4d1e-8819-9a84a41080a7 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:18.630768 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-9827b4f8-0ca5-4d1e-8819-9a84a41080a7 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:18.631178 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-9827b4f8-0ca5-4d1e-8819-9a84a41080a7 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:18.631307 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-879611c6-7af1-4cb8-b116-b59c75346887 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:40:18.631922 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-879611c6-7af1-4cb8-b116-b59c75346887 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] [instance: f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:40:18.642801 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-879611c6-7af1-4cb8-b116-b59c75346887 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:18.643381 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-879611c6-7af1-4cb8-b116-b59c75346887 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:18.644916 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-879611c6-7af1-4cb8-b116-b59c75346887 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:18.645645 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-879611c6-7af1-4cb8-b116-b59c75346887 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:18.830503 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-9827b4f8-0ca5-4d1e-8819-9a84a41080a7 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dba436d0a67433f8c8ae7cd40d3f795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46b8dc64007429b805971d4c6f5b471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:40:18.838176 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-879611c6-7af1-4cb8-b116-b59c75346887 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f4252210bd412ba24305b00a6e77b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a97e25e7eae402f8f5c4222019ed87c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:40:18.839139 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-9827b4f8-0ca5-4d1e-8819-9a84a41080a7 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] 10.222.0.66 "GET /compute/v2.1/servers/9307fdad-ca63-449d-bc5c-7e9e167c59f3" status: 200 len: 1361 microversion: 2.1 time: 0.221984 Aug 04 03:40:18.839798 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 101/200] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:40:18 2022] GET /compute/v2.1/servers/9307fdad-ca63-449d-bc5c-7e9e167c59f3 => generated 1361 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:40:18.845775 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-879611c6-7af1-4cb8-b116-b59c75346887 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] 10.222.0.66 "GET /compute/v2.1/servers/f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e" status: 200 len: 1313 microversion: 2.1 time: 0.218851 Aug 04 03:40:18.846315 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 100/201] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:40:18 2022] GET /compute/v2.1/servers/f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e => generated 1313 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 03:40:18.967967 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-51f9b230-5558-4137-9700-82e507b2318c tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:40:18.968580 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-51f9b230-5558-4137-9700-82e507b2318c tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] [instance: 60273216-f2ed-46cf-8836-1d85335d8920] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:40:18.975353 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-51f9b230-5558-4137-9700-82e507b2318c tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:18.975803 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-51f9b230-5558-4137-9700-82e507b2318c tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:18.976561 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-51f9b230-5558-4137-9700-82e507b2318c tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:18.976995 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-51f9b230-5558-4137-9700-82e507b2318c tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:19.106409 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-51f9b230-5558-4137-9700-82e507b2318c tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec8d131a9764028a096314a4ecd58f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9ff6952b014d0a9abb28dcf0b818b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:40:19.114363 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-51f9b230-5558-4137-9700-82e507b2318c tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] 10.222.0.66 "GET /compute/v2.1/servers/60273216-f2ed-46cf-8836-1d85335d8920" status: 200 len: 1521 microversion: 2.1 time: 0.150184 Aug 04 03:40:19.114945 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 102/202] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:40:18 2022] GET /compute/v2.1/servers/60273216-f2ed-46cf-8836-1d85335d8920 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:40:19.860491 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-9db386d4-70f3-4600-bf2d-c4aeca3becbf tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:40:19.861281 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-9db386d4-70f3-4600-bf2d-c4aeca3becbf tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] [instance: 9307fdad-ca63-449d-bc5c-7e9e167c59f3] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:40:19.867471 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-485f224c-bd44-40a1-b81f-7695d35cf200 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:40:19.868151 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-485f224c-bd44-40a1-b81f-7695d35cf200 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] [instance: f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:40:19.876325 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-485f224c-bd44-40a1-b81f-7695d35cf200 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:19.883707 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-485f224c-bd44-40a1-b81f-7695d35cf200 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:19.883707 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-485f224c-bd44-40a1-b81f-7695d35cf200 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:19.883707 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-485f224c-bd44-40a1-b81f-7695d35cf200 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:19.884650 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-9db386d4-70f3-4600-bf2d-c4aeca3becbf tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:19.885173 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-9db386d4-70f3-4600-bf2d-c4aeca3becbf tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:19.886129 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-9db386d4-70f3-4600-bf2d-c4aeca3becbf tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:19.886644 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-9db386d4-70f3-4600-bf2d-c4aeca3becbf tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:20.103168 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-9db386d4-70f3-4600-bf2d-c4aeca3becbf tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dba436d0a67433f8c8ae7cd40d3f795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46b8dc64007429b805971d4c6f5b471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:40:20.103794 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-485f224c-bd44-40a1-b81f-7695d35cf200 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f4252210bd412ba24305b00a6e77b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a97e25e7eae402f8f5c4222019ed87c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:40:20.108054 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-9db386d4-70f3-4600-bf2d-c4aeca3becbf tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] 10.222.0.66 "GET /compute/v2.1/servers/9307fdad-ca63-449d-bc5c-7e9e167c59f3" status: 200 len: 1361 microversion: 2.1 time: 0.251733 Aug 04 03:40:20.108680 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 101/203] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:40:19 2022] GET /compute/v2.1/servers/9307fdad-ca63-449d-bc5c-7e9e167c59f3 => generated 1361 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:40:20.113791 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [req-0a051a72-3deb-451c-9391-07c4db82245c req-54ee7d36-6b6e-458b-a9c0-47a4b3481a97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9307fdad-ca63-449d-bc5c-7e9e167c59f3", "name": "network-vif-plugged", "status": "completed", "tag": "6a5932d2-1cb7-42bc-974f-e0c47bff324c"}]} {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 03:40:20.124042 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [req-0a051a72-3deb-451c-9391-07c4db82245c req-54ee7d36-6b6e-458b-a9c0-47a4b3481a97 service nova] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:20.124196 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-485f224c-bd44-40a1-b81f-7695d35cf200 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] 10.222.0.66 "GET /compute/v2.1/servers/f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e" status: 200 len: 1313 microversion: 2.1 time: 0.260370 Aug 04 03:40:20.124490 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [req-0a051a72-3deb-451c-9391-07c4db82245c req-54ee7d36-6b6e-458b-a9c0-47a4b3481a97 service nova] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:20.124811 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 103/204] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:40:19 2022] GET /compute/v2.1/servers/f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e => generated 1313 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:40:20.139874 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-7ce5254c-829c-4e66-b923-0a3bbda3039e tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:40:20.147164 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.compute.server_external_events [req-0a051a72-3deb-451c-9391-07c4db82245c req-54ee7d36-6b6e-458b-a9c0-47a4b3481a97 service nova] Creating event network-vif-plugged:6a5932d2-1cb7-42bc-974f-e0c47bff324c for instance 9307fdad-ca63-449d-bc5c-7e9e167c59f3 on hv-cinder-73306 Aug 04 03:40:20.147301 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-7ce5254c-829c-4e66-b923-0a3bbda3039e tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] [instance: 60273216-f2ed-46cf-8836-1d85335d8920] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:40:20.152084 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [req-0a051a72-3deb-451c-9391-07c4db82245c req-54ee7d36-6b6e-458b-a9c0-47a4b3481a97 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042159 Aug 04 03:40:20.152898 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-7ce5254c-829c-4e66-b923-0a3bbda3039e tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:20.153400 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 102/205] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 03:40:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 03:40:20.153583 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-7ce5254c-829c-4e66-b923-0a3bbda3039e tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:20.154608 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-7ce5254c-829c-4e66-b923-0a3bbda3039e tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:20.155310 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-7ce5254c-829c-4e66-b923-0a3bbda3039e tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:20.312659 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-7ce5254c-829c-4e66-b923-0a3bbda3039e tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec8d131a9764028a096314a4ecd58f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9ff6952b014d0a9abb28dcf0b818b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:40:20.325338 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-7ce5254c-829c-4e66-b923-0a3bbda3039e tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] 10.222.0.66 "GET /compute/v2.1/servers/60273216-f2ed-46cf-8836-1d85335d8920" status: 200 len: 1521 microversion: 2.1 time: 0.187300 Aug 04 03:40:20.325338 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 104/206] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:40:20 2022] GET /compute/v2.1/servers/60273216-f2ed-46cf-8836-1d85335d8920 => generated 1521 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:40:21.128889 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-5f359c3f-5bf9-4f5f-84c0-2ecae7a8de52 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:40:21.129769 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-5f359c3f-5bf9-4f5f-84c0-2ecae7a8de52 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] [instance: 9307fdad-ca63-449d-bc5c-7e9e167c59f3] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:40:21.139205 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-5f359c3f-5bf9-4f5f-84c0-2ecae7a8de52 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:21.139656 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-5f359c3f-5bf9-4f5f-84c0-2ecae7a8de52 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:21.140466 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-5f359c3f-5bf9-4f5f-84c0-2ecae7a8de52 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:21.140913 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-5f359c3f-5bf9-4f5f-84c0-2ecae7a8de52 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:21.146522 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-d673ee91-69af-4531-bc78-4f0255ddbaa4 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:40:21.149384 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-d673ee91-69af-4531-bc78-4f0255ddbaa4 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] [instance: f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:40:21.161391 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-d673ee91-69af-4531-bc78-4f0255ddbaa4 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:21.161908 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-d673ee91-69af-4531-bc78-4f0255ddbaa4 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:21.162889 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-d673ee91-69af-4531-bc78-4f0255ddbaa4 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:21.163505 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-d673ee91-69af-4531-bc78-4f0255ddbaa4 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:21.434843 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-d673ee91-69af-4531-bc78-4f0255ddbaa4 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f4252210bd412ba24305b00a6e77b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a97e25e7eae402f8f5c4222019ed87c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:40:21.437621 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-5f359c3f-5bf9-4f5f-84c0-2ecae7a8de52 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dba436d0a67433f8c8ae7cd40d3f795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46b8dc64007429b805971d4c6f5b471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:40:21.443655 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-d673ee91-69af-4531-bc78-4f0255ddbaa4 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] 10.222.0.66 "GET /compute/v2.1/servers/f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e" status: 200 len: 1500 microversion: 2.1 time: 0.301611 Aug 04 03:40:21.445137 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 105/207] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:40:21 2022] GET /compute/v2.1/servers/f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e => generated 1500 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:40:21.451294 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-283ced33-ebf5-4c29-b6bc-7cf8af778eb2 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:40:21.452102 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-283ced33-ebf5-4c29-b6bc-7cf8af778eb2 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] [instance: 60273216-f2ed-46cf-8836-1d85335d8920] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:40:21.455463 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-5f359c3f-5bf9-4f5f-84c0-2ecae7a8de52 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] 10.222.0.66 "GET /compute/v2.1/servers/9307fdad-ca63-449d-bc5c-7e9e167c59f3" status: 200 len: 1361 microversion: 2.1 time: 0.331261 Aug 04 03:40:21.456015 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 103/208] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:40:21 2022] GET /compute/v2.1/servers/9307fdad-ca63-449d-bc5c-7e9e167c59f3 => generated 1361 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:40:21.459397 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-283ced33-ebf5-4c29-b6bc-7cf8af778eb2 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:21.460035 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-283ced33-ebf5-4c29-b6bc-7cf8af778eb2 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:21.460931 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-283ced33-ebf5-4c29-b6bc-7cf8af778eb2 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:21.461488 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-283ced33-ebf5-4c29-b6bc-7cf8af778eb2 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:21.687216 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-283ced33-ebf5-4c29-b6bc-7cf8af778eb2 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec8d131a9764028a096314a4ecd58f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9ff6952b014d0a9abb28dcf0b818b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:40:21.699838 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-283ced33-ebf5-4c29-b6bc-7cf8af778eb2 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] 10.222.0.66 "GET /compute/v2.1/servers/60273216-f2ed-46cf-8836-1d85335d8920" status: 200 len: 1521 microversion: 2.1 time: 0.253377 Aug 04 03:40:21.700935 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 106/209] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:40:21 2022] GET /compute/v2.1/servers/60273216-f2ed-46cf-8836-1d85335d8920 => generated 1521 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:40:22.476070 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-a43f1f91-6b64-4089-8420-f49732dd2d86 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:40:22.476716 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-a43f1f91-6b64-4089-8420-f49732dd2d86 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] [instance: 9307fdad-ca63-449d-bc5c-7e9e167c59f3] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:40:22.483072 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-a43f1f91-6b64-4089-8420-f49732dd2d86 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:22.483532 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-a43f1f91-6b64-4089-8420-f49732dd2d86 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:22.484299 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-a43f1f91-6b64-4089-8420-f49732dd2d86 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:22.484741 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-a43f1f91-6b64-4089-8420-f49732dd2d86 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:22.636163 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-a43f1f91-6b64-4089-8420-f49732dd2d86 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dba436d0a67433f8c8ae7cd40d3f795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46b8dc64007429b805971d4c6f5b471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:40:22.644177 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-a43f1f91-6b64-4089-8420-f49732dd2d86 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] 10.222.0.66 "GET /compute/v2.1/servers/9307fdad-ca63-449d-bc5c-7e9e167c59f3" status: 200 len: 1361 microversion: 2.1 time: 0.171376 Aug 04 03:40:22.646978 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 104/210] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:40:22 2022] GET /compute/v2.1/servers/9307fdad-ca63-449d-bc5c-7e9e167c59f3 => generated 1361 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:40:22.729610 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-eb853611-6130-485b-a1bc-aa1a5ba33ce4 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:40:22.730249 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-eb853611-6130-485b-a1bc-aa1a5ba33ce4 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] [instance: 60273216-f2ed-46cf-8836-1d85335d8920] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:40:22.736295 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-eb853611-6130-485b-a1bc-aa1a5ba33ce4 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:22.737005 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-eb853611-6130-485b-a1bc-aa1a5ba33ce4 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:22.737845 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-eb853611-6130-485b-a1bc-aa1a5ba33ce4 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:22.738278 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-eb853611-6130-485b-a1bc-aa1a5ba33ce4 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:22.878860 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-eb853611-6130-485b-a1bc-aa1a5ba33ce4 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec8d131a9764028a096314a4ecd58f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9ff6952b014d0a9abb28dcf0b818b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:40:22.887003 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-eb853611-6130-485b-a1bc-aa1a5ba33ce4 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] 10.222.0.66 "GET /compute/v2.1/servers/60273216-f2ed-46cf-8836-1d85335d8920" status: 200 len: 1521 microversion: 2.1 time: 0.161124 Aug 04 03:40:22.901230 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 107/211] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:40:22 2022] GET /compute/v2.1/servers/60273216-f2ed-46cf-8836-1d85335d8920 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:40:23.664310 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-72609efb-5281-4e1c-a95a-ca3d0d844dbd tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:40:23.664941 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-72609efb-5281-4e1c-a95a-ca3d0d844dbd tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] [instance: 9307fdad-ca63-449d-bc5c-7e9e167c59f3] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:40:23.671078 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-72609efb-5281-4e1c-a95a-ca3d0d844dbd tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:23.671567 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-72609efb-5281-4e1c-a95a-ca3d0d844dbd tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:23.672359 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-72609efb-5281-4e1c-a95a-ca3d0d844dbd tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:23.672789 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-72609efb-5281-4e1c-a95a-ca3d0d844dbd tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:23.829105 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-72609efb-5281-4e1c-a95a-ca3d0d844dbd tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dba436d0a67433f8c8ae7cd40d3f795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46b8dc64007429b805971d4c6f5b471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:40:23.842966 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-72609efb-5281-4e1c-a95a-ca3d0d844dbd tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] 10.222.0.66 "GET /compute/v2.1/servers/9307fdad-ca63-449d-bc5c-7e9e167c59f3" status: 200 len: 1361 microversion: 2.1 time: 0.182338 Aug 04 03:40:23.843519 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 105/212] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:40:23 2022] GET /compute/v2.1/servers/9307fdad-ca63-449d-bc5c-7e9e167c59f3 => generated 1361 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 03:40:23.910727 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-d9ff11f4-c76d-4ca6-b14e-d7fb52a8e56a tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:40:23.911337 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-d9ff11f4-c76d-4ca6-b14e-d7fb52a8e56a tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] [instance: 60273216-f2ed-46cf-8836-1d85335d8920] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:40:23.917903 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-d9ff11f4-c76d-4ca6-b14e-d7fb52a8e56a tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:23.917903 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-d9ff11f4-c76d-4ca6-b14e-d7fb52a8e56a tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:23.918539 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-d9ff11f4-c76d-4ca6-b14e-d7fb52a8e56a tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:23.918968 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-d9ff11f4-c76d-4ca6-b14e-d7fb52a8e56a tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:24.057916 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-d9ff11f4-c76d-4ca6-b14e-d7fb52a8e56a tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec8d131a9764028a096314a4ecd58f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9ff6952b014d0a9abb28dcf0b818b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:40:24.065412 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-d9ff11f4-c76d-4ca6-b14e-d7fb52a8e56a tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] 10.222.0.66 "GET /compute/v2.1/servers/60273216-f2ed-46cf-8836-1d85335d8920" status: 200 len: 1521 microversion: 2.1 time: 0.159432 Aug 04 03:40:24.066423 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 108/213] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:40:23 2022] GET /compute/v2.1/servers/60273216-f2ed-46cf-8836-1d85335d8920 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:40:24.864407 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-f53c8c3d-b057-4b97-8c57-66818d35b4a6 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:40:24.867455 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-f53c8c3d-b057-4b97-8c57-66818d35b4a6 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] [instance: 9307fdad-ca63-449d-bc5c-7e9e167c59f3] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:40:24.872668 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-f53c8c3d-b057-4b97-8c57-66818d35b4a6 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:24.873339 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-f53c8c3d-b057-4b97-8c57-66818d35b4a6 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:24.874258 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-f53c8c3d-b057-4b97-8c57-66818d35b4a6 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:24.874845 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-f53c8c3d-b057-4b97-8c57-66818d35b4a6 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:25.086494 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-1214d7ae-4e6e-428c-909d-4cf7d11a0e1e tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:40:25.087176 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-1214d7ae-4e6e-428c-909d-4cf7d11a0e1e tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] [instance: 60273216-f2ed-46cf-8836-1d85335d8920] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:40:25.093178 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-1214d7ae-4e6e-428c-909d-4cf7d11a0e1e tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:25.093655 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-1214d7ae-4e6e-428c-909d-4cf7d11a0e1e tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:25.094410 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-1214d7ae-4e6e-428c-909d-4cf7d11a0e1e tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:25.094845 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-1214d7ae-4e6e-428c-909d-4cf7d11a0e1e tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:25.099535 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-f53c8c3d-b057-4b97-8c57-66818d35b4a6 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dba436d0a67433f8c8ae7cd40d3f795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46b8dc64007429b805971d4c6f5b471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:40:25.107195 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-f53c8c3d-b057-4b97-8c57-66818d35b4a6 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] 10.222.0.66 "GET /compute/v2.1/servers/9307fdad-ca63-449d-bc5c-7e9e167c59f3" status: 200 len: 1361 microversion: 2.1 time: 0.247045 Aug 04 03:40:25.119212 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 106/214] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:40:24 2022] GET /compute/v2.1/servers/9307fdad-ca63-449d-bc5c-7e9e167c59f3 => generated 1361 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:40:25.332481 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-1214d7ae-4e6e-428c-909d-4cf7d11a0e1e tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec8d131a9764028a096314a4ecd58f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9ff6952b014d0a9abb28dcf0b818b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:40:25.340768 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-1214d7ae-4e6e-428c-909d-4cf7d11a0e1e tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] 10.222.0.66 "GET /compute/v2.1/servers/60273216-f2ed-46cf-8836-1d85335d8920" status: 200 len: 1521 microversion: 2.1 time: 0.257989 Aug 04 03:40:25.341597 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 109/215] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:40:25 2022] GET /compute/v2.1/servers/60273216-f2ed-46cf-8836-1d85335d8920 => generated 1521 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 03:40:26.131214 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-b4781ff1-d40f-4a95-a233-96f0be660165 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:40:26.132133 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-b4781ff1-d40f-4a95-a233-96f0be660165 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] [instance: 9307fdad-ca63-449d-bc5c-7e9e167c59f3] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:40:26.138446 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-b4781ff1-d40f-4a95-a233-96f0be660165 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:26.138996 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-b4781ff1-d40f-4a95-a233-96f0be660165 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:26.146257 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-b4781ff1-d40f-4a95-a233-96f0be660165 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:26.146257 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-b4781ff1-d40f-4a95-a233-96f0be660165 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:26.283636 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-b4781ff1-d40f-4a95-a233-96f0be660165 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dba436d0a67433f8c8ae7cd40d3f795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46b8dc64007429b805971d4c6f5b471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:40:26.291730 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-b4781ff1-d40f-4a95-a233-96f0be660165 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] 10.222.0.66 "GET /compute/v2.1/servers/9307fdad-ca63-449d-bc5c-7e9e167c59f3" status: 200 len: 1361 microversion: 2.1 time: 0.166001 Aug 04 03:40:26.305796 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 107/216] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:40:26 2022] GET /compute/v2.1/servers/9307fdad-ca63-449d-bc5c-7e9e167c59f3 => generated 1361 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:40:26.364580 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-7fe34819-8996-445d-afdb-0550ddfdcf9c tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:40:26.365285 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-7fe34819-8996-445d-afdb-0550ddfdcf9c tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] [instance: 60273216-f2ed-46cf-8836-1d85335d8920] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:40:26.375545 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-7fe34819-8996-445d-afdb-0550ddfdcf9c tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:26.375545 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-7fe34819-8996-445d-afdb-0550ddfdcf9c tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:26.375545 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-7fe34819-8996-445d-afdb-0550ddfdcf9c tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:26.375545 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-7fe34819-8996-445d-afdb-0550ddfdcf9c tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:26.520910 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-7fe34819-8996-445d-afdb-0550ddfdcf9c tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec8d131a9764028a096314a4ecd58f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9ff6952b014d0a9abb28dcf0b818b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:40:26.529457 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-7fe34819-8996-445d-afdb-0550ddfdcf9c tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] 10.222.0.66 "GET /compute/v2.1/servers/60273216-f2ed-46cf-8836-1d85335d8920" status: 200 len: 1521 microversion: 2.1 time: 0.169644 Aug 04 03:40:26.543473 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 110/217] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:40:26 2022] GET /compute/v2.1/servers/60273216-f2ed-46cf-8836-1d85335d8920 => generated 1521 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:40:27.311959 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-a142c016-e86d-4e7d-ba9c-65b1026a18cf tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:40:27.312592 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-a142c016-e86d-4e7d-ba9c-65b1026a18cf tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] [instance: 9307fdad-ca63-449d-bc5c-7e9e167c59f3] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:40:27.319565 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-a142c016-e86d-4e7d-ba9c-65b1026a18cf tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:27.322435 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-a142c016-e86d-4e7d-ba9c-65b1026a18cf tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:27.322435 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-a142c016-e86d-4e7d-ba9c-65b1026a18cf tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:27.322435 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-a142c016-e86d-4e7d-ba9c-65b1026a18cf tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:27.463526 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-a142c016-e86d-4e7d-ba9c-65b1026a18cf tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dba436d0a67433f8c8ae7cd40d3f795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46b8dc64007429b805971d4c6f5b471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:40:27.471386 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-a142c016-e86d-4e7d-ba9c-65b1026a18cf tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] 10.222.0.66 "GET /compute/v2.1/servers/9307fdad-ca63-449d-bc5c-7e9e167c59f3" status: 200 len: 1361 microversion: 2.1 time: 0.163239 Aug 04 03:40:27.472051 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 108/218] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:40:27 2022] GET /compute/v2.1/servers/9307fdad-ca63-449d-bc5c-7e9e167c59f3 => generated 1361 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:40:27.552036 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-fa189249-df6a-441f-8349-a1c82cd1a8a6 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:40:27.552801 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-fa189249-df6a-441f-8349-a1c82cd1a8a6 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] [instance: 60273216-f2ed-46cf-8836-1d85335d8920] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:40:27.558927 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-fa189249-df6a-441f-8349-a1c82cd1a8a6 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:27.559373 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-fa189249-df6a-441f-8349-a1c82cd1a8a6 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:27.560320 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-fa189249-df6a-441f-8349-a1c82cd1a8a6 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:27.560986 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-fa189249-df6a-441f-8349-a1c82cd1a8a6 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:27.705469 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-fa189249-df6a-441f-8349-a1c82cd1a8a6 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec8d131a9764028a096314a4ecd58f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9ff6952b014d0a9abb28dcf0b818b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:40:27.713731 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-fa189249-df6a-441f-8349-a1c82cd1a8a6 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] 10.222.0.66 "GET /compute/v2.1/servers/60273216-f2ed-46cf-8836-1d85335d8920" status: 200 len: 1521 microversion: 2.1 time: 0.166154 Aug 04 03:40:27.714303 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 111/219] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:40:27 2022] GET /compute/v2.1/servers/60273216-f2ed-46cf-8836-1d85335d8920 => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:40:28.493021 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-f84b4e87-bc85-45f0-862d-80ba5a02e0ac tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:40:28.493581 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-f84b4e87-bc85-45f0-862d-80ba5a02e0ac tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] [instance: 9307fdad-ca63-449d-bc5c-7e9e167c59f3] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:40:28.499476 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-f84b4e87-bc85-45f0-862d-80ba5a02e0ac tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:28.499939 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-f84b4e87-bc85-45f0-862d-80ba5a02e0ac tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:28.500693 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-f84b4e87-bc85-45f0-862d-80ba5a02e0ac tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:28.501130 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-f84b4e87-bc85-45f0-862d-80ba5a02e0ac tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:28.632722 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-f84b4e87-bc85-45f0-862d-80ba5a02e0ac tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dba436d0a67433f8c8ae7cd40d3f795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46b8dc64007429b805971d4c6f5b471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:40:28.640500 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-f84b4e87-bc85-45f0-862d-80ba5a02e0ac tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] 10.222.0.66 "GET /compute/v2.1/servers/9307fdad-ca63-449d-bc5c-7e9e167c59f3" status: 200 len: 1546 microversion: 2.1 time: 0.151367 Aug 04 03:40:28.641146 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 109/220] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:40:28 2022] GET /compute/v2.1/servers/9307fdad-ca63-449d-bc5c-7e9e167c59f3 => generated 1546 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:40:28.669218 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-6c646704-7bbe-4497-81dd-a709c472254e tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:40:28.669747 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-6c646704-7bbe-4497-81dd-a709c472254e tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] [instance: 9307fdad-ca63-449d-bc5c-7e9e167c59f3] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:40:28.676519 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-6c646704-7bbe-4497-81dd-a709c472254e tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:28.676968 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-6c646704-7bbe-4497-81dd-a709c472254e tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:28.677794 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-6c646704-7bbe-4497-81dd-a709c472254e tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:28.678232 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-6c646704-7bbe-4497-81dd-a709c472254e tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:28.734615 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-cf84ae83-5d26-469e-9bfb-f77e6eaa9649 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:40:28.735228 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-cf84ae83-5d26-469e-9bfb-f77e6eaa9649 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] [instance: 60273216-f2ed-46cf-8836-1d85335d8920] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:40:28.742061 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-cf84ae83-5d26-469e-9bfb-f77e6eaa9649 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:28.742746 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-cf84ae83-5d26-469e-9bfb-f77e6eaa9649 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:28.743588 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-cf84ae83-5d26-469e-9bfb-f77e6eaa9649 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:28.743963 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-cf84ae83-5d26-469e-9bfb-f77e6eaa9649 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:28.758885 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-6c646704-7bbe-4497-81dd-a709c472254e tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] 10.222.0.66 "GET /compute/v2.1/servers/9307fdad-ca63-449d-bc5c-7e9e167c59f3/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093895 Aug 04 03:40:28.759552 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 112/221] 10.222.0.66 () {58 vars in 1275 bytes} [Thu Aug 4 03:40:28 2022] GET /compute/v2.1/servers/9307fdad-ca63-449d-bc5c-7e9e167c59f3/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 03:40:28.876550 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-cf84ae83-5d26-469e-9bfb-f77e6eaa9649 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec8d131a9764028a096314a4ecd58f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9ff6952b014d0a9abb28dcf0b818b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:40:28.887397 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-cf84ae83-5d26-469e-9bfb-f77e6eaa9649 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] 10.222.0.66 "GET /compute/v2.1/servers/60273216-f2ed-46cf-8836-1d85335d8920" status: 200 len: 1521 microversion: 2.1 time: 0.156638 Aug 04 03:40:28.888363 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 110/222] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:40:28 2022] GET /compute/v2.1/servers/60273216-f2ed-46cf-8836-1d85335d8920 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 03:40:29.908059 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-179802f1-2d1f-49fb-a950-ae58ff55eb0c tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:40:29.908718 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-179802f1-2d1f-49fb-a950-ae58ff55eb0c tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] [instance: 60273216-f2ed-46cf-8836-1d85335d8920] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:40:29.914950 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-179802f1-2d1f-49fb-a950-ae58ff55eb0c tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:29.915394 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-179802f1-2d1f-49fb-a950-ae58ff55eb0c tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:29.916146 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-179802f1-2d1f-49fb-a950-ae58ff55eb0c tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:29.916574 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-179802f1-2d1f-49fb-a950-ae58ff55eb0c tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:30.062049 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-179802f1-2d1f-49fb-a950-ae58ff55eb0c tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec8d131a9764028a096314a4ecd58f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9ff6952b014d0a9abb28dcf0b818b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:40:30.070148 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-179802f1-2d1f-49fb-a950-ae58ff55eb0c tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] 10.222.0.66 "GET /compute/v2.1/servers/60273216-f2ed-46cf-8836-1d85335d8920" status: 200 len: 1521 microversion: 2.1 time: 0.166063 Aug 04 03:40:30.070712 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 113/223] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:40:29 2022] GET /compute/v2.1/servers/60273216-f2ed-46cf-8836-1d85335d8920 => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:40:30.170267 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [req-91d904ab-4079-4681-bddb-319b09e905c2 req-9a582039-ecb0-4259-a92a-3ad7c88e48c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9307fdad-ca63-449d-bc5c-7e9e167c59f3", "tag": "6a5932d2-1cb7-42bc-974f-e0c47bff324c"}]} {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 03:40:30.181178 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [req-91d904ab-4079-4681-bddb-319b09e905c2 req-9a582039-ecb0-4259-a92a-3ad7c88e48c7 service nova] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:30.181649 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [req-91d904ab-4079-4681-bddb-319b09e905c2 req-9a582039-ecb0-4259-a92a-3ad7c88e48c7 service nova] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:30.194874 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.compute.server_external_events [req-91d904ab-4079-4681-bddb-319b09e905c2 req-9a582039-ecb0-4259-a92a-3ad7c88e48c7 service nova] Creating event network-changed:6a5932d2-1cb7-42bc-974f-e0c47bff324c for instance 9307fdad-ca63-449d-bc5c-7e9e167c59f3 on hv-cinder-73306 Aug 04 03:40:30.200413 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [req-91d904ab-4079-4681-bddb-319b09e905c2 req-9a582039-ecb0-4259-a92a-3ad7c88e48c7 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033778 Aug 04 03:40:30.201032 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 111/224] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 03:40:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 03:40:31.091193 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-4121dbe3-4686-43c6-8b38-e5f5a2b31d2f tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:40:31.091869 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-4121dbe3-4686-43c6-8b38-e5f5a2b31d2f tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] [instance: 60273216-f2ed-46cf-8836-1d85335d8920] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:40:31.098923 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-4121dbe3-4686-43c6-8b38-e5f5a2b31d2f tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:31.104659 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-4121dbe3-4686-43c6-8b38-e5f5a2b31d2f tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:31.104659 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-4121dbe3-4686-43c6-8b38-e5f5a2b31d2f tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:31.104659 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-4121dbe3-4686-43c6-8b38-e5f5a2b31d2f tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:31.233558 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-4121dbe3-4686-43c6-8b38-e5f5a2b31d2f tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec8d131a9764028a096314a4ecd58f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9ff6952b014d0a9abb28dcf0b818b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:40:31.242542 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-4121dbe3-4686-43c6-8b38-e5f5a2b31d2f tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] 10.222.0.66 "GET /compute/v2.1/servers/60273216-f2ed-46cf-8836-1d85335d8920" status: 200 len: 1521 microversion: 2.1 time: 0.155063 Aug 04 03:40:31.243109 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 114/225] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:40:31 2022] GET /compute/v2.1/servers/60273216-f2ed-46cf-8836-1d85335d8920 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:40:32.264093 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-8fa41add-9be1-4210-80c5-f85cdab572c1 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:40:32.264812 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-8fa41add-9be1-4210-80c5-f85cdab572c1 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] [instance: 60273216-f2ed-46cf-8836-1d85335d8920] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:40:32.271267 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-8fa41add-9be1-4210-80c5-f85cdab572c1 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:32.271706 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-8fa41add-9be1-4210-80c5-f85cdab572c1 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:32.272451 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-8fa41add-9be1-4210-80c5-f85cdab572c1 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:32.272877 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-8fa41add-9be1-4210-80c5-f85cdab572c1 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:32.406473 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-8fa41add-9be1-4210-80c5-f85cdab572c1 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec8d131a9764028a096314a4ecd58f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9ff6952b014d0a9abb28dcf0b818b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:40:32.414029 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-8fa41add-9be1-4210-80c5-f85cdab572c1 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] 10.222.0.66 "GET /compute/v2.1/servers/60273216-f2ed-46cf-8836-1d85335d8920" status: 200 len: 1521 microversion: 2.1 time: 0.154210 Aug 04 03:40:32.414584 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 112/226] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:40:32 2022] GET /compute/v2.1/servers/60273216-f2ed-46cf-8836-1d85335d8920 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:40:33.434845 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-11713c5f-981c-4dbd-8564-589863f5ce00 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:40:33.435567 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-11713c5f-981c-4dbd-8564-589863f5ce00 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] [instance: 60273216-f2ed-46cf-8836-1d85335d8920] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:40:33.441894 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-11713c5f-981c-4dbd-8564-589863f5ce00 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:33.442418 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-11713c5f-981c-4dbd-8564-589863f5ce00 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:33.443254 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-11713c5f-981c-4dbd-8564-589863f5ce00 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:33.443760 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-11713c5f-981c-4dbd-8564-589863f5ce00 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:33.575736 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-11713c5f-981c-4dbd-8564-589863f5ce00 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec8d131a9764028a096314a4ecd58f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9ff6952b014d0a9abb28dcf0b818b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:40:33.583443 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-11713c5f-981c-4dbd-8564-589863f5ce00 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] 10.222.0.66 "GET /compute/v2.1/servers/60273216-f2ed-46cf-8836-1d85335d8920" status: 200 len: 1521 microversion: 2.1 time: 0.152575 Aug 04 03:40:33.583997 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 115/227] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:40:33 2022] GET /compute/v2.1/servers/60273216-f2ed-46cf-8836-1d85335d8920 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:40:34.603809 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-3ee5a578-53c8-40d9-915a-eb6999af5c71 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:40:34.604417 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-3ee5a578-53c8-40d9-915a-eb6999af5c71 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] [instance: 60273216-f2ed-46cf-8836-1d85335d8920] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:40:34.610639 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-3ee5a578-53c8-40d9-915a-eb6999af5c71 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:34.611082 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-3ee5a578-53c8-40d9-915a-eb6999af5c71 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:34.612730 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-3ee5a578-53c8-40d9-915a-eb6999af5c71 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:34.613470 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-3ee5a578-53c8-40d9-915a-eb6999af5c71 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:34.741048 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-3ee5a578-53c8-40d9-915a-eb6999af5c71 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec8d131a9764028a096314a4ecd58f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9ff6952b014d0a9abb28dcf0b818b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:40:34.748474 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-3ee5a578-53c8-40d9-915a-eb6999af5c71 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] 10.222.0.66 "GET /compute/v2.1/servers/60273216-f2ed-46cf-8836-1d85335d8920" status: 200 len: 1521 microversion: 2.1 time: 0.148576 Aug 04 03:40:34.749032 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 113/228] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:40:34 2022] GET /compute/v2.1/servers/60273216-f2ed-46cf-8836-1d85335d8920 => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:40:35.773786 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-f9f06abb-b106-4a9c-a446-9f1a1cdd9535 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:40:35.774300 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-f9f06abb-b106-4a9c-a446-9f1a1cdd9535 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] [instance: 60273216-f2ed-46cf-8836-1d85335d8920] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:40:35.780391 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-f9f06abb-b106-4a9c-a446-9f1a1cdd9535 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:35.780828 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-f9f06abb-b106-4a9c-a446-9f1a1cdd9535 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:35.781603 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-f9f06abb-b106-4a9c-a446-9f1a1cdd9535 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:35.782032 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-f9f06abb-b106-4a9c-a446-9f1a1cdd9535 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:35.913051 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-f9f06abb-b106-4a9c-a446-9f1a1cdd9535 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec8d131a9764028a096314a4ecd58f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9ff6952b014d0a9abb28dcf0b818b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:40:35.920890 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-f9f06abb-b106-4a9c-a446-9f1a1cdd9535 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] 10.222.0.66 "GET /compute/v2.1/servers/60273216-f2ed-46cf-8836-1d85335d8920" status: 200 len: 1521 microversion: 2.1 time: 0.154982 Aug 04 03:40:35.921612 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 116/229] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:40:35 2022] GET /compute/v2.1/servers/60273216-f2ed-46cf-8836-1d85335d8920 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:40:36.943199 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-e31c26d2-0d3c-4615-b0b3-020a8dc3acc3 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:40:36.943812 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-e31c26d2-0d3c-4615-b0b3-020a8dc3acc3 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] [instance: 60273216-f2ed-46cf-8836-1d85335d8920] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:40:36.950166 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-e31c26d2-0d3c-4615-b0b3-020a8dc3acc3 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:36.950614 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-e31c26d2-0d3c-4615-b0b3-020a8dc3acc3 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:36.951398 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-e31c26d2-0d3c-4615-b0b3-020a8dc3acc3 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:36.951852 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-e31c26d2-0d3c-4615-b0b3-020a8dc3acc3 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:37.078851 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-e31c26d2-0d3c-4615-b0b3-020a8dc3acc3 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec8d131a9764028a096314a4ecd58f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9ff6952b014d0a9abb28dcf0b818b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:40:37.086259 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-e31c26d2-0d3c-4615-b0b3-020a8dc3acc3 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] 10.222.0.66 "GET /compute/v2.1/servers/60273216-f2ed-46cf-8836-1d85335d8920" status: 200 len: 1521 microversion: 2.1 time: 0.147477 Aug 04 03:40:37.086815 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 114/230] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:40:36 2022] GET /compute/v2.1/servers/60273216-f2ed-46cf-8836-1d85335d8920 => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:40:38.107517 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-be166055-8d71-4729-9d0d-6cc569b50f6d tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:40:38.108111 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-be166055-8d71-4729-9d0d-6cc569b50f6d tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] [instance: 60273216-f2ed-46cf-8836-1d85335d8920] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:40:38.114712 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-be166055-8d71-4729-9d0d-6cc569b50f6d tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:38.115159 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-be166055-8d71-4729-9d0d-6cc569b50f6d tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:38.116019 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-be166055-8d71-4729-9d0d-6cc569b50f6d tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:38.116464 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-be166055-8d71-4729-9d0d-6cc569b50f6d tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:38.135143 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG dbcounter [-] [130263] Writing DB stats nova_cell1:SELECT=100 {{(pid=130263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:40:38.249501 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-be166055-8d71-4729-9d0d-6cc569b50f6d tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec8d131a9764028a096314a4ecd58f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9ff6952b014d0a9abb28dcf0b818b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:40:38.257500 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-be166055-8d71-4729-9d0d-6cc569b50f6d tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] 10.222.0.66 "GET /compute/v2.1/servers/60273216-f2ed-46cf-8836-1d85335d8920" status: 200 len: 1521 microversion: 2.1 time: 0.153967 Aug 04 03:40:38.258061 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 117/231] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:40:38 2022] GET /compute/v2.1/servers/60273216-f2ed-46cf-8836-1d85335d8920 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 03:40:39.278241 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-e405de2c-d70a-48b5-ad46-b503db9eae9d tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:40:39.278854 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-e405de2c-d70a-48b5-ad46-b503db9eae9d tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] [instance: 60273216-f2ed-46cf-8836-1d85335d8920] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:40:39.286213 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-e405de2c-d70a-48b5-ad46-b503db9eae9d tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:39.286656 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-e405de2c-d70a-48b5-ad46-b503db9eae9d tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:39.287409 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-e405de2c-d70a-48b5-ad46-b503db9eae9d tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:39.287837 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-e405de2c-d70a-48b5-ad46-b503db9eae9d tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:39.341700 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-3d2627a0-01bb-4b3c-b4ae-053342eabc72 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1edd878c-0e84-4e4d-a496-eddb17709192"}} {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 03:40:39.344359 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-3d2627a0-01bb-4b3c-b4ae-053342eabc72 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] [instance: f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:40:39.351117 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-3d2627a0-01bb-4b3c-b4ae-053342eabc72 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:39.351782 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-3d2627a0-01bb-4b3c-b4ae-053342eabc72 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:39.354165 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-3d2627a0-01bb-4b3c-b4ae-053342eabc72 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:39.354932 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-3d2627a0-01bb-4b3c-b4ae-053342eabc72 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:39.438555 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-e405de2c-d70a-48b5-ad46-b503db9eae9d tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec8d131a9764028a096314a4ecd58f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9ff6952b014d0a9abb28dcf0b818b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:40:39.448567 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-e405de2c-d70a-48b5-ad46-b503db9eae9d tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] 10.222.0.66 "GET /compute/v2.1/servers/60273216-f2ed-46cf-8836-1d85335d8920" status: 200 len: 1521 microversion: 2.1 time: 0.174485 Aug 04 03:40:39.449652 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 115/232] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:40:39 2022] GET /compute/v2.1/servers/60273216-f2ed-46cf-8836-1d85335d8920 => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:40:40.245007 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-3d2627a0-01bb-4b3c-b4ae-053342eabc72 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] 10.222.0.66 "POST /compute/v2.1/servers/f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.906953 Aug 04 03:40:40.245739 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 118/233] 10.222.0.66 () {60 vars in 1323 bytes} [Thu Aug 4 03:40:39 2022] POST /compute/v2.1/servers/f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e/os-volume_attachments => generated 194 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 03:40:40.469544 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-0e2ad527-efc8-4004-a835-a686d52a3f4d tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:40:40.470176 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-0e2ad527-efc8-4004-a835-a686d52a3f4d tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] [instance: 60273216-f2ed-46cf-8836-1d85335d8920] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:40:40.477088 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-0e2ad527-efc8-4004-a835-a686d52a3f4d tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:40.477703 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-0e2ad527-efc8-4004-a835-a686d52a3f4d tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:40.478479 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-0e2ad527-efc8-4004-a835-a686d52a3f4d tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:40.478916 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-0e2ad527-efc8-4004-a835-a686d52a3f4d tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:40.602337 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-b5562956-1646-402f-9a91-b5fed217642a tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-2144522063", "imageRef": "0208f4b3-1d2f-42e4-a9b4-528bf5066fe1", "flavorRef": "452", "networks": [{"uuid": "71d0df0b-f280-493e-a1c3-1aab04d8626d"}]}} {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 03:40:40.624743 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-0e2ad527-efc8-4004-a835-a686d52a3f4d tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec8d131a9764028a096314a4ecd58f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9ff6952b014d0a9abb28dcf0b818b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:40:40.638839 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-0e2ad527-efc8-4004-a835-a686d52a3f4d tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] 10.222.0.66 "GET /compute/v2.1/servers/60273216-f2ed-46cf-8836-1d85335d8920" status: 200 len: 1521 microversion: 2.1 time: 0.168666 Aug 04 03:40:40.638839 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 116/234] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:40:40 2022] GET /compute/v2.1/servers/60273216-f2ed-46cf-8836-1d85335d8920 => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:40:40.668993 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.network.neutron [None req-b5562956-1646-402f-9a91-b5fed217642a tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] validate_networks() for [('71d0df0b-f280-493e-a1c3-1aab04d8626d', None, None, None, None, None)] {{(pid=130263) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 03:40:41.050125 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.virt.hardware [None req-b5562956-1646-402f-9a91-b5fed217642a tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Flavor limits 0:0:0 {{(pid=130263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 03:40:41.050542 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.virt.hardware [None req-b5562956-1646-402f-9a91-b5fed217642a tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Image limits 0:0:0 {{(pid=130263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 03:40:41.053927 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.virt.hardware [None req-b5562956-1646-402f-9a91-b5fed217642a tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Flavor pref 0:0:0 {{(pid=130263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 03:40:41.053927 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.virt.hardware [None req-b5562956-1646-402f-9a91-b5fed217642a tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Image pref 0:0:0 {{(pid=130263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 03:40:41.053927 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.virt.hardware [None req-b5562956-1646-402f-9a91-b5fed217642a tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 03:40:41.060792 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-b5562956-1646-402f-9a91-b5fed217642a tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:41.061266 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-b5562956-1646-402f-9a91-b5fed217642a tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:41.062149 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-b5562956-1646-402f-9a91-b5fed217642a tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:41.062587 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-b5562956-1646-402f-9a91-b5fed217642a tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:41.079538 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.quota [None req-b5562956-1646-402f-9a91-b5fed217642a tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Getting quotas for project 1c4daab5960f4c98874faea2066b1909. Resources: {'instances', 'ram', 'cores'} {{(pid=130263) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 03:40:41.084303 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.quota [None req-b5562956-1646-402f-9a91-b5fed217642a tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Getting quotas for user d8a3eed3ee0b42f69948aced53729d6f and project 1c4daab5960f4c98874faea2066b1909. Resources: {'instances', 'ram', 'cores'} {{(pid=130263) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 03:40:41.099889 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-b5562956-1646-402f-9a91-b5fed217642a tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Going to run 1 instances... {{(pid=130263) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 03:40:41.099889 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-b5562956-1646-402f-9a91-b5fed217642a tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] [instance: a6df3631-d967-4c3f-bbf4-e7512466721d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0208f4b3-1d2f-42e4-a9b4-528bf5066fe1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130263) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 03:40:41.306772 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-b5562956-1646-402f-9a91-b5fed217642a tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.711029 Aug 04 03:40:41.309882 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 119/235] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 03:40:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 713 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 03:40:41.320132 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-9a5666eb-40bf-4642-9935-36ea2b0f128f tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:40:41.320761 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-9a5666eb-40bf-4642-9935-36ea2b0f128f tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] [instance: a6df3631-d967-4c3f-bbf4-e7512466721d] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:40:41.430137 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-9a5666eb-40bf-4642-9935-36ea2b0f128f tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8a3eed3ee0b42f69948aced53729d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4daab5960f4c98874faea2066b1909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:40:41.438875 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-9a5666eb-40bf-4642-9935-36ea2b0f128f tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] 10.222.0.66 "GET /compute/v2.1/servers/a6df3631-d967-4c3f-bbf4-e7512466721d" status: 200 len: 1214 microversion: 2.1 time: 0.124492 Aug 04 03:40:41.441037 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 117/236] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:40:41 2022] GET /compute/v2.1/servers/a6df3631-d967-4c3f-bbf4-e7512466721d => generated 1214 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:40:41.665057 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-de401347-8222-48e3-83c3-6e84e0b14898 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:40:41.665873 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-de401347-8222-48e3-83c3-6e84e0b14898 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] [instance: 60273216-f2ed-46cf-8836-1d85335d8920] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:40:41.673851 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-de401347-8222-48e3-83c3-6e84e0b14898 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:41.674159 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-de401347-8222-48e3-83c3-6e84e0b14898 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:41.677403 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-de401347-8222-48e3-83c3-6e84e0b14898 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:41.677403 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-de401347-8222-48e3-83c3-6e84e0b14898 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:41.880134 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-de401347-8222-48e3-83c3-6e84e0b14898 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec8d131a9764028a096314a4ecd58f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9ff6952b014d0a9abb28dcf0b818b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:40:41.888702 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-de401347-8222-48e3-83c3-6e84e0b14898 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] 10.222.0.66 "GET /compute/v2.1/servers/60273216-f2ed-46cf-8836-1d85335d8920" status: 200 len: 1521 microversion: 2.1 time: 0.227140 Aug 04 03:40:41.889574 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 120/237] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:40:41 2022] GET /compute/v2.1/servers/60273216-f2ed-46cf-8836-1d85335d8920 => generated 1521 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:40:42.464221 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-178ae02f-2d1b-44d9-8755-49598e97c608 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:40:42.466052 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-178ae02f-2d1b-44d9-8755-49598e97c608 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] [instance: a6df3631-d967-4c3f-bbf4-e7512466721d] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:40:42.474657 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-178ae02f-2d1b-44d9-8755-49598e97c608 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:42.475652 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-178ae02f-2d1b-44d9-8755-49598e97c608 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:42.476700 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-178ae02f-2d1b-44d9-8755-49598e97c608 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:42.477477 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-178ae02f-2d1b-44d9-8755-49598e97c608 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:42.483806 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG dbcounter [-] [130262] Writing DB stats nova_cell1:SELECT=100 {{(pid=130262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:40:42.584217 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-178ae02f-2d1b-44d9-8755-49598e97c608 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8a3eed3ee0b42f69948aced53729d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4daab5960f4c98874faea2066b1909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:40:42.595590 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-178ae02f-2d1b-44d9-8755-49598e97c608 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] 10.222.0.66 "GET /compute/v2.1/servers/a6df3631-d967-4c3f-bbf4-e7512466721d" status: 200 len: 1218 microversion: 2.1 time: 0.136684 Aug 04 03:40:42.598046 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 118/238] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:40:42 2022] GET /compute/v2.1/servers/a6df3631-d967-4c3f-bbf4-e7512466721d => generated 1218 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:40:42.920205 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-abdd4332-f866-47d4-9994-cf8cb3de6608 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:40:42.920205 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-abdd4332-f866-47d4-9994-cf8cb3de6608 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] [instance: 60273216-f2ed-46cf-8836-1d85335d8920] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:40:42.935658 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG dbcounter [-] [130263] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=3 {{(pid=130263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:40:42.946449 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-abdd4332-f866-47d4-9994-cf8cb3de6608 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:42.947489 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-abdd4332-f866-47d4-9994-cf8cb3de6608 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:42.949056 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-abdd4332-f866-47d4-9994-cf8cb3de6608 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:42.949909 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-abdd4332-f866-47d4-9994-cf8cb3de6608 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:43.157671 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-abdd4332-f866-47d4-9994-cf8cb3de6608 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec8d131a9764028a096314a4ecd58f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9ff6952b014d0a9abb28dcf0b818b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:40:43.168820 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-abdd4332-f866-47d4-9994-cf8cb3de6608 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] 10.222.0.66 "GET /compute/v2.1/servers/60273216-f2ed-46cf-8836-1d85335d8920" status: 200 len: 1521 microversion: 2.1 time: 0.256231 Aug 04 03:40:43.180571 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 121/239] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:40:42 2022] GET /compute/v2.1/servers/60273216-f2ed-46cf-8836-1d85335d8920 => generated 1521 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:40:43.619369 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-2df94f24-1c03-4c55-b3b9-bb4046af1af9 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:40:43.619369 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-2df94f24-1c03-4c55-b3b9-bb4046af1af9 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] [instance: a6df3631-d967-4c3f-bbf4-e7512466721d] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:40:43.621330 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG dbcounter [-] [130262] Writing DB stats nova_api:SELECT=56 {{(pid=130262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:40:43.634656 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-2df94f24-1c03-4c55-b3b9-bb4046af1af9 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:43.635855 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-2df94f24-1c03-4c55-b3b9-bb4046af1af9 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:43.636709 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-2df94f24-1c03-4c55-b3b9-bb4046af1af9 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:43.637333 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-2df94f24-1c03-4c55-b3b9-bb4046af1af9 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:43.794236 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-2df94f24-1c03-4c55-b3b9-bb4046af1af9 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8a3eed3ee0b42f69948aced53729d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4daab5960f4c98874faea2066b1909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:40:43.805097 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-2df94f24-1c03-4c55-b3b9-bb4046af1af9 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] 10.222.0.66 "GET /compute/v2.1/servers/a6df3631-d967-4c3f-bbf4-e7512466721d" status: 200 len: 1274 microversion: 2.1 time: 0.190733 Aug 04 03:40:43.809709 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 119/240] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:40:43 2022] GET /compute/v2.1/servers/a6df3631-d967-4c3f-bbf4-e7512466721d => generated 1274 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:40:44.188028 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-28cfcd0a-d814-4373-b274-dcc5c8f51b29 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:40:44.189358 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-28cfcd0a-d814-4373-b274-dcc5c8f51b29 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] [instance: 60273216-f2ed-46cf-8836-1d85335d8920] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:40:44.197262 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-28cfcd0a-d814-4373-b274-dcc5c8f51b29 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:44.197958 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-28cfcd0a-d814-4373-b274-dcc5c8f51b29 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:44.198760 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-28cfcd0a-d814-4373-b274-dcc5c8f51b29 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:44.199255 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-28cfcd0a-d814-4373-b274-dcc5c8f51b29 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:44.372069 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-28cfcd0a-d814-4373-b274-dcc5c8f51b29 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec8d131a9764028a096314a4ecd58f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9ff6952b014d0a9abb28dcf0b818b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:40:44.380600 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-28cfcd0a-d814-4373-b274-dcc5c8f51b29 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] 10.222.0.66 "GET /compute/v2.1/servers/60273216-f2ed-46cf-8836-1d85335d8920" status: 200 len: 1521 microversion: 2.1 time: 0.197061 Aug 04 03:40:44.381519 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 122/241] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:40:44 2022] GET /compute/v2.1/servers/60273216-f2ed-46cf-8836-1d85335d8920 => generated 1521 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:40:44.827465 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-e2741342-2c98-4aab-91df-e5f96ea87d52 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:40:44.828073 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-e2741342-2c98-4aab-91df-e5f96ea87d52 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] [instance: a6df3631-d967-4c3f-bbf4-e7512466721d] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:40:44.835925 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-e2741342-2c98-4aab-91df-e5f96ea87d52 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:44.839330 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-e2741342-2c98-4aab-91df-e5f96ea87d52 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:44.839330 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-e2741342-2c98-4aab-91df-e5f96ea87d52 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:44.839330 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-e2741342-2c98-4aab-91df-e5f96ea87d52 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:45.083100 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-e2741342-2c98-4aab-91df-e5f96ea87d52 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8a3eed3ee0b42f69948aced53729d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4daab5960f4c98874faea2066b1909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:40:45.092468 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-e2741342-2c98-4aab-91df-e5f96ea87d52 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] 10.222.0.66 "GET /compute/v2.1/servers/a6df3631-d967-4c3f-bbf4-e7512466721d" status: 200 len: 1314 microversion: 2.1 time: 0.268193 Aug 04 03:40:45.093753 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 120/242] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:40:44 2022] GET /compute/v2.1/servers/a6df3631-d967-4c3f-bbf4-e7512466721d => generated 1314 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:40:45.403894 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-b41fd609-5f6d-4f5b-8fea-a7889ab99492 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:40:45.407954 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-b41fd609-5f6d-4f5b-8fea-a7889ab99492 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] [instance: 60273216-f2ed-46cf-8836-1d85335d8920] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:40:45.414865 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-b41fd609-5f6d-4f5b-8fea-a7889ab99492 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:45.415369 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-b41fd609-5f6d-4f5b-8fea-a7889ab99492 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:45.416139 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-b41fd609-5f6d-4f5b-8fea-a7889ab99492 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:45.416556 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-b41fd609-5f6d-4f5b-8fea-a7889ab99492 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:45.639663 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-b41fd609-5f6d-4f5b-8fea-a7889ab99492 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec8d131a9764028a096314a4ecd58f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9ff6952b014d0a9abb28dcf0b818b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:40:45.645659 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-b41fd609-5f6d-4f5b-8fea-a7889ab99492 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] 10.222.0.66 "GET /compute/v2.1/servers/60273216-f2ed-46cf-8836-1d85335d8920" status: 200 len: 1521 microversion: 2.1 time: 0.245642 Aug 04 03:40:45.651253 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 123/243] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:40:45 2022] GET /compute/v2.1/servers/60273216-f2ed-46cf-8836-1d85335d8920 => generated 1521 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:40:45.804037 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [req-632d5ef3-3a16-45ad-a291-8dd8c37e9fbb req-1d41e52b-0c95-4ebe-b51a-0528193693f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a6df3631-d967-4c3f-bbf4-e7512466721d", "tag": "1d15fda8-15f0-45d4-abac-832a2d5e11df"}]} {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 03:40:45.819642 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [req-632d5ef3-3a16-45ad-a291-8dd8c37e9fbb req-1d41e52b-0c95-4ebe-b51a-0528193693f5 service nova] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:45.819642 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [req-632d5ef3-3a16-45ad-a291-8dd8c37e9fbb req-1d41e52b-0c95-4ebe-b51a-0528193693f5 service nova] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:45.827217 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.compute.server_external_events [req-632d5ef3-3a16-45ad-a291-8dd8c37e9fbb req-1d41e52b-0c95-4ebe-b51a-0528193693f5 service nova] Creating event network-changed:1d15fda8-15f0-45d4-abac-832a2d5e11df for instance a6df3631-d967-4c3f-bbf4-e7512466721d on hv-cinder-73306 Aug 04 03:40:45.832834 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [req-632d5ef3-3a16-45ad-a291-8dd8c37e9fbb req-1d41e52b-0c95-4ebe-b51a-0528193693f5 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032988 Aug 04 03:40:45.835009 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 121/244] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 03:40:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 03:40:46.115375 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-e4a63801-bdfb-4c38-85ac-b5aca1657f36 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:40:46.116282 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-e4a63801-bdfb-4c38-85ac-b5aca1657f36 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] [instance: a6df3631-d967-4c3f-bbf4-e7512466721d] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:40:46.125832 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-e4a63801-bdfb-4c38-85ac-b5aca1657f36 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:46.126284 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-e4a63801-bdfb-4c38-85ac-b5aca1657f36 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:46.127062 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-e4a63801-bdfb-4c38-85ac-b5aca1657f36 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:46.138483 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-e4a63801-bdfb-4c38-85ac-b5aca1657f36 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:46.345485 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-e4a63801-bdfb-4c38-85ac-b5aca1657f36 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8a3eed3ee0b42f69948aced53729d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4daab5960f4c98874faea2066b1909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:40:46.379308 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-e4a63801-bdfb-4c38-85ac-b5aca1657f36 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] 10.222.0.66 "GET /compute/v2.1/servers/a6df3631-d967-4c3f-bbf4-e7512466721d" status: 200 len: 1314 microversion: 2.1 time: 0.268793 Aug 04 03:40:46.382524 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 124/245] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:40:46 2022] GET /compute/v2.1/servers/a6df3631-d967-4c3f-bbf4-e7512466721d => generated 1314 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:40:46.674949 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-5bf218d4-18cd-47d9-8b7e-a834046c924b tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:40:46.676661 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-5bf218d4-18cd-47d9-8b7e-a834046c924b tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] [instance: 60273216-f2ed-46cf-8836-1d85335d8920] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:40:46.684122 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-5bf218d4-18cd-47d9-8b7e-a834046c924b tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:46.685143 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-5bf218d4-18cd-47d9-8b7e-a834046c924b tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:46.692772 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-5bf218d4-18cd-47d9-8b7e-a834046c924b tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:46.692772 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-5bf218d4-18cd-47d9-8b7e-a834046c924b tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:46.907193 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-5bf218d4-18cd-47d9-8b7e-a834046c924b tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec8d131a9764028a096314a4ecd58f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9ff6952b014d0a9abb28dcf0b818b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:40:46.931486 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-5bf218d4-18cd-47d9-8b7e-a834046c924b tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] 10.222.0.66 "GET /compute/v2.1/servers/60273216-f2ed-46cf-8836-1d85335d8920" status: 200 len: 1521 microversion: 2.1 time: 0.250213 Aug 04 03:40:46.932445 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 122/246] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:40:46 2022] GET /compute/v2.1/servers/60273216-f2ed-46cf-8836-1d85335d8920 => generated 1521 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:40:47.404235 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-2bcaf8da-c137-4c75-b0d6-dc1600f42c6e tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:40:47.404235 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-2bcaf8da-c137-4c75-b0d6-dc1600f42c6e tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] [instance: a6df3631-d967-4c3f-bbf4-e7512466721d] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:40:47.412001 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-2bcaf8da-c137-4c75-b0d6-dc1600f42c6e tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:47.412654 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-2bcaf8da-c137-4c75-b0d6-dc1600f42c6e tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:47.413512 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-2bcaf8da-c137-4c75-b0d6-dc1600f42c6e tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:47.414146 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-2bcaf8da-c137-4c75-b0d6-dc1600f42c6e tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:47.551196 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-2bcaf8da-c137-4c75-b0d6-dc1600f42c6e tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8a3eed3ee0b42f69948aced53729d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4daab5960f4c98874faea2066b1909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:40:47.559298 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-2bcaf8da-c137-4c75-b0d6-dc1600f42c6e tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] 10.222.0.66 "GET /compute/v2.1/servers/a6df3631-d967-4c3f-bbf4-e7512466721d" status: 200 len: 1314 microversion: 2.1 time: 0.160450 Aug 04 03:40:47.559874 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 125/247] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:40:47 2022] GET /compute/v2.1/servers/a6df3631-d967-4c3f-bbf4-e7512466721d => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:40:47.961630 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-7b496141-92f2-48d6-a5c8-ebf0f74904ef tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:40:47.962245 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-7b496141-92f2-48d6-a5c8-ebf0f74904ef tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] [instance: 60273216-f2ed-46cf-8836-1d85335d8920] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:40:47.968093 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-7b496141-92f2-48d6-a5c8-ebf0f74904ef tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:47.968537 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-7b496141-92f2-48d6-a5c8-ebf0f74904ef tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:47.969504 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-7b496141-92f2-48d6-a5c8-ebf0f74904ef tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:47.969936 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-7b496141-92f2-48d6-a5c8-ebf0f74904ef tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:48.123355 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-7b496141-92f2-48d6-a5c8-ebf0f74904ef tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec8d131a9764028a096314a4ecd58f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9ff6952b014d0a9abb28dcf0b818b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:40:48.131225 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-7b496141-92f2-48d6-a5c8-ebf0f74904ef tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] 10.222.0.66 "GET /compute/v2.1/servers/60273216-f2ed-46cf-8836-1d85335d8920" status: 200 len: 1521 microversion: 2.1 time: 0.173322 Aug 04 03:40:48.133247 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 123/248] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:40:47 2022] GET /compute/v2.1/servers/60273216-f2ed-46cf-8836-1d85335d8920 => generated 1521 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:40:48.579470 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-fcf70cad-8c7f-43d1-972d-6fbdb28ccaaa tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:40:48.580286 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-fcf70cad-8c7f-43d1-972d-6fbdb28ccaaa tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] [instance: a6df3631-d967-4c3f-bbf4-e7512466721d] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:40:48.587477 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-fcf70cad-8c7f-43d1-972d-6fbdb28ccaaa tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:48.587930 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-fcf70cad-8c7f-43d1-972d-6fbdb28ccaaa tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:48.588700 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-fcf70cad-8c7f-43d1-972d-6fbdb28ccaaa tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:48.589138 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-fcf70cad-8c7f-43d1-972d-6fbdb28ccaaa tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:48.726572 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-fcf70cad-8c7f-43d1-972d-6fbdb28ccaaa tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8a3eed3ee0b42f69948aced53729d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4daab5960f4c98874faea2066b1909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:40:48.734822 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-fcf70cad-8c7f-43d1-972d-6fbdb28ccaaa tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] 10.222.0.66 "GET /compute/v2.1/servers/a6df3631-d967-4c3f-bbf4-e7512466721d" status: 200 len: 1314 microversion: 2.1 time: 0.159118 Aug 04 03:40:48.735663 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 126/249] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:40:48 2022] GET /compute/v2.1/servers/a6df3631-d967-4c3f-bbf4-e7512466721d => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:40:49.155732 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-ef7bae04-e32b-4a4b-b911-ea39f1932f23 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:40:49.156454 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-ef7bae04-e32b-4a4b-b911-ea39f1932f23 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] [instance: 60273216-f2ed-46cf-8836-1d85335d8920] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:40:49.164772 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-ef7bae04-e32b-4a4b-b911-ea39f1932f23 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:49.165721 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-ef7bae04-e32b-4a4b-b911-ea39f1932f23 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:49.166659 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-ef7bae04-e32b-4a4b-b911-ea39f1932f23 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:49.167084 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-ef7bae04-e32b-4a4b-b911-ea39f1932f23 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:49.310404 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-ef7bae04-e32b-4a4b-b911-ea39f1932f23 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec8d131a9764028a096314a4ecd58f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9ff6952b014d0a9abb28dcf0b818b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:40:49.318627 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-ef7bae04-e32b-4a4b-b911-ea39f1932f23 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] 10.222.0.66 "GET /compute/v2.1/servers/60273216-f2ed-46cf-8836-1d85335d8920" status: 200 len: 1521 microversion: 2.1 time: 0.166755 Aug 04 03:40:49.319194 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 124/250] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:40:49 2022] GET /compute/v2.1/servers/60273216-f2ed-46cf-8836-1d85335d8920 => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:40:49.756027 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-445d56de-5dfc-4acd-ae8a-69fd0116f006 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:40:49.756565 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-445d56de-5dfc-4acd-ae8a-69fd0116f006 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] [instance: a6df3631-d967-4c3f-bbf4-e7512466721d] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:40:49.763090 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-445d56de-5dfc-4acd-ae8a-69fd0116f006 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:49.763533 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-445d56de-5dfc-4acd-ae8a-69fd0116f006 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:49.764279 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-445d56de-5dfc-4acd-ae8a-69fd0116f006 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:49.764710 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-445d56de-5dfc-4acd-ae8a-69fd0116f006 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:49.906651 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-445d56de-5dfc-4acd-ae8a-69fd0116f006 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8a3eed3ee0b42f69948aced53729d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4daab5960f4c98874faea2066b1909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:40:49.914164 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-445d56de-5dfc-4acd-ae8a-69fd0116f006 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] 10.222.0.66 "GET /compute/v2.1/servers/a6df3631-d967-4c3f-bbf4-e7512466721d" status: 200 len: 1314 microversion: 2.1 time: 0.161974 Aug 04 03:40:49.914730 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 127/251] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:40:49 2022] GET /compute/v2.1/servers/a6df3631-d967-4c3f-bbf4-e7512466721d => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:40:50.339860 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-535b0efd-4f3a-434f-8fbd-06529505db91 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:40:50.340564 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-535b0efd-4f3a-434f-8fbd-06529505db91 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] [instance: 60273216-f2ed-46cf-8836-1d85335d8920] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:40:50.347295 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-535b0efd-4f3a-434f-8fbd-06529505db91 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:50.347895 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-535b0efd-4f3a-434f-8fbd-06529505db91 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:50.348674 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-535b0efd-4f3a-434f-8fbd-06529505db91 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:50.349108 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-535b0efd-4f3a-434f-8fbd-06529505db91 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:50.547969 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-535b0efd-4f3a-434f-8fbd-06529505db91 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec8d131a9764028a096314a4ecd58f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9ff6952b014d0a9abb28dcf0b818b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:40:50.556642 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-535b0efd-4f3a-434f-8fbd-06529505db91 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] 10.222.0.66 "GET /compute/v2.1/servers/60273216-f2ed-46cf-8836-1d85335d8920" status: 200 len: 1521 microversion: 2.1 time: 0.220578 Aug 04 03:40:50.557136 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 125/252] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:40:50 2022] GET /compute/v2.1/servers/60273216-f2ed-46cf-8836-1d85335d8920 => generated 1521 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:40:50.934457 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-b2e06328-d625-442f-b239-d1aca4ad464c tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:40:50.935121 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-b2e06328-d625-442f-b239-d1aca4ad464c tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] [instance: a6df3631-d967-4c3f-bbf4-e7512466721d] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:40:50.942655 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-b2e06328-d625-442f-b239-d1aca4ad464c tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:50.943107 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-b2e06328-d625-442f-b239-d1aca4ad464c tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:50.943879 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-b2e06328-d625-442f-b239-d1aca4ad464c tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:50.944318 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-b2e06328-d625-442f-b239-d1aca4ad464c tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:51.070633 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG dbcounter [-] [130263] Writing DB stats nova_cell0:SELECT=2 {{(pid=130263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:40:51.082577 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-b2e06328-d625-442f-b239-d1aca4ad464c tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8a3eed3ee0b42f69948aced53729d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4daab5960f4c98874faea2066b1909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:40:51.090293 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-b2e06328-d625-442f-b239-d1aca4ad464c tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] 10.222.0.66 "GET /compute/v2.1/servers/a6df3631-d967-4c3f-bbf4-e7512466721d" status: 200 len: 1314 microversion: 2.1 time: 0.159579 Aug 04 03:40:51.090865 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 128/253] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:40:50 2022] GET /compute/v2.1/servers/a6df3631-d967-4c3f-bbf4-e7512466721d => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:40:51.577271 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-6fae0236-f867-4b3f-abf0-6cc8f5f80087 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:40:51.577921 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-6fae0236-f867-4b3f-abf0-6cc8f5f80087 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] [instance: 60273216-f2ed-46cf-8836-1d85335d8920] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:40:51.579780 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG dbcounter [-] [130262] Writing DB stats nova_cell0:SELECT=2 {{(pid=130262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:40:51.584924 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-6fae0236-f867-4b3f-abf0-6cc8f5f80087 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:51.585408 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-6fae0236-f867-4b3f-abf0-6cc8f5f80087 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:51.586432 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-6fae0236-f867-4b3f-abf0-6cc8f5f80087 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:51.586866 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-6fae0236-f867-4b3f-abf0-6cc8f5f80087 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:51.726002 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-6fae0236-f867-4b3f-abf0-6cc8f5f80087 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec8d131a9764028a096314a4ecd58f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9ff6952b014d0a9abb28dcf0b818b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:40:51.733544 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-6fae0236-f867-4b3f-abf0-6cc8f5f80087 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] 10.222.0.66 "GET /compute/v2.1/servers/60273216-f2ed-46cf-8836-1d85335d8920" status: 200 len: 1521 microversion: 2.1 time: 0.160054 Aug 04 03:40:51.734275 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 126/254] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:40:51 2022] GET /compute/v2.1/servers/60273216-f2ed-46cf-8836-1d85335d8920 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:40:52.112555 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-3f415b2e-1e22-45fd-bb95-36cd260a6218 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:40:52.113170 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-3f415b2e-1e22-45fd-bb95-36cd260a6218 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] [instance: a6df3631-d967-4c3f-bbf4-e7512466721d] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:40:52.115027 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG dbcounter [-] [130263] Writing DB stats nova_cell0:SELECT=6 {{(pid=130263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:40:52.120553 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-3f415b2e-1e22-45fd-bb95-36cd260a6218 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:52.121004 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-3f415b2e-1e22-45fd-bb95-36cd260a6218 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:52.121796 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-3f415b2e-1e22-45fd-bb95-36cd260a6218 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:52.122239 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-3f415b2e-1e22-45fd-bb95-36cd260a6218 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:52.257487 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-3f415b2e-1e22-45fd-bb95-36cd260a6218 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8a3eed3ee0b42f69948aced53729d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4daab5960f4c98874faea2066b1909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:40:52.265109 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-3f415b2e-1e22-45fd-bb95-36cd260a6218 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] 10.222.0.66 "GET /compute/v2.1/servers/a6df3631-d967-4c3f-bbf4-e7512466721d" status: 200 len: 1314 microversion: 2.1 time: 0.157241 Aug 04 03:40:52.265919 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 129/255] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:40:52 2022] GET /compute/v2.1/servers/a6df3631-d967-4c3f-bbf4-e7512466721d => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:40:52.756302 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-d2dd2590-584d-4e8a-8680-15dd962ed604 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:40:52.756916 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-d2dd2590-584d-4e8a-8680-15dd962ed604 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] [instance: 60273216-f2ed-46cf-8836-1d85335d8920] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:40:52.763014 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-d2dd2590-584d-4e8a-8680-15dd962ed604 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:52.763415 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-d2dd2590-584d-4e8a-8680-15dd962ed604 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:52.764200 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-d2dd2590-584d-4e8a-8680-15dd962ed604 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:52.764638 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-d2dd2590-584d-4e8a-8680-15dd962ed604 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:52.895255 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-d2dd2590-584d-4e8a-8680-15dd962ed604 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec8d131a9764028a096314a4ecd58f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9ff6952b014d0a9abb28dcf0b818b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:40:52.903511 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-d2dd2590-584d-4e8a-8680-15dd962ed604 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] 10.222.0.66 "GET /compute/v2.1/servers/60273216-f2ed-46cf-8836-1d85335d8920" status: 200 len: 1521 microversion: 2.1 time: 0.151521 Aug 04 03:40:52.904744 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 127/256] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:40:52 2022] GET /compute/v2.1/servers/60273216-f2ed-46cf-8836-1d85335d8920 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:40:53.287218 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-cd22eafc-3cdc-459c-92a5-77cad88b3719 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:40:53.287830 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-cd22eafc-3cdc-459c-92a5-77cad88b3719 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] [instance: a6df3631-d967-4c3f-bbf4-e7512466721d] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:40:53.294961 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-cd22eafc-3cdc-459c-92a5-77cad88b3719 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:53.295346 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-cd22eafc-3cdc-459c-92a5-77cad88b3719 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:53.296104 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-cd22eafc-3cdc-459c-92a5-77cad88b3719 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:53.296540 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-cd22eafc-3cdc-459c-92a5-77cad88b3719 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:53.427959 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-cd22eafc-3cdc-459c-92a5-77cad88b3719 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8a3eed3ee0b42f69948aced53729d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4daab5960f4c98874faea2066b1909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:40:53.435402 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-cd22eafc-3cdc-459c-92a5-77cad88b3719 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] 10.222.0.66 "GET /compute/v2.1/servers/a6df3631-d967-4c3f-bbf4-e7512466721d" status: 200 len: 1314 microversion: 2.1 time: 0.152740 Aug 04 03:40:53.435965 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 130/257] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:40:53 2022] GET /compute/v2.1/servers/a6df3631-d967-4c3f-bbf4-e7512466721d => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:40:53.926766 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-e46f7d96-a282-42c5-a21a-94c3ebcadb75 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:40:53.927379 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-e46f7d96-a282-42c5-a21a-94c3ebcadb75 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] [instance: 60273216-f2ed-46cf-8836-1d85335d8920] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:40:53.933697 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-e46f7d96-a282-42c5-a21a-94c3ebcadb75 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:53.934146 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-e46f7d96-a282-42c5-a21a-94c3ebcadb75 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:53.934925 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-e46f7d96-a282-42c5-a21a-94c3ebcadb75 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:53.935364 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-e46f7d96-a282-42c5-a21a-94c3ebcadb75 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:54.064423 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-e46f7d96-a282-42c5-a21a-94c3ebcadb75 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec8d131a9764028a096314a4ecd58f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9ff6952b014d0a9abb28dcf0b818b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:40:54.072876 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-e46f7d96-a282-42c5-a21a-94c3ebcadb75 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] 10.222.0.66 "GET /compute/v2.1/servers/60273216-f2ed-46cf-8836-1d85335d8920" status: 200 len: 1521 microversion: 2.1 time: 0.150108 Aug 04 03:40:54.073460 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 128/258] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:40:53 2022] GET /compute/v2.1/servers/60273216-f2ed-46cf-8836-1d85335d8920 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:40:54.455594 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-4e500ccf-045d-4c2f-81a3-b584481222e4 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:40:54.456306 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-4e500ccf-045d-4c2f-81a3-b584481222e4 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] [instance: a6df3631-d967-4c3f-bbf4-e7512466721d] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:40:54.462906 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-4e500ccf-045d-4c2f-81a3-b584481222e4 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:54.463359 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-4e500ccf-045d-4c2f-81a3-b584481222e4 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:54.464120 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-4e500ccf-045d-4c2f-81a3-b584481222e4 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:54.464557 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-4e500ccf-045d-4c2f-81a3-b584481222e4 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:54.605905 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-4e500ccf-045d-4c2f-81a3-b584481222e4 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8a3eed3ee0b42f69948aced53729d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4daab5960f4c98874faea2066b1909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:40:54.614860 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-4e500ccf-045d-4c2f-81a3-b584481222e4 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] 10.222.0.66 "GET /compute/v2.1/servers/a6df3631-d967-4c3f-bbf4-e7512466721d" status: 200 len: 1314 microversion: 2.1 time: 0.162945 Aug 04 03:40:54.615508 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 131/259] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:40:54 2022] GET /compute/v2.1/servers/a6df3631-d967-4c3f-bbf4-e7512466721d => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:40:55.092992 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-1065421f-a221-4964-8d36-60442373e4be tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:40:55.093650 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-1065421f-a221-4964-8d36-60442373e4be tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] [instance: 60273216-f2ed-46cf-8836-1d85335d8920] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:40:55.100291 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-1065421f-a221-4964-8d36-60442373e4be tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:55.102339 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-1065421f-a221-4964-8d36-60442373e4be tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:55.102339 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-1065421f-a221-4964-8d36-60442373e4be tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:55.102339 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-1065421f-a221-4964-8d36-60442373e4be tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:55.232523 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-1065421f-a221-4964-8d36-60442373e4be tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec8d131a9764028a096314a4ecd58f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9ff6952b014d0a9abb28dcf0b818b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:40:55.240720 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-1065421f-a221-4964-8d36-60442373e4be tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] 10.222.0.66 "GET /compute/v2.1/servers/60273216-f2ed-46cf-8836-1d85335d8920" status: 200 len: 1521 microversion: 2.1 time: 0.151504 Aug 04 03:40:55.241293 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 129/260] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:40:55 2022] GET /compute/v2.1/servers/60273216-f2ed-46cf-8836-1d85335d8920 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:40:55.637731 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-d97ac6e5-fd74-4375-a337-79f5d61620ef tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:40:55.637731 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-d97ac6e5-fd74-4375-a337-79f5d61620ef tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] [instance: a6df3631-d967-4c3f-bbf4-e7512466721d] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:40:55.642663 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-d97ac6e5-fd74-4375-a337-79f5d61620ef tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:55.643122 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-d97ac6e5-fd74-4375-a337-79f5d61620ef tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:55.643877 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-d97ac6e5-fd74-4375-a337-79f5d61620ef tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:55.644307 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-d97ac6e5-fd74-4375-a337-79f5d61620ef tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:55.782359 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-d97ac6e5-fd74-4375-a337-79f5d61620ef tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8a3eed3ee0b42f69948aced53729d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4daab5960f4c98874faea2066b1909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:40:55.789990 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-d97ac6e5-fd74-4375-a337-79f5d61620ef tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] 10.222.0.66 "GET /compute/v2.1/servers/a6df3631-d967-4c3f-bbf4-e7512466721d" status: 200 len: 1314 microversion: 2.1 time: 0.158228 Aug 04 03:40:55.790554 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 132/261] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:40:55 2022] GET /compute/v2.1/servers/a6df3631-d967-4c3f-bbf4-e7512466721d => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:40:56.261131 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-e5bc01d6-dcdd-426e-9f07-214021bff4d3 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:40:56.261768 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-e5bc01d6-dcdd-426e-9f07-214021bff4d3 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] [instance: 60273216-f2ed-46cf-8836-1d85335d8920] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:40:56.267652 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-e5bc01d6-dcdd-426e-9f07-214021bff4d3 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:56.268609 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-e5bc01d6-dcdd-426e-9f07-214021bff4d3 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:56.269467 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-e5bc01d6-dcdd-426e-9f07-214021bff4d3 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:56.269895 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-e5bc01d6-dcdd-426e-9f07-214021bff4d3 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:56.398954 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-e5bc01d6-dcdd-426e-9f07-214021bff4d3 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec8d131a9764028a096314a4ecd58f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9ff6952b014d0a9abb28dcf0b818b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:40:56.406486 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-e5bc01d6-dcdd-426e-9f07-214021bff4d3 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] 10.222.0.66 "GET /compute/v2.1/servers/60273216-f2ed-46cf-8836-1d85335d8920" status: 200 len: 1521 microversion: 2.1 time: 0.149206 Aug 04 03:40:56.407048 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 130/262] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:40:56 2022] GET /compute/v2.1/servers/60273216-f2ed-46cf-8836-1d85335d8920 => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:40:56.811080 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-0b1b251e-b652-4c4b-bed3-ee140cf0194e tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:40:56.811737 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-0b1b251e-b652-4c4b-bed3-ee140cf0194e tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] [instance: a6df3631-d967-4c3f-bbf4-e7512466721d] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:40:56.819102 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-0b1b251e-b652-4c4b-bed3-ee140cf0194e tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:56.819540 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-0b1b251e-b652-4c4b-bed3-ee140cf0194e tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:56.820383 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-0b1b251e-b652-4c4b-bed3-ee140cf0194e tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:56.820820 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-0b1b251e-b652-4c4b-bed3-ee140cf0194e tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:56.841013 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG dbcounter [-] [130263] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=130263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:40:56.872279 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [req-ec16f53d-ea3a-4c32-8586-701102d2297d req-2ea701ef-1181-4640-a6d1-3c655c8b55d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6df3631-d967-4c3f-bbf4-e7512466721d", "name": "network-vif-plugged", "status": "completed", "tag": "1d15fda8-15f0-45d4-abac-832a2d5e11df"}]} {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 03:40:56.885822 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [req-ec16f53d-ea3a-4c32-8586-701102d2297d req-2ea701ef-1181-4640-a6d1-3c655c8b55d0 service nova] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:56.886263 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [req-ec16f53d-ea3a-4c32-8586-701102d2297d req-2ea701ef-1181-4640-a6d1-3c655c8b55d0 service nova] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:56.899641 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.compute.server_external_events [req-ec16f53d-ea3a-4c32-8586-701102d2297d req-2ea701ef-1181-4640-a6d1-3c655c8b55d0 service nova] Creating event network-vif-plugged:1d15fda8-15f0-45d4-abac-832a2d5e11df for instance a6df3631-d967-4c3f-bbf4-e7512466721d on hv-cinder-73306 Aug 04 03:40:56.905109 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [req-ec16f53d-ea3a-4c32-8586-701102d2297d req-2ea701ef-1181-4640-a6d1-3c655c8b55d0 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036599 Aug 04 03:40:56.905833 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 131/263] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 03:40:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 03:40:57.006517 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-0b1b251e-b652-4c4b-bed3-ee140cf0194e tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8a3eed3ee0b42f69948aced53729d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4daab5960f4c98874faea2066b1909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:40:57.021483 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-0b1b251e-b652-4c4b-bed3-ee140cf0194e tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] 10.222.0.66 "GET /compute/v2.1/servers/a6df3631-d967-4c3f-bbf4-e7512466721d" status: 200 len: 1314 microversion: 2.1 time: 0.210641 Aug 04 03:40:57.021483 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 133/264] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:40:56 2022] GET /compute/v2.1/servers/a6df3631-d967-4c3f-bbf4-e7512466721d => generated 1314 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:40:57.428946 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-d1a4468a-0887-44f2-a151-f3643da4ffbc tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:40:57.429855 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-d1a4468a-0887-44f2-a151-f3643da4ffbc tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] [instance: 60273216-f2ed-46cf-8836-1d85335d8920] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:40:57.436172 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-d1a4468a-0887-44f2-a151-f3643da4ffbc tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:57.436633 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-d1a4468a-0887-44f2-a151-f3643da4ffbc tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:57.437485 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-d1a4468a-0887-44f2-a151-f3643da4ffbc tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:57.437921 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-d1a4468a-0887-44f2-a151-f3643da4ffbc tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:57.581744 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-d1a4468a-0887-44f2-a151-f3643da4ffbc tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec8d131a9764028a096314a4ecd58f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9ff6952b014d0a9abb28dcf0b818b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:40:57.589278 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-d1a4468a-0887-44f2-a151-f3643da4ffbc tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] 10.222.0.66 "GET /compute/v2.1/servers/60273216-f2ed-46cf-8836-1d85335d8920" status: 200 len: 1521 microversion: 2.1 time: 0.165271 Aug 04 03:40:57.590019 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 132/265] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:40:57 2022] GET /compute/v2.1/servers/60273216-f2ed-46cf-8836-1d85335d8920 => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:40:58.041821 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-dab7a802-6c09-41a3-b8b2-f0e96bef80ff tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:40:58.042454 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-dab7a802-6c09-41a3-b8b2-f0e96bef80ff tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] [instance: a6df3631-d967-4c3f-bbf4-e7512466721d] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:40:58.050344 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-dab7a802-6c09-41a3-b8b2-f0e96bef80ff tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:58.050813 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-dab7a802-6c09-41a3-b8b2-f0e96bef80ff tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:58.051596 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-dab7a802-6c09-41a3-b8b2-f0e96bef80ff tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:58.052179 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-dab7a802-6c09-41a3-b8b2-f0e96bef80ff tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:58.073976 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-2578306c-4852-4b22-9b09-e5785b8b137a tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:40:58.074892 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-2578306c-4852-4b22-9b09-e5785b8b137a tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] [instance: f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:40:58.082395 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-2578306c-4852-4b22-9b09-e5785b8b137a tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:58.083065 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-2578306c-4852-4b22-9b09-e5785b8b137a tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:58.084086 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-2578306c-4852-4b22-9b09-e5785b8b137a tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:58.084830 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-2578306c-4852-4b22-9b09-e5785b8b137a tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:58.126480 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-2578306c-4852-4b22-9b09-e5785b8b137a tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] [instance: f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e] Going to try to terminate instance {{(pid=130262) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 03:40:58.209142 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-dab7a802-6c09-41a3-b8b2-f0e96bef80ff tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8a3eed3ee0b42f69948aced53729d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4daab5960f4c98874faea2066b1909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:40:58.216615 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-dab7a802-6c09-41a3-b8b2-f0e96bef80ff tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] 10.222.0.66 "GET /compute/v2.1/servers/a6df3631-d967-4c3f-bbf4-e7512466721d" status: 200 len: 1314 microversion: 2.1 time: 0.179602 Aug 04 03:40:58.217181 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 134/266] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:40:58 2022] GET /compute/v2.1/servers/a6df3631-d967-4c3f-bbf4-e7512466721d => generated 1314 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:40:58.412624 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-2578306c-4852-4b22-9b09-e5785b8b137a tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] 10.222.0.66 "DELETE /compute/v2.1/servers/f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e" status: 204 len: 0 microversion: 2.1 time: 0.342198 Aug 04 03:40:58.413255 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 133/267] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 03:40:58 2022] DELETE /compute/v2.1/servers/f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e => generated 0 bytes in 344 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 04 03:40:58.421187 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-edd176d4-3fd8-4223-ae2b-a3579ad6ab54 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:40:58.421838 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-edd176d4-3fd8-4223-ae2b-a3579ad6ab54 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] [instance: f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:40:58.427993 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-edd176d4-3fd8-4223-ae2b-a3579ad6ab54 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:58.428442 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-edd176d4-3fd8-4223-ae2b-a3579ad6ab54 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:58.429236 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-edd176d4-3fd8-4223-ae2b-a3579ad6ab54 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:58.429668 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-edd176d4-3fd8-4223-ae2b-a3579ad6ab54 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:58.558755 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-edd176d4-3fd8-4223-ae2b-a3579ad6ab54 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f4252210bd412ba24305b00a6e77b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a97e25e7eae402f8f5c4222019ed87c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:40:58.567326 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-edd176d4-3fd8-4223-ae2b-a3579ad6ab54 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] 10.222.0.66 "GET /compute/v2.1/servers/f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e" status: 200 len: 1552 microversion: 2.1 time: 0.149949 Aug 04 03:40:58.567874 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 135/268] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:40:58 2022] GET /compute/v2.1/servers/f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e => generated 1552 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:40:58.612798 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-1293f488-8884-4493-b150-f9ab8e093aa9 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:40:58.613525 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-1293f488-8884-4493-b150-f9ab8e093aa9 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] [instance: 60273216-f2ed-46cf-8836-1d85335d8920] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:40:58.619459 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-1293f488-8884-4493-b150-f9ab8e093aa9 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:58.619897 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-1293f488-8884-4493-b150-f9ab8e093aa9 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:58.620676 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-1293f488-8884-4493-b150-f9ab8e093aa9 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:58.621102 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-1293f488-8884-4493-b150-f9ab8e093aa9 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:58.642360 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG dbcounter [-] [130262] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:40:58.760351 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-1293f488-8884-4493-b150-f9ab8e093aa9 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec8d131a9764028a096314a4ecd58f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9ff6952b014d0a9abb28dcf0b818b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:40:58.769226 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-1293f488-8884-4493-b150-f9ab8e093aa9 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] 10.222.0.66 "GET /compute/v2.1/servers/60273216-f2ed-46cf-8836-1d85335d8920" status: 200 len: 1521 microversion: 2.1 time: 0.161735 Aug 04 03:40:58.769909 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 134/269] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:40:58 2022] GET /compute/v2.1/servers/60273216-f2ed-46cf-8836-1d85335d8920 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:40:59.237743 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-7a08ae52-2a7c-4e70-a842-2dc551f86217 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:40:59.238704 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-7a08ae52-2a7c-4e70-a842-2dc551f86217 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] [instance: a6df3631-d967-4c3f-bbf4-e7512466721d] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:40:59.245256 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-7a08ae52-2a7c-4e70-a842-2dc551f86217 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:59.245701 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-7a08ae52-2a7c-4e70-a842-2dc551f86217 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:59.246444 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-7a08ae52-2a7c-4e70-a842-2dc551f86217 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:59.246876 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-7a08ae52-2a7c-4e70-a842-2dc551f86217 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:59.374543 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-7a08ae52-2a7c-4e70-a842-2dc551f86217 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8a3eed3ee0b42f69948aced53729d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4daab5960f4c98874faea2066b1909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:40:59.382619 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-7a08ae52-2a7c-4e70-a842-2dc551f86217 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] 10.222.0.66 "GET /compute/v2.1/servers/a6df3631-d967-4c3f-bbf4-e7512466721d" status: 200 len: 1314 microversion: 2.1 time: 0.149647 Aug 04 03:40:59.383184 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 136/270] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:40:59 2022] GET /compute/v2.1/servers/a6df3631-d967-4c3f-bbf4-e7512466721d => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:40:59.587776 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-60b58f5e-2ea9-4f44-9436-bea2bd5c2e9c tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:40:59.588316 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-60b58f5e-2ea9-4f44-9436-bea2bd5c2e9c tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] [instance: f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:40:59.594325 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-60b58f5e-2ea9-4f44-9436-bea2bd5c2e9c tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:59.594775 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-60b58f5e-2ea9-4f44-9436-bea2bd5c2e9c tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:59.595530 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-60b58f5e-2ea9-4f44-9436-bea2bd5c2e9c tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:59.596528 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-60b58f5e-2ea9-4f44-9436-bea2bd5c2e9c tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:59.727241 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-60b58f5e-2ea9-4f44-9436-bea2bd5c2e9c tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f4252210bd412ba24305b00a6e77b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a97e25e7eae402f8f5c4222019ed87c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:40:59.735118 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-60b58f5e-2ea9-4f44-9436-bea2bd5c2e9c tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] 10.222.0.66 "GET /compute/v2.1/servers/f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e" status: 200 len: 1552 microversion: 2.1 time: 0.151168 Aug 04 03:40:59.735674 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 135/271] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:40:59 2022] GET /compute/v2.1/servers/f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e => generated 1552 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:40:59.790433 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-fd20bab3-81b0-4183-9566-cbce8422ecf2 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:40:59.791164 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-fd20bab3-81b0-4183-9566-cbce8422ecf2 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] [instance: 60273216-f2ed-46cf-8836-1d85335d8920] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:40:59.797128 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-fd20bab3-81b0-4183-9566-cbce8422ecf2 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:59.797604 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-fd20bab3-81b0-4183-9566-cbce8422ecf2 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:59.798354 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-fd20bab3-81b0-4183-9566-cbce8422ecf2 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:40:59.798787 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-fd20bab3-81b0-4183-9566-cbce8422ecf2 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:40:59.927304 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-fd20bab3-81b0-4183-9566-cbce8422ecf2 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec8d131a9764028a096314a4ecd58f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9ff6952b014d0a9abb28dcf0b818b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:40:59.934734 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-fd20bab3-81b0-4183-9566-cbce8422ecf2 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] 10.222.0.66 "GET /compute/v2.1/servers/60273216-f2ed-46cf-8836-1d85335d8920" status: 200 len: 1521 microversion: 2.1 time: 0.148046 Aug 04 03:40:59.935301 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 137/272] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:40:59 2022] GET /compute/v2.1/servers/60273216-f2ed-46cf-8836-1d85335d8920 => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 03:41:00.402394 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-b6dfb3e2-9c97-4ba4-84d9-107ee04e264c tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:41:00.403008 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-b6dfb3e2-9c97-4ba4-84d9-107ee04e264c tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] [instance: a6df3631-d967-4c3f-bbf4-e7512466721d] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:41:00.410324 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-b6dfb3e2-9c97-4ba4-84d9-107ee04e264c tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:00.410770 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-b6dfb3e2-9c97-4ba4-84d9-107ee04e264c tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:00.411536 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-b6dfb3e2-9c97-4ba4-84d9-107ee04e264c tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:00.411969 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-b6dfb3e2-9c97-4ba4-84d9-107ee04e264c tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:00.546620 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-b6dfb3e2-9c97-4ba4-84d9-107ee04e264c tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8a3eed3ee0b42f69948aced53729d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4daab5960f4c98874faea2066b1909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:41:00.555140 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-b6dfb3e2-9c97-4ba4-84d9-107ee04e264c tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] 10.222.0.66 "GET /compute/v2.1/servers/a6df3631-d967-4c3f-bbf4-e7512466721d" status: 200 len: 1314 microversion: 2.1 time: 0.156609 Aug 04 03:41:00.555689 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 136/273] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:41:00 2022] GET /compute/v2.1/servers/a6df3631-d967-4c3f-bbf4-e7512466721d => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:41:00.757713 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-bae64d2f-5191-4285-adeb-f021eae68b14 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:41:00.758245 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-bae64d2f-5191-4285-adeb-f021eae68b14 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] [instance: f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:41:00.764764 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-bae64d2f-5191-4285-adeb-f021eae68b14 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:00.765230 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-bae64d2f-5191-4285-adeb-f021eae68b14 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:00.765997 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-bae64d2f-5191-4285-adeb-f021eae68b14 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:00.766435 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-bae64d2f-5191-4285-adeb-f021eae68b14 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:00.895001 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-bae64d2f-5191-4285-adeb-f021eae68b14 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f4252210bd412ba24305b00a6e77b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a97e25e7eae402f8f5c4222019ed87c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:41:00.902851 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-bae64d2f-5191-4285-adeb-f021eae68b14 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] 10.222.0.66 "GET /compute/v2.1/servers/f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e" status: 200 len: 1552 microversion: 2.1 time: 0.149053 Aug 04 03:41:00.903412 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 138/274] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:41:00 2022] GET /compute/v2.1/servers/f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e => generated 1552 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 03:41:00.956385 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-c3006556-3d2f-4f45-924b-83a7a7ececf9 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:41:00.957027 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-c3006556-3d2f-4f45-924b-83a7a7ececf9 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] [instance: 60273216-f2ed-46cf-8836-1d85335d8920] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:41:00.963090 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-c3006556-3d2f-4f45-924b-83a7a7ececf9 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:00.963509 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-c3006556-3d2f-4f45-924b-83a7a7ececf9 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:00.964269 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-c3006556-3d2f-4f45-924b-83a7a7ececf9 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:00.964704 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-c3006556-3d2f-4f45-924b-83a7a7ececf9 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:01.098558 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-c3006556-3d2f-4f45-924b-83a7a7ececf9 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec8d131a9764028a096314a4ecd58f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9ff6952b014d0a9abb28dcf0b818b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:41:01.105996 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-c3006556-3d2f-4f45-924b-83a7a7ececf9 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] 10.222.0.66 "GET /compute/v2.1/servers/60273216-f2ed-46cf-8836-1d85335d8920" status: 200 len: 1521 microversion: 2.1 time: 0.154213 Aug 04 03:41:01.106559 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 137/275] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:41:00 2022] GET /compute/v2.1/servers/60273216-f2ed-46cf-8836-1d85335d8920 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:41:01.575725 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-c81a007e-67c0-434d-96f2-808d15bc0917 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:41:01.576268 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-c81a007e-67c0-434d-96f2-808d15bc0917 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] [instance: a6df3631-d967-4c3f-bbf4-e7512466721d] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:41:01.582878 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-c81a007e-67c0-434d-96f2-808d15bc0917 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:01.583323 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-c81a007e-67c0-434d-96f2-808d15bc0917 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:01.584082 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-c81a007e-67c0-434d-96f2-808d15bc0917 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:01.584525 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-c81a007e-67c0-434d-96f2-808d15bc0917 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:01.710775 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-c81a007e-67c0-434d-96f2-808d15bc0917 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8a3eed3ee0b42f69948aced53729d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4daab5960f4c98874faea2066b1909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:41:01.718133 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-c81a007e-67c0-434d-96f2-808d15bc0917 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] 10.222.0.66 "GET /compute/v2.1/servers/a6df3631-d967-4c3f-bbf4-e7512466721d" status: 200 len: 1314 microversion: 2.1 time: 0.146230 Aug 04 03:41:01.718692 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 139/276] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:41:01 2022] GET /compute/v2.1/servers/a6df3631-d967-4c3f-bbf4-e7512466721d => generated 1314 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:41:01.924203 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-0e3c7d42-646b-4a5d-b3de-7fb299afd5f4 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:41:01.924860 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-0e3c7d42-646b-4a5d-b3de-7fb299afd5f4 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] [instance: f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:41:01.931254 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-0e3c7d42-646b-4a5d-b3de-7fb299afd5f4 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:01.931697 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-0e3c7d42-646b-4a5d-b3de-7fb299afd5f4 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:01.932451 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-0e3c7d42-646b-4a5d-b3de-7fb299afd5f4 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:01.932884 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-0e3c7d42-646b-4a5d-b3de-7fb299afd5f4 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:02.059324 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-0e3c7d42-646b-4a5d-b3de-7fb299afd5f4 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f4252210bd412ba24305b00a6e77b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a97e25e7eae402f8f5c4222019ed87c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:41:02.068181 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-0e3c7d42-646b-4a5d-b3de-7fb299afd5f4 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] 10.222.0.66 "GET /compute/v2.1/servers/f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e" status: 200 len: 1552 microversion: 2.1 time: 0.148222 Aug 04 03:41:02.068743 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 138/277] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:41:01 2022] GET /compute/v2.1/servers/f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e => generated 1552 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:41:02.127103 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-2d44433f-b7b6-4915-8c4f-f3b32144e4fb tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:41:02.128371 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-2d44433f-b7b6-4915-8c4f-f3b32144e4fb tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] [instance: 60273216-f2ed-46cf-8836-1d85335d8920] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:41:02.135084 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-2d44433f-b7b6-4915-8c4f-f3b32144e4fb tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:02.135498 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-2d44433f-b7b6-4915-8c4f-f3b32144e4fb tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:02.136259 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-2d44433f-b7b6-4915-8c4f-f3b32144e4fb tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:02.136698 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-2d44433f-b7b6-4915-8c4f-f3b32144e4fb tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:02.273471 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-2d44433f-b7b6-4915-8c4f-f3b32144e4fb tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec8d131a9764028a096314a4ecd58f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9ff6952b014d0a9abb28dcf0b818b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:41:02.281022 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-2d44433f-b7b6-4915-8c4f-f3b32144e4fb tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] 10.222.0.66 "GET /compute/v2.1/servers/60273216-f2ed-46cf-8836-1d85335d8920" status: 200 len: 1521 microversion: 2.1 time: 0.157890 Aug 04 03:41:02.284782 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 140/278] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:41:02 2022] GET /compute/v2.1/servers/60273216-f2ed-46cf-8836-1d85335d8920 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:41:02.739407 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-ee1810ff-52bb-4b1c-9268-293f76dfa513 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:41:02.740019 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-ee1810ff-52bb-4b1c-9268-293f76dfa513 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] [instance: a6df3631-d967-4c3f-bbf4-e7512466721d] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:41:02.745958 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-ee1810ff-52bb-4b1c-9268-293f76dfa513 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:02.746344 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-ee1810ff-52bb-4b1c-9268-293f76dfa513 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:02.747089 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-ee1810ff-52bb-4b1c-9268-293f76dfa513 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:02.747512 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-ee1810ff-52bb-4b1c-9268-293f76dfa513 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:02.877705 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-ee1810ff-52bb-4b1c-9268-293f76dfa513 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8a3eed3ee0b42f69948aced53729d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4daab5960f4c98874faea2066b1909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:41:02.885467 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-ee1810ff-52bb-4b1c-9268-293f76dfa513 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] 10.222.0.66 "GET /compute/v2.1/servers/a6df3631-d967-4c3f-bbf4-e7512466721d" status: 200 len: 1314 microversion: 2.1 time: 0.150098 Aug 04 03:41:02.886032 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 139/279] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:41:02 2022] GET /compute/v2.1/servers/a6df3631-d967-4c3f-bbf4-e7512466721d => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:41:03.090268 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-d49ecd8c-bdd8-4301-a97b-990d5ba70658 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:41:03.090836 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-d49ecd8c-bdd8-4301-a97b-990d5ba70658 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] [instance: f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:41:03.096848 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-d49ecd8c-bdd8-4301-a97b-990d5ba70658 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:03.097334 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-d49ecd8c-bdd8-4301-a97b-990d5ba70658 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:03.098099 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-d49ecd8c-bdd8-4301-a97b-990d5ba70658 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:03.098543 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-d49ecd8c-bdd8-4301-a97b-990d5ba70658 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:03.234046 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-d49ecd8c-bdd8-4301-a97b-990d5ba70658 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f4252210bd412ba24305b00a6e77b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a97e25e7eae402f8f5c4222019ed87c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:41:03.242454 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-d49ecd8c-bdd8-4301-a97b-990d5ba70658 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] 10.222.0.66 "GET /compute/v2.1/servers/f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e" status: 200 len: 1552 microversion: 2.1 time: 0.156121 Aug 04 03:41:03.243015 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 141/280] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:41:03 2022] GET /compute/v2.1/servers/f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e => generated 1552 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:41:03.303715 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-4e1b925b-0cec-4fa3-a269-0d66187716ac tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:41:03.304320 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-4e1b925b-0cec-4fa3-a269-0d66187716ac tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] [instance: 60273216-f2ed-46cf-8836-1d85335d8920] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:41:03.310261 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-4e1b925b-0cec-4fa3-a269-0d66187716ac tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:03.310713 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-4e1b925b-0cec-4fa3-a269-0d66187716ac tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:03.311465 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-4e1b925b-0cec-4fa3-a269-0d66187716ac tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:03.311900 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-4e1b925b-0cec-4fa3-a269-0d66187716ac tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:03.449966 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-4e1b925b-0cec-4fa3-a269-0d66187716ac tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec8d131a9764028a096314a4ecd58f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9ff6952b014d0a9abb28dcf0b818b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:41:03.462652 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-4e1b925b-0cec-4fa3-a269-0d66187716ac tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] 10.222.0.66 "GET /compute/v2.1/servers/60273216-f2ed-46cf-8836-1d85335d8920" status: 200 len: 1521 microversion: 2.1 time: 0.162489 Aug 04 03:41:03.476089 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 140/281] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:41:03 2022] GET /compute/v2.1/servers/60273216-f2ed-46cf-8836-1d85335d8920 => generated 1521 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:41:03.907205 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-3599e4ca-84d0-4b03-8452-02a2bfcd83bf tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:41:03.907817 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-3599e4ca-84d0-4b03-8452-02a2bfcd83bf tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] [instance: a6df3631-d967-4c3f-bbf4-e7512466721d] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:41:03.914033 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-3599e4ca-84d0-4b03-8452-02a2bfcd83bf tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:03.914485 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-3599e4ca-84d0-4b03-8452-02a2bfcd83bf tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:03.915245 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-3599e4ca-84d0-4b03-8452-02a2bfcd83bf tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:03.915685 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-3599e4ca-84d0-4b03-8452-02a2bfcd83bf tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:04.054130 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-3599e4ca-84d0-4b03-8452-02a2bfcd83bf tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8a3eed3ee0b42f69948aced53729d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4daab5960f4c98874faea2066b1909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:41:04.061813 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-3599e4ca-84d0-4b03-8452-02a2bfcd83bf tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] 10.222.0.66 "GET /compute/v2.1/servers/a6df3631-d967-4c3f-bbf4-e7512466721d" status: 200 len: 1314 microversion: 2.1 time: 0.158400 Aug 04 03:41:04.062396 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 142/282] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:41:03 2022] GET /compute/v2.1/servers/a6df3631-d967-4c3f-bbf4-e7512466721d => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:41:04.263528 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-ec4d55f4-ba82-4ce1-9e07-b35c04e1e543 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:41:04.264279 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-ec4d55f4-ba82-4ce1-9e07-b35c04e1e543 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] [instance: f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:41:04.270457 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-ec4d55f4-ba82-4ce1-9e07-b35c04e1e543 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:04.270922 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-ec4d55f4-ba82-4ce1-9e07-b35c04e1e543 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:04.271662 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-ec4d55f4-ba82-4ce1-9e07-b35c04e1e543 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:04.272092 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-ec4d55f4-ba82-4ce1-9e07-b35c04e1e543 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:04.452120 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-ec4d55f4-ba82-4ce1-9e07-b35c04e1e543 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f4252210bd412ba24305b00a6e77b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a97e25e7eae402f8f5c4222019ed87c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:41:04.460267 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-ec4d55f4-ba82-4ce1-9e07-b35c04e1e543 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] 10.222.0.66 "GET /compute/v2.1/servers/f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e" status: 200 len: 1552 microversion: 2.1 time: 0.200539 Aug 04 03:41:04.461280 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 141/283] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:41:04 2022] GET /compute/v2.1/servers/f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e => generated 1552 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:41:04.482995 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-66130163-3add-4093-8b0c-83e3cbad6caa tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:41:04.483581 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-66130163-3add-4093-8b0c-83e3cbad6caa tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] [instance: 60273216-f2ed-46cf-8836-1d85335d8920] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:41:04.490917 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-66130163-3add-4093-8b0c-83e3cbad6caa tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:04.491362 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-66130163-3add-4093-8b0c-83e3cbad6caa tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:04.492116 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-66130163-3add-4093-8b0c-83e3cbad6caa tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:04.492546 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-66130163-3add-4093-8b0c-83e3cbad6caa tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:04.688680 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-66130163-3add-4093-8b0c-83e3cbad6caa tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec8d131a9764028a096314a4ecd58f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9ff6952b014d0a9abb28dcf0b818b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:41:04.703315 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-66130163-3add-4093-8b0c-83e3cbad6caa tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] 10.222.0.66 "GET /compute/v2.1/servers/60273216-f2ed-46cf-8836-1d85335d8920" status: 200 len: 1521 microversion: 2.1 time: 0.216710 Aug 04 03:41:04.703315 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 143/284] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:41:04 2022] GET /compute/v2.1/servers/60273216-f2ed-46cf-8836-1d85335d8920 => generated 1521 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:41:05.082888 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-518d8bf6-82df-4d82-bd85-d02f82a13eff tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:41:05.083497 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-518d8bf6-82df-4d82-bd85-d02f82a13eff tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] [instance: a6df3631-d967-4c3f-bbf4-e7512466721d] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:41:05.089854 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-518d8bf6-82df-4d82-bd85-d02f82a13eff tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:05.090474 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-518d8bf6-82df-4d82-bd85-d02f82a13eff tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:05.091382 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-518d8bf6-82df-4d82-bd85-d02f82a13eff tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:05.091953 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-518d8bf6-82df-4d82-bd85-d02f82a13eff tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:05.242233 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-518d8bf6-82df-4d82-bd85-d02f82a13eff tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8a3eed3ee0b42f69948aced53729d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4daab5960f4c98874faea2066b1909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:41:05.249843 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-518d8bf6-82df-4d82-bd85-d02f82a13eff tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] 10.222.0.66 "GET /compute/v2.1/servers/a6df3631-d967-4c3f-bbf4-e7512466721d" status: 200 len: 1314 microversion: 2.1 time: 0.170931 Aug 04 03:41:05.250403 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 142/285] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:41:05 2022] GET /compute/v2.1/servers/a6df3631-d967-4c3f-bbf4-e7512466721d => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:41:05.482830 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-4601bf0f-496a-4b3e-9780-dafd30fab841 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:41:05.483446 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-4601bf0f-496a-4b3e-9780-dafd30fab841 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] [instance: f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:41:05.490072 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-4601bf0f-496a-4b3e-9780-dafd30fab841 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:05.490496 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-4601bf0f-496a-4b3e-9780-dafd30fab841 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:05.491295 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-4601bf0f-496a-4b3e-9780-dafd30fab841 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:05.491716 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-4601bf0f-496a-4b3e-9780-dafd30fab841 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:05.640268 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-4601bf0f-496a-4b3e-9780-dafd30fab841 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f4252210bd412ba24305b00a6e77b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a97e25e7eae402f8f5c4222019ed87c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:41:05.649993 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-4601bf0f-496a-4b3e-9780-dafd30fab841 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] 10.222.0.66 "GET /compute/v2.1/servers/f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e" status: 200 len: 1552 microversion: 2.1 time: 0.170517 Aug 04 03:41:05.650785 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 144/286] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:41:05 2022] GET /compute/v2.1/servers/f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e => generated 1552 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 03:41:05.721900 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-cfc6f758-ed4a-4bbc-a701-0daf2170657b tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:41:05.722499 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-cfc6f758-ed4a-4bbc-a701-0daf2170657b tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] [instance: 60273216-f2ed-46cf-8836-1d85335d8920] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:41:05.728796 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-cfc6f758-ed4a-4bbc-a701-0daf2170657b tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:05.729281 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-cfc6f758-ed4a-4bbc-a701-0daf2170657b tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:05.730062 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-cfc6f758-ed4a-4bbc-a701-0daf2170657b tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:05.730563 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-cfc6f758-ed4a-4bbc-a701-0daf2170657b tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:05.913848 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-cfc6f758-ed4a-4bbc-a701-0daf2170657b tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec8d131a9764028a096314a4ecd58f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9ff6952b014d0a9abb28dcf0b818b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:41:05.921418 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-cfc6f758-ed4a-4bbc-a701-0daf2170657b tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] 10.222.0.66 "GET /compute/v2.1/servers/60273216-f2ed-46cf-8836-1d85335d8920" status: 200 len: 1521 microversion: 2.1 time: 0.203582 Aug 04 03:41:05.921970 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 143/287] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:41:05 2022] GET /compute/v2.1/servers/60273216-f2ed-46cf-8836-1d85335d8920 => generated 1521 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:41:06.274715 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-9374526c-38df-4119-96b4-04b117d14fee tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:41:06.275397 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-9374526c-38df-4119-96b4-04b117d14fee tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] [instance: a6df3631-d967-4c3f-bbf4-e7512466721d] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:41:06.281583 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-9374526c-38df-4119-96b4-04b117d14fee tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:06.282031 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-9374526c-38df-4119-96b4-04b117d14fee tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:06.282824 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-9374526c-38df-4119-96b4-04b117d14fee tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:06.283257 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-9374526c-38df-4119-96b4-04b117d14fee tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:06.443142 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-9374526c-38df-4119-96b4-04b117d14fee tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8a3eed3ee0b42f69948aced53729d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4daab5960f4c98874faea2066b1909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:41:06.450950 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-9374526c-38df-4119-96b4-04b117d14fee tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] 10.222.0.66 "GET /compute/v2.1/servers/a6df3631-d967-4c3f-bbf4-e7512466721d" status: 200 len: 1314 microversion: 2.1 time: 0.180015 Aug 04 03:41:06.451528 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 145/288] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:41:06 2022] GET /compute/v2.1/servers/a6df3631-d967-4c3f-bbf4-e7512466721d => generated 1314 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:41:06.671514 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-8972fa73-a370-4aa5-a710-a62cb401877d tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:41:06.672125 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-8972fa73-a370-4aa5-a710-a62cb401877d tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] [instance: f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:41:06.679232 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-8972fa73-a370-4aa5-a710-a62cb401877d tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:06.679687 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-8972fa73-a370-4aa5-a710-a62cb401877d tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:06.680490 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-8972fa73-a370-4aa5-a710-a62cb401877d tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:06.680944 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-8972fa73-a370-4aa5-a710-a62cb401877d tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:06.817403 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-8972fa73-a370-4aa5-a710-a62cb401877d tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f4252210bd412ba24305b00a6e77b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a97e25e7eae402f8f5c4222019ed87c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:41:06.825792 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-8972fa73-a370-4aa5-a710-a62cb401877d tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] 10.222.0.66 "GET /compute/v2.1/servers/f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e" status: 200 len: 1552 microversion: 2.1 time: 0.158177 Aug 04 03:41:06.826350 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 144/289] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:41:06 2022] GET /compute/v2.1/servers/f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e => generated 1552 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 03:41:06.942836 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-7f7b665e-a466-41e9-bebc-9a5deaca4de8 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:41:06.943430 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-7f7b665e-a466-41e9-bebc-9a5deaca4de8 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] [instance: 60273216-f2ed-46cf-8836-1d85335d8920] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:41:06.950677 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-7f7b665e-a466-41e9-bebc-9a5deaca4de8 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:06.951132 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-7f7b665e-a466-41e9-bebc-9a5deaca4de8 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:06.951905 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-7f7b665e-a466-41e9-bebc-9a5deaca4de8 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:06.952362 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-7f7b665e-a466-41e9-bebc-9a5deaca4de8 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:07.095534 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-7f7b665e-a466-41e9-bebc-9a5deaca4de8 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec8d131a9764028a096314a4ecd58f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9ff6952b014d0a9abb28dcf0b818b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:41:07.104301 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-7f7b665e-a466-41e9-bebc-9a5deaca4de8 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] 10.222.0.66 "GET /compute/v2.1/servers/60273216-f2ed-46cf-8836-1d85335d8920" status: 200 len: 1521 microversion: 2.1 time: 0.165204 Aug 04 03:41:07.117970 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 146/290] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:41:06 2022] GET /compute/v2.1/servers/60273216-f2ed-46cf-8836-1d85335d8920 => generated 1521 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:41:07.472403 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-26004b88-0f0a-4c17-ab91-0c3f27cc7abf tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:41:07.472927 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-26004b88-0f0a-4c17-ab91-0c3f27cc7abf tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] [instance: a6df3631-d967-4c3f-bbf4-e7512466721d] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:41:07.481664 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-26004b88-0f0a-4c17-ab91-0c3f27cc7abf tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:07.482115 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-26004b88-0f0a-4c17-ab91-0c3f27cc7abf tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:07.483109 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-26004b88-0f0a-4c17-ab91-0c3f27cc7abf tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:07.483810 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-26004b88-0f0a-4c17-ab91-0c3f27cc7abf tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:07.615274 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-26004b88-0f0a-4c17-ab91-0c3f27cc7abf tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8a3eed3ee0b42f69948aced53729d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4daab5960f4c98874faea2066b1909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:41:07.623193 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-26004b88-0f0a-4c17-ab91-0c3f27cc7abf tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] 10.222.0.66 "GET /compute/v2.1/servers/a6df3631-d967-4c3f-bbf4-e7512466721d" status: 200 len: 1314 microversion: 2.1 time: 0.155156 Aug 04 03:41:07.623753 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 145/291] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:41:07 2022] GET /compute/v2.1/servers/a6df3631-d967-4c3f-bbf4-e7512466721d => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:41:07.847955 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-d0886daf-89da-4f36-98a4-3690aca2289d tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:41:07.848784 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-d0886daf-89da-4f36-98a4-3690aca2289d tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] [instance: f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:41:07.855304 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-d0886daf-89da-4f36-98a4-3690aca2289d tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:07.855756 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-d0886daf-89da-4f36-98a4-3690aca2289d tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:07.856521 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-d0886daf-89da-4f36-98a4-3690aca2289d tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:07.856983 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-d0886daf-89da-4f36-98a4-3690aca2289d tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:08.006915 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-d0886daf-89da-4f36-98a4-3690aca2289d tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f4252210bd412ba24305b00a6e77b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a97e25e7eae402f8f5c4222019ed87c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:41:08.012087 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-d0886daf-89da-4f36-98a4-3690aca2289d tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] 10.222.0.66 "GET /compute/v2.1/servers/f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e" status: 200 len: 1552 microversion: 2.1 time: 0.168043 Aug 04 03:41:08.012652 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 147/292] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:41:07 2022] GET /compute/v2.1/servers/f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e => generated 1552 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:41:08.126290 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-1eb41e35-8b6a-4565-995a-0e7f69ad690d tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:41:08.127024 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-1eb41e35-8b6a-4565-995a-0e7f69ad690d tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] [instance: 60273216-f2ed-46cf-8836-1d85335d8920] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:41:08.134228 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-1eb41e35-8b6a-4565-995a-0e7f69ad690d tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:08.134673 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-1eb41e35-8b6a-4565-995a-0e7f69ad690d tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:08.135436 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-1eb41e35-8b6a-4565-995a-0e7f69ad690d tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:08.135883 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-1eb41e35-8b6a-4565-995a-0e7f69ad690d tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:08.482669 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-1eb41e35-8b6a-4565-995a-0e7f69ad690d tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec8d131a9764028a096314a4ecd58f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9ff6952b014d0a9abb28dcf0b818b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:41:08.490350 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-1eb41e35-8b6a-4565-995a-0e7f69ad690d tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] 10.222.0.66 "GET /compute/v2.1/servers/60273216-f2ed-46cf-8836-1d85335d8920" status: 200 len: 1521 microversion: 2.1 time: 0.368229 Aug 04 03:41:08.490908 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 146/293] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:41:08 2022] GET /compute/v2.1/servers/60273216-f2ed-46cf-8836-1d85335d8920 => generated 1521 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:41:08.644874 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-281165fd-dbb0-4a0c-b153-efcee60784ca tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:41:08.645509 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-281165fd-dbb0-4a0c-b153-efcee60784ca tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] [instance: a6df3631-d967-4c3f-bbf4-e7512466721d] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:41:08.652303 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-281165fd-dbb0-4a0c-b153-efcee60784ca tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:08.652769 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-281165fd-dbb0-4a0c-b153-efcee60784ca tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:08.653554 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-281165fd-dbb0-4a0c-b153-efcee60784ca tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:08.653972 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-281165fd-dbb0-4a0c-b153-efcee60784ca tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:08.785507 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-281165fd-dbb0-4a0c-b153-efcee60784ca tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8a3eed3ee0b42f69948aced53729d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4daab5960f4c98874faea2066b1909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:41:08.793069 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-281165fd-dbb0-4a0c-b153-efcee60784ca tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] 10.222.0.66 "GET /compute/v2.1/servers/a6df3631-d967-4c3f-bbf4-e7512466721d" status: 200 len: 1314 microversion: 2.1 time: 0.151923 Aug 04 03:41:08.793672 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 148/294] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:41:08 2022] GET /compute/v2.1/servers/a6df3631-d967-4c3f-bbf4-e7512466721d => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:41:09.037735 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-30055fff-ba9b-4d20-b4c1-20f02fefd096 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:41:09.037735 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-30055fff-ba9b-4d20-b4c1-20f02fefd096 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] [instance: f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:41:09.041704 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-30055fff-ba9b-4d20-b4c1-20f02fefd096 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:09.042219 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-30055fff-ba9b-4d20-b4c1-20f02fefd096 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:09.043060 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-30055fff-ba9b-4d20-b4c1-20f02fefd096 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:09.043625 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-30055fff-ba9b-4d20-b4c1-20f02fefd096 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:09.180410 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-30055fff-ba9b-4d20-b4c1-20f02fefd096 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f4252210bd412ba24305b00a6e77b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a97e25e7eae402f8f5c4222019ed87c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:41:09.189741 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-30055fff-ba9b-4d20-b4c1-20f02fefd096 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] 10.222.0.66 "GET /compute/v2.1/servers/f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e" status: 200 len: 1552 microversion: 2.1 time: 0.160163 Aug 04 03:41:09.190319 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 147/295] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:41:09 2022] GET /compute/v2.1/servers/f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e => generated 1552 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:41:09.511566 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-feba7952-e679-4b64-8859-6673e702b639 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:41:09.512170 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-feba7952-e679-4b64-8859-6673e702b639 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] [instance: 60273216-f2ed-46cf-8836-1d85335d8920] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:41:09.518321 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-feba7952-e679-4b64-8859-6673e702b639 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:09.518769 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-feba7952-e679-4b64-8859-6673e702b639 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:09.519524 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-feba7952-e679-4b64-8859-6673e702b639 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:09.519962 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-feba7952-e679-4b64-8859-6673e702b639 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:09.654282 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-feba7952-e679-4b64-8859-6673e702b639 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec8d131a9764028a096314a4ecd58f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9ff6952b014d0a9abb28dcf0b818b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:41:09.662102 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-feba7952-e679-4b64-8859-6673e702b639 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] 10.222.0.66 "GET /compute/v2.1/servers/60273216-f2ed-46cf-8836-1d85335d8920" status: 200 len: 1521 microversion: 2.1 time: 0.154320 Aug 04 03:41:09.662664 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 149/296] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:41:09 2022] GET /compute/v2.1/servers/60273216-f2ed-46cf-8836-1d85335d8920 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:41:09.813283 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-74b78808-1734-4cef-a0a2-87c27fcef9e7 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:41:09.813896 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-74b78808-1734-4cef-a0a2-87c27fcef9e7 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] [instance: a6df3631-d967-4c3f-bbf4-e7512466721d] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:41:09.820174 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-74b78808-1734-4cef-a0a2-87c27fcef9e7 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:09.820623 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-74b78808-1734-4cef-a0a2-87c27fcef9e7 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:09.821475 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-74b78808-1734-4cef-a0a2-87c27fcef9e7 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:09.821944 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-74b78808-1734-4cef-a0a2-87c27fcef9e7 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:09.954880 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-74b78808-1734-4cef-a0a2-87c27fcef9e7 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8a3eed3ee0b42f69948aced53729d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4daab5960f4c98874faea2066b1909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:41:09.963721 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-74b78808-1734-4cef-a0a2-87c27fcef9e7 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] 10.222.0.66 "GET /compute/v2.1/servers/a6df3631-d967-4c3f-bbf4-e7512466721d" status: 200 len: 1314 microversion: 2.1 time: 0.154214 Aug 04 03:41:09.964270 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 148/297] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:41:09 2022] GET /compute/v2.1/servers/a6df3631-d967-4c3f-bbf4-e7512466721d => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:41:10.212649 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-3d238084-55e5-4f04-a20a-8e6ceb9c3f53 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:41:10.213296 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-3d238084-55e5-4f04-a20a-8e6ceb9c3f53 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] [instance: f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:41:10.219202 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-3d238084-55e5-4f04-a20a-8e6ceb9c3f53 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:10.219656 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-3d238084-55e5-4f04-a20a-8e6ceb9c3f53 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:10.220414 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-3d238084-55e5-4f04-a20a-8e6ceb9c3f53 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:10.220850 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-3d238084-55e5-4f04-a20a-8e6ceb9c3f53 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:10.224793 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG dbcounter [-] [130263] Writing DB stats nova_cell1:SELECT=100 {{(pid=130263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:41:10.486633 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-3d238084-55e5-4f04-a20a-8e6ceb9c3f53 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f4252210bd412ba24305b00a6e77b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a97e25e7eae402f8f5c4222019ed87c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:41:10.495676 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-3d238084-55e5-4f04-a20a-8e6ceb9c3f53 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] 10.222.0.66 "GET /compute/v2.1/servers/f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e" status: 200 len: 1552 microversion: 2.1 time: 0.287675 Aug 04 03:41:10.496219 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 150/298] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:41:10 2022] GET /compute/v2.1/servers/f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e => generated 1552 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:41:10.683912 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-dfc68e94-5040-4325-afd4-f5cc10bdbfe5 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:41:10.685058 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-dfc68e94-5040-4325-afd4-f5cc10bdbfe5 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] [instance: 60273216-f2ed-46cf-8836-1d85335d8920] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:41:10.691915 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-dfc68e94-5040-4325-afd4-f5cc10bdbfe5 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:10.692524 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-dfc68e94-5040-4325-afd4-f5cc10bdbfe5 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:10.693115 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-dfc68e94-5040-4325-afd4-f5cc10bdbfe5 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:10.693582 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-dfc68e94-5040-4325-afd4-f5cc10bdbfe5 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:10.837281 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-dfc68e94-5040-4325-afd4-f5cc10bdbfe5 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec8d131a9764028a096314a4ecd58f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9ff6952b014d0a9abb28dcf0b818b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:41:10.845375 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-dfc68e94-5040-4325-afd4-f5cc10bdbfe5 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] 10.222.0.66 "GET /compute/v2.1/servers/60273216-f2ed-46cf-8836-1d85335d8920" status: 200 len: 1521 microversion: 2.1 time: 0.165238 Aug 04 03:41:10.845933 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 149/299] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:41:10 2022] GET /compute/v2.1/servers/60273216-f2ed-46cf-8836-1d85335d8920 => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:41:10.984365 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-350f4c28-f7fe-44e5-848d-380b6e4e7fdc tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:41:10.984974 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-350f4c28-f7fe-44e5-848d-380b6e4e7fdc tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] [instance: a6df3631-d967-4c3f-bbf4-e7512466721d] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:41:10.992348 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-350f4c28-f7fe-44e5-848d-380b6e4e7fdc tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:10.992827 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-350f4c28-f7fe-44e5-848d-380b6e4e7fdc tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:10.993629 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-350f4c28-f7fe-44e5-848d-380b6e4e7fdc tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:10.994065 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-350f4c28-f7fe-44e5-848d-380b6e4e7fdc tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:11.139236 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-350f4c28-f7fe-44e5-848d-380b6e4e7fdc tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8a3eed3ee0b42f69948aced53729d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4daab5960f4c98874faea2066b1909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:41:11.146875 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-350f4c28-f7fe-44e5-848d-380b6e4e7fdc tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] 10.222.0.66 "GET /compute/v2.1/servers/a6df3631-d967-4c3f-bbf4-e7512466721d" status: 200 len: 1314 microversion: 2.1 time: 0.166341 Aug 04 03:41:11.147474 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 151/300] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:41:10 2022] GET /compute/v2.1/servers/a6df3631-d967-4c3f-bbf4-e7512466721d => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:41:11.517068 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-438f322a-5942-4acf-b989-53096ad1f6ea tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:41:11.517687 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-438f322a-5942-4acf-b989-53096ad1f6ea tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] [instance: f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:41:11.524418 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-438f322a-5942-4acf-b989-53096ad1f6ea tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:11.524855 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-438f322a-5942-4acf-b989-53096ad1f6ea tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:11.525635 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-438f322a-5942-4acf-b989-53096ad1f6ea tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:11.526200 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-438f322a-5942-4acf-b989-53096ad1f6ea tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:11.655911 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-438f322a-5942-4acf-b989-53096ad1f6ea tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f4252210bd412ba24305b00a6e77b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a97e25e7eae402f8f5c4222019ed87c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:41:11.664562 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-438f322a-5942-4acf-b989-53096ad1f6ea tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] 10.222.0.66 "GET /compute/v2.1/servers/f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e" status: 200 len: 1552 microversion: 2.1 time: 0.151490 Aug 04 03:41:11.665122 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 150/301] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:41:11 2022] GET /compute/v2.1/servers/f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e => generated 1552 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:41:11.867891 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-2b675e67-790d-46b8-b891-084fc59f6c60 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:41:11.868526 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-2b675e67-790d-46b8-b891-084fc59f6c60 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] [instance: 60273216-f2ed-46cf-8836-1d85335d8920] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:41:11.874559 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-2b675e67-790d-46b8-b891-084fc59f6c60 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:11.875007 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-2b675e67-790d-46b8-b891-084fc59f6c60 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:11.875820 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-2b675e67-790d-46b8-b891-084fc59f6c60 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:11.876255 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-2b675e67-790d-46b8-b891-084fc59f6c60 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:12.016874 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-2b675e67-790d-46b8-b891-084fc59f6c60 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec8d131a9764028a096314a4ecd58f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9ff6952b014d0a9abb28dcf0b818b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:41:12.025030 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-2b675e67-790d-46b8-b891-084fc59f6c60 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] 10.222.0.66 "GET /compute/v2.1/servers/60273216-f2ed-46cf-8836-1d85335d8920" status: 200 len: 1521 microversion: 2.1 time: 0.161810 Aug 04 03:41:12.025617 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 152/302] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:41:11 2022] GET /compute/v2.1/servers/60273216-f2ed-46cf-8836-1d85335d8920 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:41:12.168691 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-0a6c44e7-c9b9-47e3-bf61-1c990aca9480 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:41:12.169341 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-0a6c44e7-c9b9-47e3-bf61-1c990aca9480 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] [instance: a6df3631-d967-4c3f-bbf4-e7512466721d] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:41:12.175802 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-0a6c44e7-c9b9-47e3-bf61-1c990aca9480 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:12.176246 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-0a6c44e7-c9b9-47e3-bf61-1c990aca9480 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:12.177007 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-0a6c44e7-c9b9-47e3-bf61-1c990aca9480 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:12.177463 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-0a6c44e7-c9b9-47e3-bf61-1c990aca9480 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:12.181517 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG dbcounter [-] [130262] Writing DB stats nova_cell1:SELECT=100 {{(pid=130262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:41:12.306796 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-0a6c44e7-c9b9-47e3-bf61-1c990aca9480 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8a3eed3ee0b42f69948aced53729d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4daab5960f4c98874faea2066b1909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:41:12.314080 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-0a6c44e7-c9b9-47e3-bf61-1c990aca9480 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] 10.222.0.66 "GET /compute/v2.1/servers/a6df3631-d967-4c3f-bbf4-e7512466721d" status: 200 len: 1314 microversion: 2.1 time: 0.150389 Aug 04 03:41:12.314626 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 151/303] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:41:12 2022] GET /compute/v2.1/servers/a6df3631-d967-4c3f-bbf4-e7512466721d => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:41:12.686101 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-841dc358-1ff6-4f1b-96f7-065867616d78 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:41:12.686706 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-841dc358-1ff6-4f1b-96f7-065867616d78 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] [instance: f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:41:12.692934 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-841dc358-1ff6-4f1b-96f7-065867616d78 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:12.693421 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-841dc358-1ff6-4f1b-96f7-065867616d78 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:12.694172 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-841dc358-1ff6-4f1b-96f7-065867616d78 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:12.694673 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-841dc358-1ff6-4f1b-96f7-065867616d78 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:12.824231 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-841dc358-1ff6-4f1b-96f7-065867616d78 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f4252210bd412ba24305b00a6e77b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a97e25e7eae402f8f5c4222019ed87c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:41:12.832403 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-841dc358-1ff6-4f1b-96f7-065867616d78 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] 10.222.0.66 "GET /compute/v2.1/servers/f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e" status: 200 len: 1552 microversion: 2.1 time: 0.150096 Aug 04 03:41:12.832968 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 153/304] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:41:12 2022] GET /compute/v2.1/servers/f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e => generated 1552 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:41:13.046298 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-a4db02c0-dbbe-4482-8416-385e11c587fa tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:41:13.046945 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-a4db02c0-dbbe-4482-8416-385e11c587fa tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] [instance: 60273216-f2ed-46cf-8836-1d85335d8920] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:41:13.053112 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-a4db02c0-dbbe-4482-8416-385e11c587fa tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:13.053706 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-a4db02c0-dbbe-4482-8416-385e11c587fa tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:13.054458 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-a4db02c0-dbbe-4482-8416-385e11c587fa tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:13.055523 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-a4db02c0-dbbe-4482-8416-385e11c587fa tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:13.187119 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-a4db02c0-dbbe-4482-8416-385e11c587fa tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec8d131a9764028a096314a4ecd58f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9ff6952b014d0a9abb28dcf0b818b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:41:13.194744 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-a4db02c0-dbbe-4482-8416-385e11c587fa tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] 10.222.0.66 "GET /compute/v2.1/servers/60273216-f2ed-46cf-8836-1d85335d8920" status: 200 len: 1521 microversion: 2.1 time: 0.152294 Aug 04 03:41:13.195893 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 152/305] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:41:13 2022] GET /compute/v2.1/servers/60273216-f2ed-46cf-8836-1d85335d8920 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:41:13.334848 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-87d53224-674b-4e28-bfae-fb9ff95f93c4 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:41:13.335383 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-87d53224-674b-4e28-bfae-fb9ff95f93c4 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] [instance: a6df3631-d967-4c3f-bbf4-e7512466721d] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:41:13.342480 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-87d53224-674b-4e28-bfae-fb9ff95f93c4 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:13.342925 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-87d53224-674b-4e28-bfae-fb9ff95f93c4 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:13.343671 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-87d53224-674b-4e28-bfae-fb9ff95f93c4 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:13.344101 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-87d53224-674b-4e28-bfae-fb9ff95f93c4 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:13.470070 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-87d53224-674b-4e28-bfae-fb9ff95f93c4 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8a3eed3ee0b42f69948aced53729d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4daab5960f4c98874faea2066b1909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:41:13.477444 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-87d53224-674b-4e28-bfae-fb9ff95f93c4 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] 10.222.0.66 "GET /compute/v2.1/servers/a6df3631-d967-4c3f-bbf4-e7512466721d" status: 200 len: 1314 microversion: 2.1 time: 0.146401 Aug 04 03:41:13.478005 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 154/306] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:41:13 2022] GET /compute/v2.1/servers/a6df3631-d967-4c3f-bbf4-e7512466721d => generated 1314 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:41:13.853191 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-8e62b791-f7fb-44ec-aa6a-622c3e4ed436 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:41:13.853818 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-8e62b791-f7fb-44ec-aa6a-622c3e4ed436 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] [instance: f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:41:13.859777 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-8e62b791-f7fb-44ec-aa6a-622c3e4ed436 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:13.860217 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-8e62b791-f7fb-44ec-aa6a-622c3e4ed436 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:13.861266 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-8e62b791-f7fb-44ec-aa6a-622c3e4ed436 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:13.861702 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-8e62b791-f7fb-44ec-aa6a-622c3e4ed436 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:13.993654 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-8e62b791-f7fb-44ec-aa6a-622c3e4ed436 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f4252210bd412ba24305b00a6e77b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a97e25e7eae402f8f5c4222019ed87c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:41:14.001506 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-8e62b791-f7fb-44ec-aa6a-622c3e4ed436 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] 10.222.0.66 "GET /compute/v2.1/servers/f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e" status: 200 len: 1552 microversion: 2.1 time: 0.152712 Aug 04 03:41:14.002050 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 153/307] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:41:13 2022] GET /compute/v2.1/servers/f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e => generated 1552 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:41:14.216109 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-5cf3c354-65d4-4fe1-aced-bd391133497b tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:41:14.216741 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-5cf3c354-65d4-4fe1-aced-bd391133497b tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] [instance: 60273216-f2ed-46cf-8836-1d85335d8920] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:41:14.218936 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG dbcounter [-] [130263] Writing DB stats nova_api:SELECT=68 {{(pid=130263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:41:14.223665 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-5cf3c354-65d4-4fe1-aced-bd391133497b tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:14.224115 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-5cf3c354-65d4-4fe1-aced-bd391133497b tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:14.224874 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-5cf3c354-65d4-4fe1-aced-bd391133497b tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:14.225333 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-5cf3c354-65d4-4fe1-aced-bd391133497b tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:14.354455 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-5cf3c354-65d4-4fe1-aced-bd391133497b tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec8d131a9764028a096314a4ecd58f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9ff6952b014d0a9abb28dcf0b818b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:41:14.362141 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-5cf3c354-65d4-4fe1-aced-bd391133497b tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] 10.222.0.66 "GET /compute/v2.1/servers/60273216-f2ed-46cf-8836-1d85335d8920" status: 200 len: 1521 microversion: 2.1 time: 0.150220 Aug 04 03:41:14.362690 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 155/308] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:41:14 2022] GET /compute/v2.1/servers/60273216-f2ed-46cf-8836-1d85335d8920 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:41:14.497242 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-24a7e8f9-7ba9-4441-8a59-7d4fa7a1b7ae tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:41:14.497868 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-24a7e8f9-7ba9-4441-8a59-7d4fa7a1b7ae tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] [instance: a6df3631-d967-4c3f-bbf4-e7512466721d] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:41:14.503863 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-24a7e8f9-7ba9-4441-8a59-7d4fa7a1b7ae tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:14.504308 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-24a7e8f9-7ba9-4441-8a59-7d4fa7a1b7ae tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:14.505061 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-24a7e8f9-7ba9-4441-8a59-7d4fa7a1b7ae tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:14.505528 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-24a7e8f9-7ba9-4441-8a59-7d4fa7a1b7ae tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:14.637067 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-24a7e8f9-7ba9-4441-8a59-7d4fa7a1b7ae tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8a3eed3ee0b42f69948aced53729d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4daab5960f4c98874faea2066b1909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:41:14.644459 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-24a7e8f9-7ba9-4441-8a59-7d4fa7a1b7ae tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] 10.222.0.66 "GET /compute/v2.1/servers/a6df3631-d967-4c3f-bbf4-e7512466721d" status: 200 len: 1314 microversion: 2.1 time: 0.151122 Aug 04 03:41:14.645014 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 154/309] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:41:14 2022] GET /compute/v2.1/servers/a6df3631-d967-4c3f-bbf4-e7512466721d => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:41:15.022524 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-80a7a900-db00-4eb7-bbc1-1157f65c2d38 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:41:15.023147 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-80a7a900-db00-4eb7-bbc1-1157f65c2d38 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] [instance: f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:41:15.030364 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-80a7a900-db00-4eb7-bbc1-1157f65c2d38 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:15.030821 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-80a7a900-db00-4eb7-bbc1-1157f65c2d38 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:15.031589 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-80a7a900-db00-4eb7-bbc1-1157f65c2d38 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:15.032032 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-80a7a900-db00-4eb7-bbc1-1157f65c2d38 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:15.168029 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-80a7a900-db00-4eb7-bbc1-1157f65c2d38 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f4252210bd412ba24305b00a6e77b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a97e25e7eae402f8f5c4222019ed87c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:41:15.176356 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-80a7a900-db00-4eb7-bbc1-1157f65c2d38 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] 10.222.0.66 "GET /compute/v2.1/servers/f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e" status: 200 len: 1552 microversion: 2.1 time: 0.157792 Aug 04 03:41:15.176938 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 156/310] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:41:15 2022] GET /compute/v2.1/servers/f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e => generated 1552 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:41:15.383381 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-0b79d28d-1303-4b4e-b9fe-6445fa259f63 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:41:15.383987 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-0b79d28d-1303-4b4e-b9fe-6445fa259f63 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] [instance: 60273216-f2ed-46cf-8836-1d85335d8920] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:41:15.385986 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG dbcounter [-] [130262] Writing DB stats nova_api:SELECT=77,nova_api:UPDATE=1 {{(pid=130262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:41:15.390672 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-0b79d28d-1303-4b4e-b9fe-6445fa259f63 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:15.391237 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-0b79d28d-1303-4b4e-b9fe-6445fa259f63 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:15.391997 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-0b79d28d-1303-4b4e-b9fe-6445fa259f63 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:15.392433 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-0b79d28d-1303-4b4e-b9fe-6445fa259f63 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:15.522505 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-0b79d28d-1303-4b4e-b9fe-6445fa259f63 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec8d131a9764028a096314a4ecd58f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9ff6952b014d0a9abb28dcf0b818b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:41:15.531336 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-0b79d28d-1303-4b4e-b9fe-6445fa259f63 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] 10.222.0.66 "GET /compute/v2.1/servers/60273216-f2ed-46cf-8836-1d85335d8920" status: 200 len: 1521 microversion: 2.1 time: 0.152395 Aug 04 03:41:15.531896 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 155/311] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:41:15 2022] GET /compute/v2.1/servers/60273216-f2ed-46cf-8836-1d85335d8920 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:41:15.665383 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-27aa7991-81a8-43ad-9219-22d55e9b4736 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:41:15.665979 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-27aa7991-81a8-43ad-9219-22d55e9b4736 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] [instance: a6df3631-d967-4c3f-bbf4-e7512466721d] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:41:15.672541 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-27aa7991-81a8-43ad-9219-22d55e9b4736 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:15.672907 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-27aa7991-81a8-43ad-9219-22d55e9b4736 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:15.673687 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-27aa7991-81a8-43ad-9219-22d55e9b4736 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:15.674121 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-27aa7991-81a8-43ad-9219-22d55e9b4736 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:15.810798 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-27aa7991-81a8-43ad-9219-22d55e9b4736 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8a3eed3ee0b42f69948aced53729d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4daab5960f4c98874faea2066b1909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:41:15.818388 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-27aa7991-81a8-43ad-9219-22d55e9b4736 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] 10.222.0.66 "GET /compute/v2.1/servers/a6df3631-d967-4c3f-bbf4-e7512466721d" status: 200 len: 1498 microversion: 2.1 time: 0.156919 Aug 04 03:41:15.818953 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 157/312] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:41:15 2022] GET /compute/v2.1/servers/a6df3631-d967-4c3f-bbf4-e7512466721d => generated 1498 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:41:16.199259 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-dbaefb64-fdd5-4afc-ac2a-327e4b885978 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:41:16.199830 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-dbaefb64-fdd5-4afc-ac2a-327e4b885978 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] [instance: f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:41:16.206883 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-dbaefb64-fdd5-4afc-ac2a-327e4b885978 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:16.207436 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-dbaefb64-fdd5-4afc-ac2a-327e4b885978 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:16.210280 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-dbaefb64-fdd5-4afc-ac2a-327e4b885978 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:16.210280 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-dbaefb64-fdd5-4afc-ac2a-327e4b885978 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:16.391213 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-dbaefb64-fdd5-4afc-ac2a-327e4b885978 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f4252210bd412ba24305b00a6e77b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a97e25e7eae402f8f5c4222019ed87c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:41:16.400165 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-dbaefb64-fdd5-4afc-ac2a-327e4b885978 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] 10.222.0.66 "GET /compute/v2.1/servers/f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e" status: 200 len: 1552 microversion: 2.1 time: 0.205413 Aug 04 03:41:16.413513 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 156/313] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:41:16 2022] GET /compute/v2.1/servers/f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e => generated 1552 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:41:16.552614 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-c5bfcb0e-a520-4abe-9ef7-00edf0e35848 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:41:16.553320 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-c5bfcb0e-a520-4abe-9ef7-00edf0e35848 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] [instance: 60273216-f2ed-46cf-8836-1d85335d8920] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:41:16.561235 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-c5bfcb0e-a520-4abe-9ef7-00edf0e35848 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:16.561781 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-c5bfcb0e-a520-4abe-9ef7-00edf0e35848 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:16.562727 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-c5bfcb0e-a520-4abe-9ef7-00edf0e35848 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:16.563167 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-c5bfcb0e-a520-4abe-9ef7-00edf0e35848 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:16.709888 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-c5bfcb0e-a520-4abe-9ef7-00edf0e35848 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec8d131a9764028a096314a4ecd58f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9ff6952b014d0a9abb28dcf0b818b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:41:16.717433 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-c5bfcb0e-a520-4abe-9ef7-00edf0e35848 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] 10.222.0.66 "GET /compute/v2.1/servers/60273216-f2ed-46cf-8836-1d85335d8920" status: 200 len: 1501 microversion: 2.1 time: 0.168996 Aug 04 03:41:16.717996 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 158/314] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:41:16 2022] GET /compute/v2.1/servers/60273216-f2ed-46cf-8836-1d85335d8920 => generated 1501 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:41:16.738385 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-e5638922-62f3-40cb-932c-b628c681f02d tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:41:16.738988 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-e5638922-62f3-40cb-932c-b628c681f02d tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] [instance: 8620bffd-405f-41cc-9388-abdb301923d5] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:41:16.754929 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-e5638922-62f3-40cb-932c-b628c681f02d tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:16.754929 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-e5638922-62f3-40cb-932c-b628c681f02d tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:16.754929 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-e5638922-62f3-40cb-932c-b628c681f02d tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:16.754929 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-e5638922-62f3-40cb-932c-b628c681f02d tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:16.931408 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-e5638922-62f3-40cb-932c-b628c681f02d tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec8d131a9764028a096314a4ecd58f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9ff6952b014d0a9abb28dcf0b818b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:41:16.946972 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-e5638922-62f3-40cb-932c-b628c681f02d tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] 10.222.0.66 "GET /compute/v2.1/servers/8620bffd-405f-41cc-9388-abdb301923d5" status: 200 len: 1516 microversion: 2.1 time: 0.211502 Aug 04 03:41:16.950461 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 157/315] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:41:16 2022] GET /compute/v2.1/servers/8620bffd-405f-41cc-9388-abdb301923d5 => generated 1516 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:41:17.277485 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [req-b3036279-c29f-4c91-9f0d-059589cfb257 req-2510c5a8-eec7-4e47-ad14-d4335ee7f589 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e", "name": "network-vif-deleted", "tag": "5a965454-938f-4b0b-a81b-3e2875b1b5f6"}]} {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 03:41:17.298672 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [req-b3036279-c29f-4c91-9f0d-059589cfb257 req-2510c5a8-eec7-4e47-ad14-d4335ee7f589 service nova] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:17.298672 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [req-b3036279-c29f-4c91-9f0d-059589cfb257 req-2510c5a8-eec7-4e47-ad14-d4335ee7f589 service nova] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:17.312178 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.compute.server_external_events [req-b3036279-c29f-4c91-9f0d-059589cfb257 req-2510c5a8-eec7-4e47-ad14-d4335ee7f589 service nova] Creating event network-vif-deleted:5a965454-938f-4b0b-a81b-3e2875b1b5f6 for instance f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e on hv-cinder-73306 Aug 04 03:41:17.318698 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [req-b3036279-c29f-4c91-9f0d-059589cfb257 req-2510c5a8-eec7-4e47-ad14-d4335ee7f589 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046383 Aug 04 03:41:17.319515 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 159/316] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 03:41:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 03:41:17.361670 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-8577fb11-aa89-432a-80a8-6adbd4f7390f tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:41:17.362272 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-8577fb11-aa89-432a-80a8-6adbd4f7390f tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] [instance: a6df3631-d967-4c3f-bbf4-e7512466721d] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:41:17.369919 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-8577fb11-aa89-432a-80a8-6adbd4f7390f tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:17.370662 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-8577fb11-aa89-432a-80a8-6adbd4f7390f tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:17.371442 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-8577fb11-aa89-432a-80a8-6adbd4f7390f tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:17.371877 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-8577fb11-aa89-432a-80a8-6adbd4f7390f tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:17.400880 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-8577fb11-aa89-432a-80a8-6adbd4f7390f tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] [instance: a6df3631-d967-4c3f-bbf4-e7512466721d] Going to try to terminate instance {{(pid=130262) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 03:41:17.432497 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-7dab1551-d84f-48dd-ab25-61cbd29fc2ad tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:41:17.433329 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-7dab1551-d84f-48dd-ab25-61cbd29fc2ad tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] [instance: f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:41:17.440006 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-7dab1551-d84f-48dd-ab25-61cbd29fc2ad tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:17.440550 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-7dab1551-d84f-48dd-ab25-61cbd29fc2ad tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:17.444361 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-7dab1551-d84f-48dd-ab25-61cbd29fc2ad tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:17.444829 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-7dab1551-d84f-48dd-ab25-61cbd29fc2ad tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:17.527186 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-7dab1551-d84f-48dd-ab25-61cbd29fc2ad tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f4252210bd412ba24305b00a6e77b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a97e25e7eae402f8f5c4222019ed87c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:41:17.535909 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-7dab1551-d84f-48dd-ab25-61cbd29fc2ad tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] 10.222.0.66 "GET /compute/v2.1/servers/f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e" status: 200 len: 1344 microversion: 2.1 time: 0.111395 Aug 04 03:41:17.537364 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 160/317] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:41:17 2022] GET /compute/v2.1/servers/f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e => generated 1344 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:41:17.773696 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-8577fb11-aa89-432a-80a8-6adbd4f7390f tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] 10.222.0.66 "DELETE /compute/v2.1/servers/a6df3631-d967-4c3f-bbf4-e7512466721d" status: 204 len: 0 microversion: 2.1 time: 0.417006 Aug 04 03:41:17.776296 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 158/318] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 03:41:17 2022] DELETE /compute/v2.1/servers/a6df3631-d967-4c3f-bbf4-e7512466721d => generated 0 bytes in 421 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 03:41:17.786197 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-50059353-5ed1-4007-b4b2-26825764296a tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:41:17.791501 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-50059353-5ed1-4007-b4b2-26825764296a tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] [instance: a6df3631-d967-4c3f-bbf4-e7512466721d] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:41:17.794619 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-50059353-5ed1-4007-b4b2-26825764296a tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:17.795070 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-50059353-5ed1-4007-b4b2-26825764296a tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:17.795848 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-50059353-5ed1-4007-b4b2-26825764296a tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:17.796484 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-50059353-5ed1-4007-b4b2-26825764296a tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:17.936824 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-50059353-5ed1-4007-b4b2-26825764296a tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8a3eed3ee0b42f69948aced53729d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4daab5960f4c98874faea2066b1909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:41:17.944505 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-50059353-5ed1-4007-b4b2-26825764296a tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] 10.222.0.66 "GET /compute/v2.1/servers/a6df3631-d967-4c3f-bbf4-e7512466721d" status: 200 len: 1504 microversion: 2.1 time: 0.163386 Aug 04 03:41:17.945238 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 161/319] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:41:17 2022] GET /compute/v2.1/servers/a6df3631-d967-4c3f-bbf4-e7512466721d => generated 1504 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:41:18.560882 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-ddfecaeb-0174-460b-94e2-3e86bef37657 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:41:18.561532 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-ddfecaeb-0174-460b-94e2-3e86bef37657 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] [instance: f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:41:18.567431 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-ddfecaeb-0174-460b-94e2-3e86bef37657 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:18.567869 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-ddfecaeb-0174-460b-94e2-3e86bef37657 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:18.568616 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-ddfecaeb-0174-460b-94e2-3e86bef37657 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:18.569043 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-ddfecaeb-0174-460b-94e2-3e86bef37657 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:18.632059 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-ddfecaeb-0174-460b-94e2-3e86bef37657 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f4252210bd412ba24305b00a6e77b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a97e25e7eae402f8f5c4222019ed87c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:41:18.641182 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-ddfecaeb-0174-460b-94e2-3e86bef37657 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] 10.222.0.66 "GET /compute/v2.1/servers/f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e" status: 200 len: 1344 microversion: 2.1 time: 0.085367 Aug 04 03:41:18.641784 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 159/320] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:41:18 2022] GET /compute/v2.1/servers/f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e => generated 1344 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:41:18.967783 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-24a7c58f-15b9-4afb-8989-c795641db4c5 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:41:18.968484 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-24a7c58f-15b9-4afb-8989-c795641db4c5 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] [instance: a6df3631-d967-4c3f-bbf4-e7512466721d] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:41:18.975646 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-24a7c58f-15b9-4afb-8989-c795641db4c5 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:18.976101 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-24a7c58f-15b9-4afb-8989-c795641db4c5 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:18.977966 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-24a7c58f-15b9-4afb-8989-c795641db4c5 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:18.978739 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-24a7c58f-15b9-4afb-8989-c795641db4c5 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:19.116836 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-24a7c58f-15b9-4afb-8989-c795641db4c5 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8a3eed3ee0b42f69948aced53729d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4daab5960f4c98874faea2066b1909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:41:19.124978 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-24a7c58f-15b9-4afb-8989-c795641db4c5 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] 10.222.0.66 "GET /compute/v2.1/servers/a6df3631-d967-4c3f-bbf4-e7512466721d" status: 200 len: 1504 microversion: 2.1 time: 0.161312 Aug 04 03:41:19.125576 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 162/321] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:41:18 2022] GET /compute/v2.1/servers/a6df3631-d967-4c3f-bbf4-e7512466721d => generated 1504 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:41:19.662850 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-4c687467-9301-46ba-af3e-a6fe07db8a84 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:41:19.663465 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-4c687467-9301-46ba-af3e-a6fe07db8a84 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] [instance: f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:41:19.670023 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-4c687467-9301-46ba-af3e-a6fe07db8a84 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:19.670787 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-4c687467-9301-46ba-af3e-a6fe07db8a84 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:19.671853 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-4c687467-9301-46ba-af3e-a6fe07db8a84 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:19.672606 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-4c687467-9301-46ba-af3e-a6fe07db8a84 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:19.730704 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-4c687467-9301-46ba-af3e-a6fe07db8a84 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:19.730704 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-4c687467-9301-46ba-af3e-a6fe07db8a84 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:19.730704 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.objects.instance [None req-4c687467-9301-46ba-af3e-a6fe07db8a84 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lazy-loading 'fault' on Instance uuid f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e {{(pid=130262) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 03:41:19.783388 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-4c687467-9301-46ba-af3e-a6fe07db8a84 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9f4252210bd412ba24305b00a6e77b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a97e25e7eae402f8f5c4222019ed87c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:41:19.793459 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-4c687467-9301-46ba-af3e-a6fe07db8a84 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] 10.222.0.66 "GET /compute/v2.1/servers/f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e" status: 200 len: 1349 microversion: 2.1 time: 0.134763 Aug 04 03:41:19.794279 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 160/322] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:41:19 2022] GET /compute/v2.1/servers/f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e => generated 1349 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:41:20.146966 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-002f7375-9ba5-47fb-8ba8-845cae98de62 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:41:20.147594 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-002f7375-9ba5-47fb-8ba8-845cae98de62 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] [instance: a6df3631-d967-4c3f-bbf4-e7512466721d] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:41:20.156322 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-002f7375-9ba5-47fb-8ba8-845cae98de62 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:20.157007 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-002f7375-9ba5-47fb-8ba8-845cae98de62 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:20.158068 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-002f7375-9ba5-47fb-8ba8-845cae98de62 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:20.158904 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-002f7375-9ba5-47fb-8ba8-845cae98de62 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:20.172612 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [req-59d85fe4-083c-4bec-b7d3-6b39e35f512a req-bf7904a7-71ee-45f9-90a5-345ef21bd922 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6df3631-d967-4c3f-bbf4-e7512466721d", "name": "network-vif-deleted", "tag": "1d15fda8-15f0-45d4-abac-832a2d5e11df"}]} {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 03:41:20.189178 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [req-59d85fe4-083c-4bec-b7d3-6b39e35f512a req-bf7904a7-71ee-45f9-90a5-345ef21bd922 service nova] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:20.189178 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [req-59d85fe4-083c-4bec-b7d3-6b39e35f512a req-bf7904a7-71ee-45f9-90a5-345ef21bd922 service nova] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:20.202418 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.compute.server_external_events [req-59d85fe4-083c-4bec-b7d3-6b39e35f512a req-bf7904a7-71ee-45f9-90a5-345ef21bd922 service nova] Creating event network-vif-deleted:1d15fda8-15f0-45d4-abac-832a2d5e11df for instance a6df3631-d967-4c3f-bbf4-e7512466721d on hv-cinder-73306 Aug 04 03:41:20.209572 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [req-59d85fe4-083c-4bec-b7d3-6b39e35f512a req-bf7904a7-71ee-45f9-90a5-345ef21bd922 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040568 Aug 04 03:41:20.216175 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 161/323] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 03:41:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 03:41:20.239402 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-002f7375-9ba5-47fb-8ba8-845cae98de62 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8a3eed3ee0b42f69948aced53729d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4daab5960f4c98874faea2066b1909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:41:20.248241 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-002f7375-9ba5-47fb-8ba8-845cae98de62 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] 10.222.0.66 "GET /compute/v2.1/servers/a6df3631-d967-4c3f-bbf4-e7512466721d" status: 200 len: 1462 microversion: 2.1 time: 0.105408 Aug 04 03:41:20.253499 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 163/324] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:41:20 2022] GET /compute/v2.1/servers/a6df3631-d967-4c3f-bbf4-e7512466721d => generated 1462 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:41:20.266718 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-d34940fc-235c-4674-9eb2-c7c232f298fb tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 03:41:20.268962 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-d34940fc-235c-4674-9eb2-c7c232f298fb tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] [instance: 8620bffd-405f-41cc-9388-abdb301923d5] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:41:20.275140 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-d34940fc-235c-4674-9eb2-c7c232f298fb tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:20.275622 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-d34940fc-235c-4674-9eb2-c7c232f298fb tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:20.276383 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-d34940fc-235c-4674-9eb2-c7c232f298fb tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:20.276810 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-d34940fc-235c-4674-9eb2-c7c232f298fb tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:20.299368 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.objects.instance [None req-d34940fc-235c-4674-9eb2-c7c232f298fb tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lazy-loading 'flavor' on Instance uuid 8620bffd-405f-41cc-9388-abdb301923d5 {{(pid=130262) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 03:41:20.678429 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-d34940fc-235c-4674-9eb2-c7c232f298fb tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] 10.222.0.66 "POST /compute/v2.1/servers/8620bffd-405f-41cc-9388-abdb301923d5/action" status: 200 len: 32 microversion: 2.1 time: 0.415866 Aug 04 03:41:20.679054 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 162/325] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 03:41:20 2022] POST /compute/v2.1/servers/8620bffd-405f-41cc-9388-abdb301923d5/action => generated 32 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 03:41:20.688845 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-cc2bc2ee-a9c6-4005-85c1-cc241dea0264 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:41:20.689516 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-cc2bc2ee-a9c6-4005-85c1-cc241dea0264 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] [instance: 8620bffd-405f-41cc-9388-abdb301923d5] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:41:20.695692 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-cc2bc2ee-a9c6-4005-85c1-cc241dea0264 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:20.696139 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-cc2bc2ee-a9c6-4005-85c1-cc241dea0264 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:20.696927 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-cc2bc2ee-a9c6-4005-85c1-cc241dea0264 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:20.697979 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-cc2bc2ee-a9c6-4005-85c1-cc241dea0264 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:20.818859 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-2b1057ec-e1e7-4740-a482-c868ac1adbd4 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:41:20.819654 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-2b1057ec-e1e7-4740-a482-c868ac1adbd4 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] [instance: f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:41:20.828407 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-2b1057ec-e1e7-4740-a482-c868ac1adbd4 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:20.829013 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-2b1057ec-e1e7-4740-a482-c868ac1adbd4 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:20.829827 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-2b1057ec-e1e7-4740-a482-c868ac1adbd4 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:20.830354 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-2b1057ec-e1e7-4740-a482-c868ac1adbd4 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:20.847062 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.wsgi [None req-2b1057ec-e1e7-4740-a482-c868ac1adbd4 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] HTTP exception thrown: Instance f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e could not be found. Aug 04 03:41:20.852012 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-2b1057ec-e1e7-4740-a482-c868ac1adbd4 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Request method failure captured: Aug 04 03:41:20.852012 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: request: GET /compute/v2.1/servers/f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e HTTP/1.1 Aug 04 03:41:20.852012 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: Accept: application/json Aug 04 03:41:20.852012 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: Accept-Encoding: identity Aug 04 03:41:20.852012 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: Connection: close Aug 04 03:41:20.852012 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: Content-Length: 0 Aug 04 03:41:20.852012 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: Content-Type: application/json Aug 04 03:41:20.852012 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: Host: 10.222.0.66 Aug 04 03:41:20.852012 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: Openstack-System-Scope: None Aug 04 03:41:20.852012 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: User-Agent: python-urllib3/1.26.11 Aug 04 03:41:20.852012 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Auth-Token: gAAAAABi6z9gzS6yG_TBbD0v4hG4GrVcDdpU5pSrQJxFDGogeiZSQNP8j_Y4CLa_IkHm1EG8kdqWMR0kMfPqoM-OAh__5eO2t6x8EM-IHaxYa_6Thibxo0JoZsW2Vy42jSXzl0bfB0k8yX2dlQqKWaJfCxKObxi2PzM-U_LLRZwWvHMpKxEI2dI Aug 04 03:41:20.852012 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Domain-Id: None Aug 04 03:41:20.852012 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Domain-Name: None Aug 04 03:41:20.852012 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Identity-Status: Confirmed Aug 04 03:41:20.852012 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Is-Admin-Project: True Aug 04 03:41:20.852012 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Project-Domain-Id: default Aug 04 03:41:20.852012 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Project-Domain-Name: Default Aug 04 03:41:20.852012 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Project-Id: 8a97e25e7eae402f8f5c4222019ed87c Aug 04 03:41:20.852012 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Project-Name: tempest-DeleteServersTestJSON-1714127186 Aug 04 03:41:20.852012 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Role: member,reader Aug 04 03:41:20.852012 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Roles: member,reader Aug 04 03:41:20.856357 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/8a97e25e7eae402f8f5c4222019ed87c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/8a97e25e7eae402f8f5c4222019ed87c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/8a97e25e7eae402f8f5c4222019ed87c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_8a97e25e7eae402f8f5c4222019ed87c"}]}] Aug 04 03:41:20.856357 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Tenant: tempest-DeleteServersTestJSON-1714127186 Aug 04 03:41:20.856357 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Tenant-Id: 8a97e25e7eae402f8f5c4222019ed87c Aug 04 03:41:20.856357 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Tenant-Name: tempest-DeleteServersTestJSON-1714127186 Aug 04 03:41:20.856357 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-User: tempest-DeleteServersTestJSON-1714127186-project Aug 04 03:41:20.856357 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-User-Domain-Id: default Aug 04 03:41:20.856357 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-User-Domain-Name: Default Aug 04 03:41:20.856357 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-User-Id: d9f4252210bd412ba24305b00a6e77b4 Aug 04 03:41:20.856357 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-User-Name: tempest-DeleteServersTestJSON-1714127186-project Aug 04 03:41:20.856357 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: method: > Aug 04 03:41:20.856357 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: exception: Instance f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e could not be found. Aug 04 03:41:20.856357 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: action_args: {'id': 'f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e'} Aug 04 03:41:20.857473 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 03:41:20.857473 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 03:41:20.857473 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 03:41:20.857473 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 03:41:20.857473 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 03:41:20.857473 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 03:41:20.857473 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 03:41:20.857473 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 03:41:20.857473 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 03:41:20.857473 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 03:41:20.857473 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e could not be found. Aug 04 03:41:20.857473 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi Aug 04 03:41:20.857473 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 03:41:20.857473 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi Aug 04 03:41:20.857473 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 03:41:20.857473 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 03:41:20.857473 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 03:41:20.857473 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 03:41:20.857473 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 03:41:20.857473 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 03:41:20.858694 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 03:41:20.858694 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 03:41:20.858694 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 03:41:20.858694 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 03:41:20.858694 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 03:41:20.858694 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 03:41:20.858694 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 03:41:20.858694 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e could not be found. Aug 04 03:41:20.858694 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi Aug 04 03:41:20.858694 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 03:41:20.858694 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi Aug 04 03:41:20.858694 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 03:41:20.858694 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 03:41:20.858694 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 03:41:20.858694 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 03:41:20.858694 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 03:41:20.858694 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e could not be found. Aug 04 03:41:20.858694 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi Aug 04 03:41:20.861932 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-2b1057ec-e1e7-4740-a482-c868ac1adbd4 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Returning 404 to user: Instance f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e could not be found. {{(pid=130262) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 03:41:20.861932 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-2b1057ec-e1e7-4740-a482-c868ac1adbd4 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] 10.222.0.66 "GET /compute/v2.1/servers/f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e" status: 404 len: 111 microversion: 2.1 time: 0.039674 Aug 04 03:41:20.861932 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 163/326] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:41:20 2022] GET /compute/v2.1/servers/f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 03:41:20.862272 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-cc2bc2ee-a9c6-4005-85c1-cc241dea0264 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec8d131a9764028a096314a4ecd58f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9ff6952b014d0a9abb28dcf0b818b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:41:20.868700 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-cc2bc2ee-a9c6-4005-85c1-cc241dea0264 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] 10.222.0.66 "GET /compute/v2.1/servers/8620bffd-405f-41cc-9388-abdb301923d5" status: 200 len: 1522 microversion: 2.1 time: 0.183678 Aug 04 03:41:20.870099 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 164/327] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:41:20 2022] GET /compute/v2.1/servers/8620bffd-405f-41cc-9388-abdb301923d5 => generated 1522 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:41:21.021599 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-0b2f2e31-3b0e-4fae-825c-bec6f4725f52 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:41:21.024016 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-0b2f2e31-3b0e-4fae-825c-bec6f4725f52 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] [instance: f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:41:21.031135 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-0b2f2e31-3b0e-4fae-825c-bec6f4725f52 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:21.031794 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-0b2f2e31-3b0e-4fae-825c-bec6f4725f52 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:21.032563 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-0b2f2e31-3b0e-4fae-825c-bec6f4725f52 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:21.032994 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-0b2f2e31-3b0e-4fae-825c-bec6f4725f52 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:21.046259 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.wsgi [None req-0b2f2e31-3b0e-4fae-825c-bec6f4725f52 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] HTTP exception thrown: Instance f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e could not be found. Aug 04 03:41:21.048061 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-0b2f2e31-3b0e-4fae-825c-bec6f4725f52 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Request method failure captured: Aug 04 03:41:21.048061 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: request: GET /compute/v2.1/servers/f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e/os-volume_attachments HTTP/1.1 Aug 04 03:41:21.048061 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: Accept: application/json Aug 04 03:41:21.048061 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: Accept-Encoding: identity Aug 04 03:41:21.048061 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: Connection: close Aug 04 03:41:21.048061 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: Content-Length: 0 Aug 04 03:41:21.048061 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: Content-Type: application/json Aug 04 03:41:21.048061 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: Host: 10.222.0.66 Aug 04 03:41:21.048061 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: Openstack-System-Scope: None Aug 04 03:41:21.048061 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: User-Agent: python-urllib3/1.26.11 Aug 04 03:41:21.048061 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Auth-Token: gAAAAABi6z9gzS6yG_TBbD0v4hG4GrVcDdpU5pSrQJxFDGogeiZSQNP8j_Y4CLa_IkHm1EG8kdqWMR0kMfPqoM-OAh__5eO2t6x8EM-IHaxYa_6Thibxo0JoZsW2Vy42jSXzl0bfB0k8yX2dlQqKWaJfCxKObxi2PzM-U_LLRZwWvHMpKxEI2dI Aug 04 03:41:21.048061 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Domain-Id: None Aug 04 03:41:21.048061 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Domain-Name: None Aug 04 03:41:21.048061 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Identity-Status: Confirmed Aug 04 03:41:21.048061 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Is-Admin-Project: True Aug 04 03:41:21.048061 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Project-Domain-Id: default Aug 04 03:41:21.048061 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Project-Domain-Name: Default Aug 04 03:41:21.048061 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Project-Id: 8a97e25e7eae402f8f5c4222019ed87c Aug 04 03:41:21.048061 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Project-Name: tempest-DeleteServersTestJSON-1714127186 Aug 04 03:41:21.048061 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Role: member,reader Aug 04 03:41:21.048061 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Roles: member,reader Aug 04 03:41:21.049656 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/8a97e25e7eae402f8f5c4222019ed87c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/8a97e25e7eae402f8f5c4222019ed87c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/8a97e25e7eae402f8f5c4222019ed87c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_8a97e25e7eae402f8f5c4222019ed87c"}]}] Aug 04 03:41:21.049656 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Tenant: tempest-DeleteServersTestJSON-1714127186 Aug 04 03:41:21.049656 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Tenant-Id: 8a97e25e7eae402f8f5c4222019ed87c Aug 04 03:41:21.049656 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Tenant-Name: tempest-DeleteServersTestJSON-1714127186 Aug 04 03:41:21.049656 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-User: tempest-DeleteServersTestJSON-1714127186-project Aug 04 03:41:21.049656 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-User-Domain-Id: default Aug 04 03:41:21.049656 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-User-Domain-Name: Default Aug 04 03:41:21.049656 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-User-Id: d9f4252210bd412ba24305b00a6e77b4 Aug 04 03:41:21.049656 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-User-Name: tempest-DeleteServersTestJSON-1714127186-project Aug 04 03:41:21.049656 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: method: > Aug 04 03:41:21.049656 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: exception: Instance f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e could not be found. Aug 04 03:41:21.049656 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: action_args: {'server_id': 'f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e'} Aug 04 03:41:21.050763 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 03:41:21.050763 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 03:41:21.050763 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 03:41:21.050763 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 03:41:21.050763 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 03:41:21.050763 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 03:41:21.050763 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 03:41:21.050763 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 03:41:21.050763 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 03:41:21.050763 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 03:41:21.050763 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e could not be found. Aug 04 03:41:21.050763 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi Aug 04 03:41:21.050763 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 03:41:21.050763 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi Aug 04 03:41:21.050763 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 03:41:21.050763 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 03:41:21.050763 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 03:41:21.050763 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 03:41:21.050763 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 03:41:21.050763 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 03:41:21.052015 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 03:41:21.052015 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 04 03:41:21.052015 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 03:41:21.052015 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 04 03:41:21.052015 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 03:41:21.052015 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 04 03:41:21.052015 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 04 03:41:21.052015 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 03:41:21.052015 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 03:41:21.052015 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e could not be found. Aug 04 03:41:21.052015 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi Aug 04 03:41:21.052015 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 03:41:21.052015 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi Aug 04 03:41:21.052015 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 03:41:21.052015 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 03:41:21.052015 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 03:41:21.052015 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 03:41:21.052015 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 03:41:21.052015 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e could not be found. Aug 04 03:41:21.052015 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi Aug 04 03:41:21.053500 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-0b2f2e31-3b0e-4fae-825c-bec6f4725f52 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Returning 404 to user: Instance f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e could not be found. {{(pid=130262) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 03:41:21.054059 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-0b2f2e31-3b0e-4fae-825c-bec6f4725f52 tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] 10.222.0.66 "GET /compute/v2.1/servers/f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.038853 Aug 04 03:41:21.054594 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 164/328] 10.222.0.66 () {58 vars in 1302 bytes} [Thu Aug 4 03:41:21 2022] GET /compute/v2.1/servers/f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e/os-volume_attachments => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 03:41:21.269306 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-19a4809b-6da1-4aef-bdd7-0c5405cd86a0 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:41:21.269919 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-19a4809b-6da1-4aef-bdd7-0c5405cd86a0 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] [instance: a6df3631-d967-4c3f-bbf4-e7512466721d] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:41:21.277612 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-19a4809b-6da1-4aef-bdd7-0c5405cd86a0 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:21.278045 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-19a4809b-6da1-4aef-bdd7-0c5405cd86a0 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:21.281273 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-19a4809b-6da1-4aef-bdd7-0c5405cd86a0 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:21.281710 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-19a4809b-6da1-4aef-bdd7-0c5405cd86a0 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:21.319247 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-19a4809b-6da1-4aef-bdd7-0c5405cd86a0 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:21.319696 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-19a4809b-6da1-4aef-bdd7-0c5405cd86a0 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:21.320270 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.objects.instance [None req-19a4809b-6da1-4aef-bdd7-0c5405cd86a0 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lazy-loading 'fault' on Instance uuid a6df3631-d967-4c3f-bbf4-e7512466721d {{(pid=130263) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 03:41:21.373573 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-19a4809b-6da1-4aef-bdd7-0c5405cd86a0 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8a3eed3ee0b42f69948aced53729d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4daab5960f4c98874faea2066b1909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:41:21.382465 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-19a4809b-6da1-4aef-bdd7-0c5405cd86a0 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] 10.222.0.66 "GET /compute/v2.1/servers/a6df3631-d967-4c3f-bbf4-e7512466721d" status: 200 len: 1304 microversion: 2.1 time: 0.116939 Aug 04 03:41:21.383227 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 165/329] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:41:21 2022] GET /compute/v2.1/servers/a6df3631-d967-4c3f-bbf4-e7512466721d => generated 1304 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:41:21.891638 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-189a6945-48b8-4302-8de2-a0ad2292c0c5 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:41:21.892257 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-189a6945-48b8-4302-8de2-a0ad2292c0c5 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] [instance: 8620bffd-405f-41cc-9388-abdb301923d5] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:41:21.898279 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-189a6945-48b8-4302-8de2-a0ad2292c0c5 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:21.898726 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-189a6945-48b8-4302-8de2-a0ad2292c0c5 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:21.899602 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-189a6945-48b8-4302-8de2-a0ad2292c0c5 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:21.900068 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-189a6945-48b8-4302-8de2-a0ad2292c0c5 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:22.034910 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-189a6945-48b8-4302-8de2-a0ad2292c0c5 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec8d131a9764028a096314a4ecd58f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9ff6952b014d0a9abb28dcf0b818b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:41:22.038384 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG dbcounter [-] [130262] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=130262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:41:22.042674 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-189a6945-48b8-4302-8de2-a0ad2292c0c5 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] 10.222.0.66 "GET /compute/v2.1/servers/8620bffd-405f-41cc-9388-abdb301923d5" status: 200 len: 1522 microversion: 2.1 time: 0.155046 Aug 04 03:41:22.043235 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 165/330] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:41:21 2022] GET /compute/v2.1/servers/8620bffd-405f-41cc-9388-abdb301923d5 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:41:22.411026 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-d5704079-c86b-4e93-bf18-163f5a38b220 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:41:22.412475 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-d5704079-c86b-4e93-bf18-163f5a38b220 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] [instance: a6df3631-d967-4c3f-bbf4-e7512466721d] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:41:22.418953 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-d5704079-c86b-4e93-bf18-163f5a38b220 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:22.419410 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-d5704079-c86b-4e93-bf18-163f5a38b220 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:22.420173 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-d5704079-c86b-4e93-bf18-163f5a38b220 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:22.420628 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-d5704079-c86b-4e93-bf18-163f5a38b220 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:22.451954 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-d5704079-c86b-4e93-bf18-163f5a38b220 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:22.452485 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-d5704079-c86b-4e93-bf18-163f5a38b220 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:22.452935 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.objects.instance [None req-d5704079-c86b-4e93-bf18-163f5a38b220 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lazy-loading 'fault' on Instance uuid a6df3631-d967-4c3f-bbf4-e7512466721d {{(pid=130263) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 03:41:22.502470 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-d5704079-c86b-4e93-bf18-163f5a38b220 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8a3eed3ee0b42f69948aced53729d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4daab5960f4c98874faea2066b1909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:41:22.506490 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG dbcounter [-] [130263] Writing DB stats nova_cell1:SELECT=100 {{(pid=130263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:41:22.511893 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-d5704079-c86b-4e93-bf18-163f5a38b220 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] 10.222.0.66 "GET /compute/v2.1/servers/a6df3631-d967-4c3f-bbf4-e7512466721d" status: 200 len: 1304 microversion: 2.1 time: 0.104293 Aug 04 03:41:22.512467 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 166/331] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:41:22 2022] GET /compute/v2.1/servers/a6df3631-d967-4c3f-bbf4-e7512466721d => generated 1304 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:41:23.063490 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-0b8836b4-2196-4866-97d0-7a44e9dedb78 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:41:23.064097 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-0b8836b4-2196-4866-97d0-7a44e9dedb78 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] [instance: 8620bffd-405f-41cc-9388-abdb301923d5] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:41:23.070848 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-0b8836b4-2196-4866-97d0-7a44e9dedb78 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:23.071298 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-0b8836b4-2196-4866-97d0-7a44e9dedb78 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:23.072772 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-0b8836b4-2196-4866-97d0-7a44e9dedb78 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:23.073260 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-0b8836b4-2196-4866-97d0-7a44e9dedb78 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:23.208650 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-0b8836b4-2196-4866-97d0-7a44e9dedb78 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec8d131a9764028a096314a4ecd58f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9ff6952b014d0a9abb28dcf0b818b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:41:23.217619 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-0b8836b4-2196-4866-97d0-7a44e9dedb78 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] 10.222.0.66 "GET /compute/v2.1/servers/8620bffd-405f-41cc-9388-abdb301923d5" status: 200 len: 1522 microversion: 2.1 time: 0.158000 Aug 04 03:41:23.218747 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 166/332] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:41:23 2022] GET /compute/v2.1/servers/8620bffd-405f-41cc-9388-abdb301923d5 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:41:23.547179 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-6c95e39f-25ed-4395-9280-09d0f12f1799 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:41:23.547911 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-6c95e39f-25ed-4395-9280-09d0f12f1799 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] [instance: a6df3631-d967-4c3f-bbf4-e7512466721d] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:41:23.555652 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-6c95e39f-25ed-4395-9280-09d0f12f1799 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:23.556191 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-6c95e39f-25ed-4395-9280-09d0f12f1799 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:23.557720 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-6c95e39f-25ed-4395-9280-09d0f12f1799 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:23.558283 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-6c95e39f-25ed-4395-9280-09d0f12f1799 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:23.599865 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-6c95e39f-25ed-4395-9280-09d0f12f1799 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:23.600343 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-6c95e39f-25ed-4395-9280-09d0f12f1799 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:23.600794 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.objects.instance [None req-6c95e39f-25ed-4395-9280-09d0f12f1799 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lazy-loading 'fault' on Instance uuid a6df3631-d967-4c3f-bbf4-e7512466721d {{(pid=130263) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 03:41:23.645799 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-6c95e39f-25ed-4395-9280-09d0f12f1799 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8a3eed3ee0b42f69948aced53729d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4daab5960f4c98874faea2066b1909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:41:23.653632 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-6c95e39f-25ed-4395-9280-09d0f12f1799 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] 10.222.0.66 "GET /compute/v2.1/servers/a6df3631-d967-4c3f-bbf4-e7512466721d" status: 200 len: 1304 microversion: 2.1 time: 0.112519 Aug 04 03:41:23.654197 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 167/333] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:41:23 2022] GET /compute/v2.1/servers/a6df3631-d967-4c3f-bbf4-e7512466721d => generated 1304 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:41:24.239972 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-81cdf6a5-3f5b-47d4-b387-468959f76226 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:41:24.240575 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-81cdf6a5-3f5b-47d4-b387-468959f76226 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] [instance: 8620bffd-405f-41cc-9388-abdb301923d5] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:41:24.248298 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-81cdf6a5-3f5b-47d4-b387-468959f76226 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:24.248742 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-81cdf6a5-3f5b-47d4-b387-468959f76226 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:24.249523 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-81cdf6a5-3f5b-47d4-b387-468959f76226 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:24.249953 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-81cdf6a5-3f5b-47d4-b387-468959f76226 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:24.394387 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-81cdf6a5-3f5b-47d4-b387-468959f76226 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec8d131a9764028a096314a4ecd58f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9ff6952b014d0a9abb28dcf0b818b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:41:24.403319 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-81cdf6a5-3f5b-47d4-b387-468959f76226 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] 10.222.0.66 "GET /compute/v2.1/servers/8620bffd-405f-41cc-9388-abdb301923d5" status: 200 len: 1522 microversion: 2.1 time: 0.167817 Aug 04 03:41:24.404059 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 167/334] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:41:24 2022] GET /compute/v2.1/servers/8620bffd-405f-41cc-9388-abdb301923d5 => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:41:24.677254 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-395b8f90-5fa9-44a3-abb1-217a6f301e56 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:41:24.678560 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-395b8f90-5fa9-44a3-abb1-217a6f301e56 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] [instance: a6df3631-d967-4c3f-bbf4-e7512466721d] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:41:24.689052 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-395b8f90-5fa9-44a3-abb1-217a6f301e56 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:24.689899 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-395b8f90-5fa9-44a3-abb1-217a6f301e56 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:24.690543 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-395b8f90-5fa9-44a3-abb1-217a6f301e56 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:24.690979 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-395b8f90-5fa9-44a3-abb1-217a6f301e56 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:24.723714 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-395b8f90-5fa9-44a3-abb1-217a6f301e56 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:24.724159 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-395b8f90-5fa9-44a3-abb1-217a6f301e56 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:24.724605 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.objects.instance [None req-395b8f90-5fa9-44a3-abb1-217a6f301e56 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lazy-loading 'fault' on Instance uuid a6df3631-d967-4c3f-bbf4-e7512466721d {{(pid=130263) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 03:41:24.783247 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-395b8f90-5fa9-44a3-abb1-217a6f301e56 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8a3eed3ee0b42f69948aced53729d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4daab5960f4c98874faea2066b1909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:41:24.792942 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-395b8f90-5fa9-44a3-abb1-217a6f301e56 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] 10.222.0.66 "GET /compute/v2.1/servers/a6df3631-d967-4c3f-bbf4-e7512466721d" status: 200 len: 1304 microversion: 2.1 time: 0.121833 Aug 04 03:41:24.793828 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 168/335] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:41:24 2022] GET /compute/v2.1/servers/a6df3631-d967-4c3f-bbf4-e7512466721d => generated 1304 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:41:25.425989 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-8396ff02-9cd3-48c1-bed8-69ab626bc528 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:41:25.427780 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-8396ff02-9cd3-48c1-bed8-69ab626bc528 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] [instance: 8620bffd-405f-41cc-9388-abdb301923d5] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:41:25.437975 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-8396ff02-9cd3-48c1-bed8-69ab626bc528 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:25.440148 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-8396ff02-9cd3-48c1-bed8-69ab626bc528 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:25.440148 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-8396ff02-9cd3-48c1-bed8-69ab626bc528 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:25.440148 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-8396ff02-9cd3-48c1-bed8-69ab626bc528 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:25.611525 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-8396ff02-9cd3-48c1-bed8-69ab626bc528 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec8d131a9764028a096314a4ecd58f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9ff6952b014d0a9abb28dcf0b818b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:41:25.619443 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-8396ff02-9cd3-48c1-bed8-69ab626bc528 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] 10.222.0.66 "GET /compute/v2.1/servers/8620bffd-405f-41cc-9388-abdb301923d5" status: 200 len: 1522 microversion: 2.1 time: 0.197649 Aug 04 03:41:25.620293 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 168/336] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:41:25 2022] GET /compute/v2.1/servers/8620bffd-405f-41cc-9388-abdb301923d5 => generated 1522 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:41:25.699175 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-0850aab7-a486-4da5-861b-e4e3743b0d3a tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:41:25.699668 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-0850aab7-a486-4da5-861b-e4e3743b0d3a tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] [instance: f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:41:25.706450 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-0850aab7-a486-4da5-861b-e4e3743b0d3a tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:25.706891 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-0850aab7-a486-4da5-861b-e4e3743b0d3a tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:25.709039 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-0850aab7-a486-4da5-861b-e4e3743b0d3a tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:25.709439 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-0850aab7-a486-4da5-861b-e4e3743b0d3a tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:25.724186 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.wsgi [None req-0850aab7-a486-4da5-861b-e4e3743b0d3a tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] HTTP exception thrown: Instance f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e could not be found. Aug 04 03:41:25.730589 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-0850aab7-a486-4da5-861b-e4e3743b0d3a tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Request method failure captured: Aug 04 03:41:25.730589 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: request: DELETE /compute/v2.1/servers/f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e HTTP/1.1 Aug 04 03:41:25.730589 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Accept: application/json Aug 04 03:41:25.730589 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Accept-Encoding: identity Aug 04 03:41:25.730589 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Connection: close Aug 04 03:41:25.730589 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Content-Length: 0 Aug 04 03:41:25.730589 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Content-Type: application/json Aug 04 03:41:25.730589 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Host: 10.222.0.66 Aug 04 03:41:25.730589 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Openstack-System-Scope: None Aug 04 03:41:25.730589 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: User-Agent: python-urllib3/1.26.11 Aug 04 03:41:25.730589 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Auth-Token: gAAAAABi6z9gzS6yG_TBbD0v4hG4GrVcDdpU5pSrQJxFDGogeiZSQNP8j_Y4CLa_IkHm1EG8kdqWMR0kMfPqoM-OAh__5eO2t6x8EM-IHaxYa_6Thibxo0JoZsW2Vy42jSXzl0bfB0k8yX2dlQqKWaJfCxKObxi2PzM-U_LLRZwWvHMpKxEI2dI Aug 04 03:41:25.730589 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Domain-Id: None Aug 04 03:41:25.730589 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Domain-Name: None Aug 04 03:41:25.730589 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Identity-Status: Confirmed Aug 04 03:41:25.730589 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Is-Admin-Project: True Aug 04 03:41:25.730589 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Project-Domain-Id: default Aug 04 03:41:25.730589 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Project-Domain-Name: Default Aug 04 03:41:25.730589 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Project-Id: 8a97e25e7eae402f8f5c4222019ed87c Aug 04 03:41:25.730589 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Project-Name: tempest-DeleteServersTestJSON-1714127186 Aug 04 03:41:25.730589 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Role: member,reader Aug 04 03:41:25.730589 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Roles: member,reader Aug 04 03:41:25.732040 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/8a97e25e7eae402f8f5c4222019ed87c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/8a97e25e7eae402f8f5c4222019ed87c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/8a97e25e7eae402f8f5c4222019ed87c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_8a97e25e7eae402f8f5c4222019ed87c"}]}] Aug 04 03:41:25.732040 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Tenant: tempest-DeleteServersTestJSON-1714127186 Aug 04 03:41:25.732040 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Tenant-Id: 8a97e25e7eae402f8f5c4222019ed87c Aug 04 03:41:25.732040 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Tenant-Name: tempest-DeleteServersTestJSON-1714127186 Aug 04 03:41:25.732040 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-User: tempest-DeleteServersTestJSON-1714127186-project Aug 04 03:41:25.732040 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-User-Domain-Id: default Aug 04 03:41:25.732040 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-User-Domain-Name: Default Aug 04 03:41:25.732040 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-User-Id: d9f4252210bd412ba24305b00a6e77b4 Aug 04 03:41:25.732040 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-User-Name: tempest-DeleteServersTestJSON-1714127186-project Aug 04 03:41:25.732040 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: method: > Aug 04 03:41:25.732040 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: exception: Instance f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e could not be found. Aug 04 03:41:25.732040 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: action_args: {'id': 'f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e'} Aug 04 03:41:25.732850 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 03:41:25.732850 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 03:41:25.732850 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 03:41:25.732850 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 03:41:25.732850 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 03:41:25.732850 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 03:41:25.732850 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 03:41:25.732850 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 03:41:25.732850 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 03:41:25.732850 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 03:41:25.732850 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e could not be found. Aug 04 03:41:25.732850 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Aug 04 03:41:25.732850 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 03:41:25.732850 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Aug 04 03:41:25.732850 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 03:41:25.732850 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 03:41:25.732850 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 03:41:25.732850 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 03:41:25.732850 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 03:41:25.732850 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 03:41:25.733994 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 03:41:25.733994 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 03:41:25.733994 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 03:41:25.733994 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 03:41:25.733994 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 03:41:25.733994 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 03:41:25.733994 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 03:41:25.733994 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 03:41:25.733994 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 03:41:25.733994 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e could not be found. Aug 04 03:41:25.733994 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Aug 04 03:41:25.733994 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 03:41:25.733994 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Aug 04 03:41:25.733994 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 03:41:25.733994 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 03:41:25.733994 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 03:41:25.733994 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 03:41:25.733994 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 03:41:25.733994 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e could not be found. Aug 04 03:41:25.733994 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Aug 04 03:41:25.735340 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-0850aab7-a486-4da5-861b-e4e3743b0d3a tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Returning 404 to user: Instance f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e could not be found. {{(pid=130263) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 03:41:25.735340 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-0850aab7-a486-4da5-861b-e4e3743b0d3a tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] 10.222.0.66 "DELETE /compute/v2.1/servers/f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e" status: 404 len: 111 microversion: 2.1 time: 0.037319 Aug 04 03:41:25.735340 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 169/337] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 03:41:25 2022] DELETE /compute/v2.1/servers/f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 03:41:25.741704 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-5828cd63-bc3a-4d3b-bb8d-731b6afb161e tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:41:25.742316 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-5828cd63-bc3a-4d3b-bb8d-731b6afb161e tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] [instance: f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:41:25.751876 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-5828cd63-bc3a-4d3b-bb8d-731b6afb161e tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:25.752352 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-5828cd63-bc3a-4d3b-bb8d-731b6afb161e tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:25.753117 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-5828cd63-bc3a-4d3b-bb8d-731b6afb161e tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:25.753738 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-5828cd63-bc3a-4d3b-bb8d-731b6afb161e tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:25.817706 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-cf69b4ec-97c1-43ef-80d8-c15070c1de07 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:41:25.818536 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-cf69b4ec-97c1-43ef-80d8-c15070c1de07 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] [instance: a6df3631-d967-4c3f-bbf4-e7512466721d] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:41:25.838544 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-cf69b4ec-97c1-43ef-80d8-c15070c1de07 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:25.838544 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-cf69b4ec-97c1-43ef-80d8-c15070c1de07 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:25.838544 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-cf69b4ec-97c1-43ef-80d8-c15070c1de07 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:25.838544 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-cf69b4ec-97c1-43ef-80d8-c15070c1de07 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:25.846383 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.wsgi [None req-cf69b4ec-97c1-43ef-80d8-c15070c1de07 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] HTTP exception thrown: Instance a6df3631-d967-4c3f-bbf4-e7512466721d could not be found. Aug 04 03:41:25.848089 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-cf69b4ec-97c1-43ef-80d8-c15070c1de07 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Request method failure captured: Aug 04 03:41:25.848089 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: request: GET /compute/v2.1/servers/a6df3631-d967-4c3f-bbf4-e7512466721d HTTP/1.1 Aug 04 03:41:25.848089 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Accept: application/json Aug 04 03:41:25.848089 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Accept-Encoding: identity Aug 04 03:41:25.848089 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Connection: close Aug 04 03:41:25.848089 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Content-Length: 0 Aug 04 03:41:25.848089 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Content-Type: application/json Aug 04 03:41:25.848089 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Host: 10.222.0.66 Aug 04 03:41:25.848089 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Openstack-System-Scope: None Aug 04 03:41:25.848089 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: User-Agent: python-urllib3/1.26.11 Aug 04 03:41:25.848089 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Auth-Token: gAAAAABi6z-qEYzO33wR1ytEwZPdccOcO7toLG8-sBHogtriF87tP1yzrlM6aPDdtaOwaY7UIt2UKW7uUZduG8xb6Dt8T-qfCuwK8xYJnFs6KaNOVBR-4SgILbLRTyR0qUyoEQEzkmfJJKpe6JXB7B2qdCZxjKhbe6w3OQarPATLZJ4HlOMvIok Aug 04 03:41:25.848089 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Domain-Id: None Aug 04 03:41:25.848089 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Domain-Name: None Aug 04 03:41:25.848089 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Identity-Status: Confirmed Aug 04 03:41:25.848089 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Is-Admin-Project: True Aug 04 03:41:25.848089 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Project-Domain-Id: default Aug 04 03:41:25.848089 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Project-Domain-Name: Default Aug 04 03:41:25.848089 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Project-Id: 1c4daab5960f4c98874faea2066b1909 Aug 04 03:41:25.848089 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Project-Name: tempest-VolumesActionsTest-1014326987 Aug 04 03:41:25.848089 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Role: member,reader Aug 04 03:41:25.848089 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Roles: member,reader Aug 04 03:41:25.849557 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/1c4daab5960f4c98874faea2066b1909"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/1c4daab5960f4c98874faea2066b1909"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/1c4daab5960f4c98874faea2066b1909"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_1c4daab5960f4c98874faea2066b1909"}]}] Aug 04 03:41:25.849557 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Tenant: tempest-VolumesActionsTest-1014326987 Aug 04 03:41:25.849557 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Tenant-Id: 1c4daab5960f4c98874faea2066b1909 Aug 04 03:41:25.849557 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Tenant-Name: tempest-VolumesActionsTest-1014326987 Aug 04 03:41:25.849557 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-User: tempest-VolumesActionsTest-1014326987-project Aug 04 03:41:25.849557 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-User-Domain-Id: default Aug 04 03:41:25.849557 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-User-Domain-Name: Default Aug 04 03:41:25.849557 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-User-Id: d8a3eed3ee0b42f69948aced53729d6f Aug 04 03:41:25.849557 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-User-Name: tempest-VolumesActionsTest-1014326987-project Aug 04 03:41:25.849557 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: method: > Aug 04 03:41:25.849557 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: exception: Instance a6df3631-d967-4c3f-bbf4-e7512466721d could not be found. Aug 04 03:41:25.849557 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: action_args: {'id': 'a6df3631-d967-4c3f-bbf4-e7512466721d'} Aug 04 03:41:25.850349 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 03:41:25.850349 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 03:41:25.850349 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 03:41:25.850349 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 03:41:25.850349 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 03:41:25.850349 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 03:41:25.850349 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 03:41:25.850349 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 03:41:25.850349 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 03:41:25.850349 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 03:41:25.850349 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a6df3631-d967-4c3f-bbf4-e7512466721d could not be found. Aug 04 03:41:25.850349 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Aug 04 03:41:25.850349 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 03:41:25.850349 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Aug 04 03:41:25.850349 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 03:41:25.850349 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 03:41:25.850349 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 03:41:25.850349 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 03:41:25.850349 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 03:41:25.850349 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 03:41:25.851641 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 03:41:25.851641 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 03:41:25.851641 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 03:41:25.851641 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 03:41:25.851641 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 03:41:25.851641 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 03:41:25.851641 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 03:41:25.851641 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a6df3631-d967-4c3f-bbf4-e7512466721d could not be found. Aug 04 03:41:25.851641 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Aug 04 03:41:25.851641 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 03:41:25.851641 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Aug 04 03:41:25.851641 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 03:41:25.851641 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 03:41:25.851641 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 03:41:25.851641 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 03:41:25.851641 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 03:41:25.851641 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a6df3631-d967-4c3f-bbf4-e7512466721d could not be found. Aug 04 03:41:25.851641 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Aug 04 03:41:25.852782 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-cf69b4ec-97c1-43ef-80d8-c15070c1de07 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Returning 404 to user: Instance a6df3631-d967-4c3f-bbf4-e7512466721d could not be found. {{(pid=130263) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 03:41:25.852782 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-cf69b4ec-97c1-43ef-80d8-c15070c1de07 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] 10.222.0.66 "GET /compute/v2.1/servers/a6df3631-d967-4c3f-bbf4-e7512466721d" status: 404 len: 111 microversion: 2.1 time: 0.037264 Aug 04 03:41:25.852782 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 170/338] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:41:25 2022] GET /compute/v2.1/servers/a6df3631-d967-4c3f-bbf4-e7512466721d => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 03:41:25.921761 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.wsgi [None req-5828cd63-bc3a-4d3b-bb8d-731b6afb161e tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] HTTP exception thrown: Instance f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e could not be found. Aug 04 03:41:25.923405 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-5828cd63-bc3a-4d3b-bb8d-731b6afb161e tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Request method failure captured: Aug 04 03:41:25.923405 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: request: GET /compute/v2.1/servers/f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e HTTP/1.1 Aug 04 03:41:25.923405 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: Accept: application/json Aug 04 03:41:25.923405 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: Accept-Encoding: identity Aug 04 03:41:25.923405 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: Connection: close Aug 04 03:41:25.923405 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: Content-Length: 0 Aug 04 03:41:25.923405 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: Content-Type: application/json Aug 04 03:41:25.923405 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: Host: 10.222.0.66 Aug 04 03:41:25.923405 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: Openstack-System-Scope: None Aug 04 03:41:25.923405 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: User-Agent: python-urllib3/1.26.11 Aug 04 03:41:25.923405 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Auth-Token: gAAAAABi6z9gzS6yG_TBbD0v4hG4GrVcDdpU5pSrQJxFDGogeiZSQNP8j_Y4CLa_IkHm1EG8kdqWMR0kMfPqoM-OAh__5eO2t6x8EM-IHaxYa_6Thibxo0JoZsW2Vy42jSXzl0bfB0k8yX2dlQqKWaJfCxKObxi2PzM-U_LLRZwWvHMpKxEI2dI Aug 04 03:41:25.923405 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Domain-Id: None Aug 04 03:41:25.923405 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Domain-Name: None Aug 04 03:41:25.923405 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Identity-Status: Confirmed Aug 04 03:41:25.923405 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Is-Admin-Project: True Aug 04 03:41:25.923405 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Project-Domain-Id: default Aug 04 03:41:25.923405 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Project-Domain-Name: Default Aug 04 03:41:25.923405 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Project-Id: 8a97e25e7eae402f8f5c4222019ed87c Aug 04 03:41:25.923405 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Project-Name: tempest-DeleteServersTestJSON-1714127186 Aug 04 03:41:25.923405 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Role: member,reader Aug 04 03:41:25.923405 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Roles: member,reader Aug 04 03:41:25.924876 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/8a97e25e7eae402f8f5c4222019ed87c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/8a97e25e7eae402f8f5c4222019ed87c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/8a97e25e7eae402f8f5c4222019ed87c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_8a97e25e7eae402f8f5c4222019ed87c"}]}] Aug 04 03:41:25.924876 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Tenant: tempest-DeleteServersTestJSON-1714127186 Aug 04 03:41:25.924876 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Tenant-Id: 8a97e25e7eae402f8f5c4222019ed87c Aug 04 03:41:25.924876 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Tenant-Name: tempest-DeleteServersTestJSON-1714127186 Aug 04 03:41:25.924876 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-User: tempest-DeleteServersTestJSON-1714127186-project Aug 04 03:41:25.924876 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-User-Domain-Id: default Aug 04 03:41:25.924876 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-User-Domain-Name: Default Aug 04 03:41:25.924876 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-User-Id: d9f4252210bd412ba24305b00a6e77b4 Aug 04 03:41:25.924876 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-User-Name: tempest-DeleteServersTestJSON-1714127186-project Aug 04 03:41:25.924876 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: method: > Aug 04 03:41:25.924876 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: exception: Instance f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e could not be found. Aug 04 03:41:25.924876 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: action_args: {'id': 'f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e'} Aug 04 03:41:25.925720 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 03:41:25.925720 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 03:41:25.925720 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 03:41:25.925720 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 03:41:25.925720 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 03:41:25.925720 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 03:41:25.925720 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 03:41:25.925720 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 03:41:25.925720 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 03:41:25.925720 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 03:41:25.925720 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e could not be found. Aug 04 03:41:25.925720 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi Aug 04 03:41:25.925720 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 03:41:25.925720 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi Aug 04 03:41:25.925720 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 03:41:25.925720 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 03:41:25.925720 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 03:41:25.925720 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 03:41:25.925720 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 03:41:25.925720 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 03:41:25.926844 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 03:41:25.926844 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 03:41:25.926844 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 03:41:25.926844 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 03:41:25.926844 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 03:41:25.926844 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 03:41:25.926844 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 03:41:25.926844 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e could not be found. Aug 04 03:41:25.926844 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi Aug 04 03:41:25.926844 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 03:41:25.926844 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi Aug 04 03:41:25.926844 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 03:41:25.926844 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 03:41:25.926844 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 03:41:25.926844 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 03:41:25.926844 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 03:41:25.926844 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e could not be found. Aug 04 03:41:25.926844 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi Aug 04 03:41:25.928224 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-5828cd63-bc3a-4d3b-bb8d-731b6afb161e tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] Returning 404 to user: Instance f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e could not be found. {{(pid=130262) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 03:41:25.928224 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-5828cd63-bc3a-4d3b-bb8d-731b6afb161e tempest-DeleteServersTestJSON-1714127186 tempest-DeleteServersTestJSON-1714127186-project] 10.222.0.66 "GET /compute/v2.1/servers/f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e" status: 404 len: 111 microversion: 2.1 time: 0.187311 Aug 04 03:41:25.928224 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 169/339] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:41:25 2022] GET /compute/v2.1/servers/f8994ac7-c0e6-4109-826a-b7f9cd0a3f4e => generated 111 bytes in 189 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 03:41:26.055988 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-a810a9c5-530c-40df-ac4b-1bcb2cf627d7 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-2005372742", "imageRef": "0208f4b3-1d2f-42e4-a9b4-528bf5066fe1", "flavorRef": "452", "networks": [{"uuid": "71d0df0b-f280-493e-a1c3-1aab04d8626d"}]}} {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 03:41:26.117848 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.network.neutron [None req-a810a9c5-530c-40df-ac4b-1bcb2cf627d7 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] validate_networks() for [('71d0df0b-f280-493e-a1c3-1aab04d8626d', None, None, None, None, None)] {{(pid=130263) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 03:41:26.646632 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-bb658001-5e89-4f52-a90b-f139a90ec94a tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:41:26.647307 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-bb658001-5e89-4f52-a90b-f139a90ec94a tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] [instance: 8620bffd-405f-41cc-9388-abdb301923d5] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:41:26.653627 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-bb658001-5e89-4f52-a90b-f139a90ec94a tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:26.659303 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-bb658001-5e89-4f52-a90b-f139a90ec94a tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:26.659303 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-bb658001-5e89-4f52-a90b-f139a90ec94a tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:26.659303 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-bb658001-5e89-4f52-a90b-f139a90ec94a tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:27.067243 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-bb658001-5e89-4f52-a90b-f139a90ec94a tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec8d131a9764028a096314a4ecd58f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9ff6952b014d0a9abb28dcf0b818b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:41:27.076748 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-bb658001-5e89-4f52-a90b-f139a90ec94a tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] 10.222.0.66 "GET /compute/v2.1/servers/8620bffd-405f-41cc-9388-abdb301923d5" status: 200 len: 1522 microversion: 2.1 time: 0.433945 Aug 04 03:41:27.077503 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 170/340] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:41:26 2022] GET /compute/v2.1/servers/8620bffd-405f-41cc-9388-abdb301923d5 => generated 1522 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 03:41:27.147055 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.virt.hardware [None req-a810a9c5-530c-40df-ac4b-1bcb2cf627d7 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Flavor limits 0:0:0 {{(pid=130263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 03:41:27.148244 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.virt.hardware [None req-a810a9c5-530c-40df-ac4b-1bcb2cf627d7 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Image limits 0:0:0 {{(pid=130263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 03:41:27.149166 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.virt.hardware [None req-a810a9c5-530c-40df-ac4b-1bcb2cf627d7 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Flavor pref 0:0:0 {{(pid=130263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 03:41:27.149693 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.virt.hardware [None req-a810a9c5-530c-40df-ac4b-1bcb2cf627d7 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Image pref 0:0:0 {{(pid=130263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 03:41:27.150720 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.virt.hardware [None req-a810a9c5-530c-40df-ac4b-1bcb2cf627d7 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 03:41:27.163726 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-a810a9c5-530c-40df-ac4b-1bcb2cf627d7 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:27.164418 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-a810a9c5-530c-40df-ac4b-1bcb2cf627d7 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:27.166445 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-a810a9c5-530c-40df-ac4b-1bcb2cf627d7 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:27.170303 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-a810a9c5-530c-40df-ac4b-1bcb2cf627d7 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:27.189952 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.quota [None req-a810a9c5-530c-40df-ac4b-1bcb2cf627d7 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Getting quotas for project 1c4daab5960f4c98874faea2066b1909. Resources: {'instances', 'ram', 'cores'} {{(pid=130263) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 03:41:27.195424 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.quota [None req-a810a9c5-530c-40df-ac4b-1bcb2cf627d7 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Getting quotas for user d8a3eed3ee0b42f69948aced53729d6f and project 1c4daab5960f4c98874faea2066b1909. Resources: {'instances', 'ram', 'cores'} {{(pid=130263) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 03:41:27.210827 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-a810a9c5-530c-40df-ac4b-1bcb2cf627d7 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Going to run 1 instances... {{(pid=130263) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 03:41:27.214523 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-a810a9c5-530c-40df-ac4b-1bcb2cf627d7 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] [instance: 11b75ab4-ac6b-43cf-b7c4-b81b0101c6cb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0208f4b3-1d2f-42e4-a9b4-528bf5066fe1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130263) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 03:41:27.369777 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-a810a9c5-530c-40df-ac4b-1bcb2cf627d7 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.315036 Aug 04 03:41:27.369777 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 171/341] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 03:41:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 1316 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 03:41:27.379943 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-bd1bb1bc-59fd-463a-a9d5-28e5ab0d79ab tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:41:27.380979 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-bd1bb1bc-59fd-463a-a9d5-28e5ab0d79ab tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] [instance: 11b75ab4-ac6b-43cf-b7c4-b81b0101c6cb] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:41:27.494659 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-bd1bb1bc-59fd-463a-a9d5-28e5ab0d79ab tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8a3eed3ee0b42f69948aced53729d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4daab5960f4c98874faea2066b1909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:41:27.501588 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-bd1bb1bc-59fd-463a-a9d5-28e5ab0d79ab tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] 10.222.0.66 "GET /compute/v2.1/servers/11b75ab4-ac6b-43cf-b7c4-b81b0101c6cb" status: 200 len: 1214 microversion: 2.1 time: 0.125620 Aug 04 03:41:27.502144 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 171/342] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:41:27 2022] GET /compute/v2.1/servers/11b75ab4-ac6b-43cf-b7c4-b81b0101c6cb => generated 1214 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:41:28.099712 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-d3b754d4-cadd-4a37-bcac-beebb5239cc9 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:41:28.100684 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-d3b754d4-cadd-4a37-bcac-beebb5239cc9 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] [instance: 8620bffd-405f-41cc-9388-abdb301923d5] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:41:28.111734 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-d3b754d4-cadd-4a37-bcac-beebb5239cc9 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:28.112991 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-d3b754d4-cadd-4a37-bcac-beebb5239cc9 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:28.113590 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-d3b754d4-cadd-4a37-bcac-beebb5239cc9 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:28.114089 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-d3b754d4-cadd-4a37-bcac-beebb5239cc9 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:28.437606 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-d3b754d4-cadd-4a37-bcac-beebb5239cc9 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec8d131a9764028a096314a4ecd58f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9ff6952b014d0a9abb28dcf0b818b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:41:28.457522 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-d3b754d4-cadd-4a37-bcac-beebb5239cc9 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] 10.222.0.66 "GET /compute/v2.1/servers/8620bffd-405f-41cc-9388-abdb301923d5" status: 200 len: 1522 microversion: 2.1 time: 0.362790 Aug 04 03:41:28.471770 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 172/343] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:41:28 2022] GET /compute/v2.1/servers/8620bffd-405f-41cc-9388-abdb301923d5 => generated 1522 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:41:28.521981 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-6d5eb0ae-d2f9-44a1-9d4c-aecaf3c80768 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:41:28.522587 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-6d5eb0ae-d2f9-44a1-9d4c-aecaf3c80768 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] [instance: 11b75ab4-ac6b-43cf-b7c4-b81b0101c6cb] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:41:28.540162 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-6d5eb0ae-d2f9-44a1-9d4c-aecaf3c80768 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:28.540786 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-6d5eb0ae-d2f9-44a1-9d4c-aecaf3c80768 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:28.546473 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-6d5eb0ae-d2f9-44a1-9d4c-aecaf3c80768 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:28.546473 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-6d5eb0ae-d2f9-44a1-9d4c-aecaf3c80768 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:28.659033 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-6d5eb0ae-d2f9-44a1-9d4c-aecaf3c80768 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8a3eed3ee0b42f69948aced53729d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4daab5960f4c98874faea2066b1909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:41:28.666630 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-6d5eb0ae-d2f9-44a1-9d4c-aecaf3c80768 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] 10.222.0.66 "GET /compute/v2.1/servers/11b75ab4-ac6b-43cf-b7c4-b81b0101c6cb" status: 200 len: 1218 microversion: 2.1 time: 0.148332 Aug 04 03:41:28.667775 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 172/344] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:41:28 2022] GET /compute/v2.1/servers/11b75ab4-ac6b-43cf-b7c4-b81b0101c6cb => generated 1218 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:41:29.501259 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-3d5f5661-8255-4728-b9c9-3d65cfe0e45a tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:41:29.501900 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-3d5f5661-8255-4728-b9c9-3d65cfe0e45a tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] [instance: 8620bffd-405f-41cc-9388-abdb301923d5] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:41:29.511581 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-3d5f5661-8255-4728-b9c9-3d65cfe0e45a tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:29.512368 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-3d5f5661-8255-4728-b9c9-3d65cfe0e45a tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:29.513950 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-3d5f5661-8255-4728-b9c9-3d65cfe0e45a tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:29.514564 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-3d5f5661-8255-4728-b9c9-3d65cfe0e45a tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:29.690309 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-dacc83f1-91ba-4c5d-bc46-28fd0fb17856 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:41:29.697512 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-dacc83f1-91ba-4c5d-bc46-28fd0fb17856 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] [instance: 11b75ab4-ac6b-43cf-b7c4-b81b0101c6cb] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:41:29.705002 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-dacc83f1-91ba-4c5d-bc46-28fd0fb17856 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:29.705506 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-dacc83f1-91ba-4c5d-bc46-28fd0fb17856 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:29.710430 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-dacc83f1-91ba-4c5d-bc46-28fd0fb17856 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:29.711267 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-dacc83f1-91ba-4c5d-bc46-28fd0fb17856 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:29.783755 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-3d5f5661-8255-4728-b9c9-3d65cfe0e45a tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec8d131a9764028a096314a4ecd58f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9ff6952b014d0a9abb28dcf0b818b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:41:29.793931 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-3d5f5661-8255-4728-b9c9-3d65cfe0e45a tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] 10.222.0.66 "GET /compute/v2.1/servers/8620bffd-405f-41cc-9388-abdb301923d5" status: 200 len: 1522 microversion: 2.1 time: 0.300712 Aug 04 03:41:29.794892 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 173/345] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:41:29 2022] GET /compute/v2.1/servers/8620bffd-405f-41cc-9388-abdb301923d5 => generated 1522 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:41:29.814771 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-dacc83f1-91ba-4c5d-bc46-28fd0fb17856 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8a3eed3ee0b42f69948aced53729d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4daab5960f4c98874faea2066b1909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:41:29.823659 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-dacc83f1-91ba-4c5d-bc46-28fd0fb17856 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] 10.222.0.66 "GET /compute/v2.1/servers/11b75ab4-ac6b-43cf-b7c4-b81b0101c6cb" status: 200 len: 1274 microversion: 2.1 time: 0.139046 Aug 04 03:41:29.824550 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 173/346] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:41:29 2022] GET /compute/v2.1/servers/11b75ab4-ac6b-43cf-b7c4-b81b0101c6cb => generated 1274 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 03:41:30.821869 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-23328300-6522-40d6-b690-0f8fa8fba266 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:41:30.822668 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-23328300-6522-40d6-b690-0f8fa8fba266 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] [instance: 8620bffd-405f-41cc-9388-abdb301923d5] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:41:30.843555 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-23328300-6522-40d6-b690-0f8fa8fba266 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:30.851622 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-0b4ec400-7bd7-4bdd-912e-83aa69ba6918 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:41:30.854261 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-0b4ec400-7bd7-4bdd-912e-83aa69ba6918 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] [instance: 11b75ab4-ac6b-43cf-b7c4-b81b0101c6cb] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:41:30.858277 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-23328300-6522-40d6-b690-0f8fa8fba266 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:30.865523 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-23328300-6522-40d6-b690-0f8fa8fba266 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:30.866695 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-23328300-6522-40d6-b690-0f8fa8fba266 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:30.872708 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-0b4ec400-7bd7-4bdd-912e-83aa69ba6918 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:30.874704 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-0b4ec400-7bd7-4bdd-912e-83aa69ba6918 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:30.877231 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-0b4ec400-7bd7-4bdd-912e-83aa69ba6918 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:30.877977 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-0b4ec400-7bd7-4bdd-912e-83aa69ba6918 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:31.045570 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-0b4ec400-7bd7-4bdd-912e-83aa69ba6918 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8a3eed3ee0b42f69948aced53729d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4daab5960f4c98874faea2066b1909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:41:31.058634 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-0b4ec400-7bd7-4bdd-912e-83aa69ba6918 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] 10.222.0.66 "GET /compute/v2.1/servers/11b75ab4-ac6b-43cf-b7c4-b81b0101c6cb" status: 200 len: 1272 microversion: 2.1 time: 0.212203 Aug 04 03:41:31.059899 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 174/347] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:41:30 2022] GET /compute/v2.1/servers/11b75ab4-ac6b-43cf-b7c4-b81b0101c6cb => generated 1272 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:41:31.205087 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-23328300-6522-40d6-b690-0f8fa8fba266 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec8d131a9764028a096314a4ecd58f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9ff6952b014d0a9abb28dcf0b818b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:41:31.214037 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-23328300-6522-40d6-b690-0f8fa8fba266 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] 10.222.0.66 "GET /compute/v2.1/servers/8620bffd-405f-41cc-9388-abdb301923d5" status: 200 len: 1522 microversion: 2.1 time: 0.401824 Aug 04 03:41:31.214731 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 174/348] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:41:30 2022] GET /compute/v2.1/servers/8620bffd-405f-41cc-9388-abdb301923d5 => generated 1522 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:41:32.080687 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-ca50e419-02a5-43b6-bbb8-07dcb14f9e5e tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:41:32.082005 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-ca50e419-02a5-43b6-bbb8-07dcb14f9e5e tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] [instance: 11b75ab4-ac6b-43cf-b7c4-b81b0101c6cb] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:41:32.091601 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-ca50e419-02a5-43b6-bbb8-07dcb14f9e5e tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:32.092336 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-ca50e419-02a5-43b6-bbb8-07dcb14f9e5e tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:32.097329 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-ca50e419-02a5-43b6-bbb8-07dcb14f9e5e tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:32.097329 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-ca50e419-02a5-43b6-bbb8-07dcb14f9e5e tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:32.239006 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-1fee5a1c-b480-4ce4-8bfc-acef6f5ff47a tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:41:32.240243 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-1fee5a1c-b480-4ce4-8bfc-acef6f5ff47a tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] [instance: 8620bffd-405f-41cc-9388-abdb301923d5] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:41:32.256240 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-1fee5a1c-b480-4ce4-8bfc-acef6f5ff47a tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:32.257063 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-1fee5a1c-b480-4ce4-8bfc-acef6f5ff47a tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:32.258130 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-1fee5a1c-b480-4ce4-8bfc-acef6f5ff47a tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:32.258767 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-1fee5a1c-b480-4ce4-8bfc-acef6f5ff47a tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:32.374439 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-ca50e419-02a5-43b6-bbb8-07dcb14f9e5e tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8a3eed3ee0b42f69948aced53729d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4daab5960f4c98874faea2066b1909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:41:32.383600 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-ca50e419-02a5-43b6-bbb8-07dcb14f9e5e tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] 10.222.0.66 "GET /compute/v2.1/servers/11b75ab4-ac6b-43cf-b7c4-b81b0101c6cb" status: 200 len: 1314 microversion: 2.1 time: 0.306559 Aug 04 03:41:32.386670 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 175/349] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:41:32 2022] GET /compute/v2.1/servers/11b75ab4-ac6b-43cf-b7c4-b81b0101c6cb => generated 1314 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:41:32.622134 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-1fee5a1c-b480-4ce4-8bfc-acef6f5ff47a tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec8d131a9764028a096314a4ecd58f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9ff6952b014d0a9abb28dcf0b818b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:41:32.639650 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-1fee5a1c-b480-4ce4-8bfc-acef6f5ff47a tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] 10.222.0.66 "GET /compute/v2.1/servers/8620bffd-405f-41cc-9388-abdb301923d5" status: 200 len: 1522 microversion: 2.1 time: 0.405513 Aug 04 03:41:32.649836 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 175/350] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:41:32 2022] GET /compute/v2.1/servers/8620bffd-405f-41cc-9388-abdb301923d5 => generated 1522 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:41:33.414951 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-eb8cc2bb-b555-43ce-aafa-1e093db706e4 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:41:33.416784 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-eb8cc2bb-b555-43ce-aafa-1e093db706e4 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] [instance: 11b75ab4-ac6b-43cf-b7c4-b81b0101c6cb] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:41:33.426931 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-eb8cc2bb-b555-43ce-aafa-1e093db706e4 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:33.433149 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-eb8cc2bb-b555-43ce-aafa-1e093db706e4 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:33.433149 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-eb8cc2bb-b555-43ce-aafa-1e093db706e4 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:33.433149 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-eb8cc2bb-b555-43ce-aafa-1e093db706e4 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:33.676212 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-ec337b3f-2292-4169-be6f-0e962c778702 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:41:33.678226 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-ec337b3f-2292-4169-be6f-0e962c778702 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] [instance: 8620bffd-405f-41cc-9388-abdb301923d5] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:41:33.688219 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-ec337b3f-2292-4169-be6f-0e962c778702 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:33.689707 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-ec337b3f-2292-4169-be6f-0e962c778702 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:33.690511 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-ec337b3f-2292-4169-be6f-0e962c778702 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:33.695862 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-ec337b3f-2292-4169-be6f-0e962c778702 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:33.703528 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-eb8cc2bb-b555-43ce-aafa-1e093db706e4 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8a3eed3ee0b42f69948aced53729d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4daab5960f4c98874faea2066b1909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:41:33.714049 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-eb8cc2bb-b555-43ce-aafa-1e093db706e4 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] 10.222.0.66 "GET /compute/v2.1/servers/11b75ab4-ac6b-43cf-b7c4-b81b0101c6cb" status: 200 len: 1314 microversion: 2.1 time: 0.305395 Aug 04 03:41:33.714760 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 176/351] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:41:33 2022] GET /compute/v2.1/servers/11b75ab4-ac6b-43cf-b7c4-b81b0101c6cb => generated 1314 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:41:33.783018 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [req-c6c77683-5e73-4f26-af1b-b132890f5ae8 req-3e618dc6-55de-499f-92b0-52d89a641595 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11b75ab4-ac6b-43cf-b7c4-b81b0101c6cb", "tag": "609f1a95-58c6-40c6-981e-09b86ea7c0b5"}]} {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 03:41:33.795097 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [req-c6c77683-5e73-4f26-af1b-b132890f5ae8 req-3e618dc6-55de-499f-92b0-52d89a641595 service nova] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:33.795616 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [req-c6c77683-5e73-4f26-af1b-b132890f5ae8 req-3e618dc6-55de-499f-92b0-52d89a641595 service nova] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:33.814443 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.compute.server_external_events [req-c6c77683-5e73-4f26-af1b-b132890f5ae8 req-3e618dc6-55de-499f-92b0-52d89a641595 service nova] Creating event network-changed:609f1a95-58c6-40c6-981e-09b86ea7c0b5 for instance 11b75ab4-ac6b-43cf-b7c4-b81b0101c6cb on hv-cinder-73306 Aug 04 03:41:33.836235 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [req-c6c77683-5e73-4f26-af1b-b132890f5ae8 req-3e618dc6-55de-499f-92b0-52d89a641595 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057931 Aug 04 03:41:33.839670 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 177/352] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 03:41:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 03:41:33.911855 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-ec337b3f-2292-4169-be6f-0e962c778702 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec8d131a9764028a096314a4ecd58f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9ff6952b014d0a9abb28dcf0b818b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:41:33.929341 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-ec337b3f-2292-4169-be6f-0e962c778702 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] 10.222.0.66 "GET /compute/v2.1/servers/8620bffd-405f-41cc-9388-abdb301923d5" status: 200 len: 1522 microversion: 2.1 time: 0.262193 Aug 04 03:41:33.943719 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 176/353] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:41:33 2022] GET /compute/v2.1/servers/8620bffd-405f-41cc-9388-abdb301923d5 => generated 1522 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 03:41:34.741822 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-fce47b51-566f-4eb0-8fb8-2236a011ff02 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:41:34.742577 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-fce47b51-566f-4eb0-8fb8-2236a011ff02 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] [instance: 11b75ab4-ac6b-43cf-b7c4-b81b0101c6cb] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:41:34.756987 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-fce47b51-566f-4eb0-8fb8-2236a011ff02 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:34.759091 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-fce47b51-566f-4eb0-8fb8-2236a011ff02 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:34.760901 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-fce47b51-566f-4eb0-8fb8-2236a011ff02 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:34.761787 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-fce47b51-566f-4eb0-8fb8-2236a011ff02 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:34.953593 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-d8d3cecf-47ef-47c6-8904-4d6db51b7fb8 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:41:34.954776 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-d8d3cecf-47ef-47c6-8904-4d6db51b7fb8 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] [instance: 8620bffd-405f-41cc-9388-abdb301923d5] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:41:34.971779 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-d8d3cecf-47ef-47c6-8904-4d6db51b7fb8 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:34.972479 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-d8d3cecf-47ef-47c6-8904-4d6db51b7fb8 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:34.981672 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-d8d3cecf-47ef-47c6-8904-4d6db51b7fb8 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:34.981672 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-d8d3cecf-47ef-47c6-8904-4d6db51b7fb8 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:35.222677 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-fce47b51-566f-4eb0-8fb8-2236a011ff02 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8a3eed3ee0b42f69948aced53729d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4daab5960f4c98874faea2066b1909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:41:35.232381 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-fce47b51-566f-4eb0-8fb8-2236a011ff02 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] 10.222.0.66 "GET /compute/v2.1/servers/11b75ab4-ac6b-43cf-b7c4-b81b0101c6cb" status: 200 len: 1314 microversion: 2.1 time: 0.497840 Aug 04 03:41:35.237123 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 178/354] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:41:34 2022] GET /compute/v2.1/servers/11b75ab4-ac6b-43cf-b7c4-b81b0101c6cb => generated 1314 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:41:35.352587 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-d8d3cecf-47ef-47c6-8904-4d6db51b7fb8 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec8d131a9764028a096314a4ecd58f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9ff6952b014d0a9abb28dcf0b818b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:41:35.362394 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-d8d3cecf-47ef-47c6-8904-4d6db51b7fb8 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] 10.222.0.66 "GET /compute/v2.1/servers/8620bffd-405f-41cc-9388-abdb301923d5" status: 200 len: 1502 microversion: 2.1 time: 0.412323 Aug 04 03:41:35.364485 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 177/355] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:41:34 2022] GET /compute/v2.1/servers/8620bffd-405f-41cc-9388-abdb301923d5 => generated 1502 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:41:35.390945 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-8ae6f750-c8cf-4a71-b16c-464c9d5b2604 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "499f7b79-07f3-4404-9277-835f2ab5a9d3"}} {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 03:41:35.395370 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-8ae6f750-c8cf-4a71-b16c-464c9d5b2604 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] [instance: 8620bffd-405f-41cc-9388-abdb301923d5] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:41:35.402995 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-8ae6f750-c8cf-4a71-b16c-464c9d5b2604 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:35.403671 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-8ae6f750-c8cf-4a71-b16c-464c9d5b2604 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:35.404599 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-8ae6f750-c8cf-4a71-b16c-464c9d5b2604 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:35.405185 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-8ae6f750-c8cf-4a71-b16c-464c9d5b2604 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:35.435537 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.wsgi [None req-8ae6f750-c8cf-4a71-b16c-464c9d5b2604 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] HTTP exception thrown: Cannot 'attach_volume' instance 8620bffd-405f-41cc-9388-abdb301923d5 while it is in vm_state rescued Aug 04 03:41:35.437697 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-8ae6f750-c8cf-4a71-b16c-464c9d5b2604 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Request method failure captured: Aug 04 03:41:35.437697 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: request: POST /compute/v2.1/servers/8620bffd-405f-41cc-9388-abdb301923d5/os-volume_attachments HTTP/1.1 Aug 04 03:41:35.437697 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: Accept: application/json Aug 04 03:41:35.437697 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: Accept-Encoding: identity Aug 04 03:41:35.437697 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: Connection: close Aug 04 03:41:35.437697 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: Content-Length: 74 Aug 04 03:41:35.437697 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: Content-Type: application/json Aug 04 03:41:35.437697 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: Host: 10.222.0.66 Aug 04 03:41:35.437697 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: Openstack-System-Scope: None Aug 04 03:41:35.437697 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: User-Agent: python-urllib3/1.26.11 Aug 04 03:41:35.437697 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Auth-Token: gAAAAABi6z9iJGtDuNMkQNRzXKMLfYH03ewA3atDGoFpPxtvts1QZtyCLQeJxJ5xZv4Jb-yIauhBf4zpbsK162-B4YQFxwTxCIkCQ6jvB-tFo8yRaZBs3m8Flt5Gurg1Uwbts57F5uW3TIfvRnRvF-jH58mlrMbD9VNKLxPPHo2uIUs41P8tL24 Aug 04 03:41:35.437697 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Domain-Id: None Aug 04 03:41:35.437697 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Domain-Name: None Aug 04 03:41:35.437697 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Identity-Status: Confirmed Aug 04 03:41:35.437697 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Is-Admin-Project: True Aug 04 03:41:35.437697 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Project-Domain-Id: default Aug 04 03:41:35.437697 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Project-Domain-Name: Default Aug 04 03:41:35.437697 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Project-Id: 7d9ff6952b014d0a9abb28dcf0b818b0 Aug 04 03:41:35.437697 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-603950778 Aug 04 03:41:35.437697 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Role: member,reader Aug 04 03:41:35.437697 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Roles: member,reader Aug 04 03:41:35.439272 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/7d9ff6952b014d0a9abb28dcf0b818b0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/7d9ff6952b014d0a9abb28dcf0b818b0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/7d9ff6952b014d0a9abb28dcf0b818b0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_7d9ff6952b014d0a9abb28dcf0b818b0"}]}] Aug 04 03:41:35.439272 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Tenant: tempest-ServerRescueNegativeTestJSON-603950778 Aug 04 03:41:35.439272 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Tenant-Id: 7d9ff6952b014d0a9abb28dcf0b818b0 Aug 04 03:41:35.439272 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-603950778 Aug 04 03:41:35.439272 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-User: tempest-ServerRescueNegativeTestJSON-603950778-project Aug 04 03:41:35.439272 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-User-Domain-Id: default Aug 04 03:41:35.439272 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-User-Domain-Name: Default Aug 04 03:41:35.439272 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-User-Id: 3ec8d131a9764028a096314a4ecd58f9 Aug 04 03:41:35.439272 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-User-Name: tempest-ServerRescueNegativeTestJSON-603950778-project Aug 04 03:41:35.439272 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: Aug 04 03:41:35.439272 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: {"volumeAttachment": {"volumeId": "499f7b79-07f3-4404-9277-835f2ab5a9d3"}} Aug 04 03:41:35.439272 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: method: > Aug 04 03:41:35.440126 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: exception: Cannot 'attach_volume' instance 8620bffd-405f-41cc-9388-abdb301923d5 while it is in vm_state rescued Aug 04 03:41:35.440126 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: action_args: {'server_id': '8620bffd-405f-41cc-9388-abdb301923d5', 'body': {'volumeAttachment': {'volumeId': '499f7b79-07f3-4404-9277-835f2ab5a9d3'}}} Aug 04 03:41:35.440126 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 03:41:35.440126 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 03:41:35.440126 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 04 03:41:35.440126 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 04 03:41:35.440126 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 04 03:41:35.440126 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 04 03:41:35.440126 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 04 03:41:35.440126 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 04 03:41:35.440126 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 8620bffd-405f-41cc-9388-abdb301923d5 in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 04 03:41:35.440126 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi Aug 04 03:41:35.440126 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 03:41:35.440126 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi Aug 04 03:41:35.440126 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 03:41:35.440126 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 03:41:35.440126 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 03:41:35.440126 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 03:41:35.440126 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 03:41:35.441429 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 03:41:35.441429 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 03:41:35.441429 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 03:41:35.441429 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 03:41:35.441429 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 03:41:35.441429 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 03:41:35.441429 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 03:41:35.441429 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 03:41:35.441429 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 04 03:41:35.441429 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 04 03:41:35.441429 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 04 03:41:35.441429 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 04 03:41:35.441429 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 8620bffd-405f-41cc-9388-abdb301923d5 while it is in vm_state rescued Aug 04 03:41:35.441429 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi Aug 04 03:41:35.441429 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 03:41:35.441429 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi Aug 04 03:41:35.441429 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 03:41:35.441429 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 03:41:35.441429 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 03:41:35.442968 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 03:41:35.442968 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 03:41:35.442968 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 8620bffd-405f-41cc-9388-abdb301923d5 while it is in vm_state rescued Aug 04 03:41:35.442968 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi Aug 04 03:41:35.445828 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-8ae6f750-c8cf-4a71-b16c-464c9d5b2604 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Returning 409 to user: Cannot 'attach_volume' instance 8620bffd-405f-41cc-9388-abdb301923d5 while it is in vm_state rescued {{(pid=130262) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 03:41:35.447061 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-8ae6f750-c8cf-4a71-b16c-464c9d5b2604 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] 10.222.0.66 "POST /compute/v2.1/servers/8620bffd-405f-41cc-9388-abdb301923d5/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.065570 Aug 04 03:41:35.452437 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 179/356] 10.222.0.66 () {60 vars in 1323 bytes} [Thu Aug 4 03:41:35 2022] POST /compute/v2.1/servers/8620bffd-405f-41cc-9388-abdb301923d5/os-volume_attachments => generated 152 bytes in 72 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 04 03:41:35.466658 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-69cf1ed0-0b13-4d45-baa8-fcf0b82c7d4f tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 03:41:35.467579 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-69cf1ed0-0b13-4d45-baa8-fcf0b82c7d4f tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] [instance: 8620bffd-405f-41cc-9388-abdb301923d5] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:41:35.477110 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-69cf1ed0-0b13-4d45-baa8-fcf0b82c7d4f tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:35.478032 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-69cf1ed0-0b13-4d45-baa8-fcf0b82c7d4f tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:35.479600 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-69cf1ed0-0b13-4d45-baa8-fcf0b82c7d4f tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:35.480298 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-69cf1ed0-0b13-4d45-baa8-fcf0b82c7d4f tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:35.786317 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-69cf1ed0-0b13-4d45-baa8-fcf0b82c7d4f tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] 10.222.0.66 "POST /compute/v2.1/servers/8620bffd-405f-41cc-9388-abdb301923d5/action" status: 202 len: 0 microversion: 2.1 time: 0.318276 Aug 04 03:41:35.787718 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 178/357] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 03:41:35 2022] POST /compute/v2.1/servers/8620bffd-405f-41cc-9388-abdb301923d5/action => generated 0 bytes in 327 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 03:41:35.797613 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-b910dfa3-0119-498a-bec6-12becae7b24b tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:41:35.799529 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-b910dfa3-0119-498a-bec6-12becae7b24b tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] [instance: 8620bffd-405f-41cc-9388-abdb301923d5] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:41:35.810655 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-b910dfa3-0119-498a-bec6-12becae7b24b tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:35.814931 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-b910dfa3-0119-498a-bec6-12becae7b24b tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:35.814931 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-b910dfa3-0119-498a-bec6-12becae7b24b tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:35.814931 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-b910dfa3-0119-498a-bec6-12becae7b24b tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:36.005003 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-b910dfa3-0119-498a-bec6-12becae7b24b tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec8d131a9764028a096314a4ecd58f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9ff6952b014d0a9abb28dcf0b818b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:41:36.034256 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-b910dfa3-0119-498a-bec6-12becae7b24b tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] 10.222.0.66 "GET /compute/v2.1/servers/8620bffd-405f-41cc-9388-abdb301923d5" status: 200 len: 1510 microversion: 2.1 time: 0.240783 Aug 04 03:41:36.046160 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 180/358] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:41:35 2022] GET /compute/v2.1/servers/8620bffd-405f-41cc-9388-abdb301923d5 => generated 1510 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 03:41:36.258520 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-d54dd789-88ae-4019-9086-ee7d2f69ab94 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:41:36.259328 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-d54dd789-88ae-4019-9086-ee7d2f69ab94 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] [instance: 11b75ab4-ac6b-43cf-b7c4-b81b0101c6cb] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:41:36.266379 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-d54dd789-88ae-4019-9086-ee7d2f69ab94 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:36.266905 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-d54dd789-88ae-4019-9086-ee7d2f69ab94 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:36.267946 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-d54dd789-88ae-4019-9086-ee7d2f69ab94 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:36.268458 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-d54dd789-88ae-4019-9086-ee7d2f69ab94 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:36.472762 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-d54dd789-88ae-4019-9086-ee7d2f69ab94 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8a3eed3ee0b42f69948aced53729d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4daab5960f4c98874faea2066b1909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:41:36.489981 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-d54dd789-88ae-4019-9086-ee7d2f69ab94 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] 10.222.0.66 "GET /compute/v2.1/servers/11b75ab4-ac6b-43cf-b7c4-b81b0101c6cb" status: 200 len: 1314 microversion: 2.1 time: 0.230086 Aug 04 03:41:36.489981 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 179/359] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:41:36 2022] GET /compute/v2.1/servers/11b75ab4-ac6b-43cf-b7c4-b81b0101c6cb => generated 1314 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:41:37.064265 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-eefe6026-f043-47ba-9eca-ecd5c84476a1 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:41:37.314267 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-eefe6026-f043-47ba-9eca-ecd5c84476a1 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] [instance: 8620bffd-405f-41cc-9388-abdb301923d5] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:41:37.314267 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-eefe6026-f043-47ba-9eca-ecd5c84476a1 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:37.314267 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-eefe6026-f043-47ba-9eca-ecd5c84476a1 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:37.314267 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-eefe6026-f043-47ba-9eca-ecd5c84476a1 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:37.316856 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-eefe6026-f043-47ba-9eca-ecd5c84476a1 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:37.316856 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-eefe6026-f043-47ba-9eca-ecd5c84476a1 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec8d131a9764028a096314a4ecd58f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9ff6952b014d0a9abb28dcf0b818b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:41:37.316856 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-eefe6026-f043-47ba-9eca-ecd5c84476a1 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] 10.222.0.66 "GET /compute/v2.1/servers/8620bffd-405f-41cc-9388-abdb301923d5" status: 200 len: 1510 microversion: 2.1 time: 0.224996 Aug 04 03:41:37.316856 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 181/360] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:41:37 2022] GET /compute/v2.1/servers/8620bffd-405f-41cc-9388-abdb301923d5 => generated 1510 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:41:37.508424 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-e9fd4138-ef70-4ccd-b03f-82db305ae1db tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:41:37.509042 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-e9fd4138-ef70-4ccd-b03f-82db305ae1db tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] [instance: 11b75ab4-ac6b-43cf-b7c4-b81b0101c6cb] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:41:37.511900 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG dbcounter [-] [130263] Writing DB stats nova_cell0:SELECT=2 {{(pid=130263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:41:37.512697 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG dbcounter [-] [130263] Writing DB stats nova_cell0:SELECT=6 {{(pid=130263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:41:37.518151 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-e9fd4138-ef70-4ccd-b03f-82db305ae1db tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:37.520543 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-e9fd4138-ef70-4ccd-b03f-82db305ae1db tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:37.523501 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-e9fd4138-ef70-4ccd-b03f-82db305ae1db tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:37.524052 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-e9fd4138-ef70-4ccd-b03f-82db305ae1db tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:37.695470 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-e9fd4138-ef70-4ccd-b03f-82db305ae1db tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8a3eed3ee0b42f69948aced53729d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4daab5960f4c98874faea2066b1909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:41:37.704974 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-e9fd4138-ef70-4ccd-b03f-82db305ae1db tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] 10.222.0.66 "GET /compute/v2.1/servers/11b75ab4-ac6b-43cf-b7c4-b81b0101c6cb" status: 200 len: 1314 microversion: 2.1 time: 0.200553 Aug 04 03:41:37.705839 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 180/361] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:41:37 2022] GET /compute/v2.1/servers/11b75ab4-ac6b-43cf-b7c4-b81b0101c6cb => generated 1314 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:41:38.370268 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-e7d0a848-c5da-4f27-8072-d4035817c69d tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:41:38.370891 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-e7d0a848-c5da-4f27-8072-d4035817c69d tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] [instance: 8620bffd-405f-41cc-9388-abdb301923d5] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:41:38.379430 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG dbcounter [-] [130262] Writing DB stats nova_cell0:SELECT=2 {{(pid=130262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:41:38.382312 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-e7d0a848-c5da-4f27-8072-d4035817c69d tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:38.382780 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-e7d0a848-c5da-4f27-8072-d4035817c69d tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:38.385730 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-e7d0a848-c5da-4f27-8072-d4035817c69d tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:38.386451 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-e7d0a848-c5da-4f27-8072-d4035817c69d tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:38.579798 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-e7d0a848-c5da-4f27-8072-d4035817c69d tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec8d131a9764028a096314a4ecd58f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9ff6952b014d0a9abb28dcf0b818b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:41:38.589018 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-e7d0a848-c5da-4f27-8072-d4035817c69d tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] 10.222.0.66 "GET /compute/v2.1/servers/8620bffd-405f-41cc-9388-abdb301923d5" status: 200 len: 1510 microversion: 2.1 time: 0.223474 Aug 04 03:41:38.589618 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 182/362] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:41:38 2022] GET /compute/v2.1/servers/8620bffd-405f-41cc-9388-abdb301923d5 => generated 1510 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:41:38.732719 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-87a8d374-10e5-453d-8926-6ac251e81cf5 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:41:38.736618 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-87a8d374-10e5-453d-8926-6ac251e81cf5 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] [instance: 11b75ab4-ac6b-43cf-b7c4-b81b0101c6cb] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:41:38.753803 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-87a8d374-10e5-453d-8926-6ac251e81cf5 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:38.754552 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-87a8d374-10e5-453d-8926-6ac251e81cf5 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:38.760002 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-87a8d374-10e5-453d-8926-6ac251e81cf5 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:38.760002 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-87a8d374-10e5-453d-8926-6ac251e81cf5 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:38.945593 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-87a8d374-10e5-453d-8926-6ac251e81cf5 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8a3eed3ee0b42f69948aced53729d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4daab5960f4c98874faea2066b1909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:41:38.956036 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-87a8d374-10e5-453d-8926-6ac251e81cf5 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] 10.222.0.66 "GET /compute/v2.1/servers/11b75ab4-ac6b-43cf-b7c4-b81b0101c6cb" status: 200 len: 1314 microversion: 2.1 time: 0.231016 Aug 04 03:41:38.957238 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 181/363] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:41:38 2022] GET /compute/v2.1/servers/11b75ab4-ac6b-43cf-b7c4-b81b0101c6cb => generated 1314 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:41:39.610334 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-c0c8cab5-805e-4387-ba27-280c04a38b89 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:41:39.611244 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-c0c8cab5-805e-4387-ba27-280c04a38b89 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] [instance: 8620bffd-405f-41cc-9388-abdb301923d5] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:41:39.617862 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-c0c8cab5-805e-4387-ba27-280c04a38b89 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:39.618297 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-c0c8cab5-805e-4387-ba27-280c04a38b89 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:39.620059 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-c0c8cab5-805e-4387-ba27-280c04a38b89 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:39.620230 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-c0c8cab5-805e-4387-ba27-280c04a38b89 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:39.815974 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-c0c8cab5-805e-4387-ba27-280c04a38b89 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec8d131a9764028a096314a4ecd58f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9ff6952b014d0a9abb28dcf0b818b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:41:39.826243 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-c0c8cab5-805e-4387-ba27-280c04a38b89 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] 10.222.0.66 "GET /compute/v2.1/servers/8620bffd-405f-41cc-9388-abdb301923d5" status: 200 len: 1510 microversion: 2.1 time: 0.219219 Aug 04 03:41:39.827569 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 183/364] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:41:39 2022] GET /compute/v2.1/servers/8620bffd-405f-41cc-9388-abdb301923d5 => generated 1510 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:41:39.986660 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-2e7a46d8-8e3b-4fad-a410-e1fa84fe52bb tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:41:39.987441 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-2e7a46d8-8e3b-4fad-a410-e1fa84fe52bb tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] [instance: 11b75ab4-ac6b-43cf-b7c4-b81b0101c6cb] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:41:39.998722 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-2e7a46d8-8e3b-4fad-a410-e1fa84fe52bb tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:39.999170 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-2e7a46d8-8e3b-4fad-a410-e1fa84fe52bb tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:40.000133 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-2e7a46d8-8e3b-4fad-a410-e1fa84fe52bb tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:40.000725 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-2e7a46d8-8e3b-4fad-a410-e1fa84fe52bb tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:40.296088 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-2e7a46d8-8e3b-4fad-a410-e1fa84fe52bb tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8a3eed3ee0b42f69948aced53729d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4daab5960f4c98874faea2066b1909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:41:40.314300 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-2e7a46d8-8e3b-4fad-a410-e1fa84fe52bb tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] 10.222.0.66 "GET /compute/v2.1/servers/11b75ab4-ac6b-43cf-b7c4-b81b0101c6cb" status: 200 len: 1314 microversion: 2.1 time: 0.338759 Aug 04 03:41:40.314806 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 182/365] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:41:39 2022] GET /compute/v2.1/servers/11b75ab4-ac6b-43cf-b7c4-b81b0101c6cb => generated 1314 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:41:40.850480 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-a893c451-5d5f-470b-8704-54eb8f780336 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:41:40.856025 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-a893c451-5d5f-470b-8704-54eb8f780336 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] [instance: 8620bffd-405f-41cc-9388-abdb301923d5] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:41:40.864012 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-a893c451-5d5f-470b-8704-54eb8f780336 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:40.864347 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-a893c451-5d5f-470b-8704-54eb8f780336 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:40.865311 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-a893c451-5d5f-470b-8704-54eb8f780336 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:40.865962 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-a893c451-5d5f-470b-8704-54eb8f780336 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:41.075890 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-a893c451-5d5f-470b-8704-54eb8f780336 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec8d131a9764028a096314a4ecd58f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9ff6952b014d0a9abb28dcf0b818b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:41:41.084656 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-a893c451-5d5f-470b-8704-54eb8f780336 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] 10.222.0.66 "GET /compute/v2.1/servers/8620bffd-405f-41cc-9388-abdb301923d5" status: 200 len: 1510 microversion: 2.1 time: 0.238945 Aug 04 03:41:41.085330 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 184/366] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:41:40 2022] GET /compute/v2.1/servers/8620bffd-405f-41cc-9388-abdb301923d5 => generated 1510 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:41:41.338557 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-9217d186-6bea-4e36-a58a-1380f41c5911 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:41:41.340055 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-9217d186-6bea-4e36-a58a-1380f41c5911 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] [instance: 11b75ab4-ac6b-43cf-b7c4-b81b0101c6cb] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:41:41.356459 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-9217d186-6bea-4e36-a58a-1380f41c5911 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:41.357250 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-9217d186-6bea-4e36-a58a-1380f41c5911 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:41.358674 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-9217d186-6bea-4e36-a58a-1380f41c5911 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:41.359273 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-9217d186-6bea-4e36-a58a-1380f41c5911 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:41.703623 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-9217d186-6bea-4e36-a58a-1380f41c5911 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8a3eed3ee0b42f69948aced53729d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4daab5960f4c98874faea2066b1909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:41:41.715935 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG dbcounter [-] [130263] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:41:41.732450 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-9217d186-6bea-4e36-a58a-1380f41c5911 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] 10.222.0.66 "GET /compute/v2.1/servers/11b75ab4-ac6b-43cf-b7c4-b81b0101c6cb" status: 200 len: 1314 microversion: 2.1 time: 0.394670 Aug 04 03:41:41.733932 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 183/367] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:41:41 2022] GET /compute/v2.1/servers/11b75ab4-ac6b-43cf-b7c4-b81b0101c6cb => generated 1314 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:41:42.005144 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [req-20b62ad9-653d-4b6e-907e-d3d56d8a1062 req-050fd4d7-6991-4509-b5ea-2bfdc07c4fc6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11b75ab4-ac6b-43cf-b7c4-b81b0101c6cb", "name": "network-vif-plugged", "status": "completed", "tag": "609f1a95-58c6-40c6-981e-09b86ea7c0b5"}]} {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 03:41:42.025604 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [req-20b62ad9-653d-4b6e-907e-d3d56d8a1062 req-050fd4d7-6991-4509-b5ea-2bfdc07c4fc6 service nova] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:42.025604 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [req-20b62ad9-653d-4b6e-907e-d3d56d8a1062 req-050fd4d7-6991-4509-b5ea-2bfdc07c4fc6 service nova] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:42.035956 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG dbcounter [-] [130262] Writing DB stats nova_cell1:SELECT=100 {{(pid=130262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:41:42.051892 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.compute.server_external_events [req-20b62ad9-653d-4b6e-907e-d3d56d8a1062 req-050fd4d7-6991-4509-b5ea-2bfdc07c4fc6 service nova] Creating event network-vif-plugged:609f1a95-58c6-40c6-981e-09b86ea7c0b5 for instance 11b75ab4-ac6b-43cf-b7c4-b81b0101c6cb on hv-cinder-73306 Aug 04 03:41:42.057795 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [req-20b62ad9-653d-4b6e-907e-d3d56d8a1062 req-050fd4d7-6991-4509-b5ea-2bfdc07c4fc6 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056490 Aug 04 03:41:42.062298 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 185/368] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 03:41:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 03:41:42.123357 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-5157f65b-152d-4d99-8410-29938d87d81c tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:41:42.124331 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-5157f65b-152d-4d99-8410-29938d87d81c tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] [instance: 8620bffd-405f-41cc-9388-abdb301923d5] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:41:42.138354 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-5157f65b-152d-4d99-8410-29938d87d81c tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:42.140579 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-5157f65b-152d-4d99-8410-29938d87d81c tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:42.141814 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-5157f65b-152d-4d99-8410-29938d87d81c tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:42.144043 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-5157f65b-152d-4d99-8410-29938d87d81c tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:42.470087 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-5157f65b-152d-4d99-8410-29938d87d81c tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec8d131a9764028a096314a4ecd58f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9ff6952b014d0a9abb28dcf0b818b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:41:42.486938 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-5157f65b-152d-4d99-8410-29938d87d81c tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] 10.222.0.66 "GET /compute/v2.1/servers/8620bffd-405f-41cc-9388-abdb301923d5" status: 200 len: 1510 microversion: 2.1 time: 0.377224 Aug 04 03:41:42.489877 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 184/369] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:41:42 2022] GET /compute/v2.1/servers/8620bffd-405f-41cc-9388-abdb301923d5 => generated 1510 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:41:42.755840 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-8b087988-5ae1-4bf5-9de3-1b67446eab87 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:41:42.756841 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-8b087988-5ae1-4bf5-9de3-1b67446eab87 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] [instance: 11b75ab4-ac6b-43cf-b7c4-b81b0101c6cb] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:41:42.775545 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-8b087988-5ae1-4bf5-9de3-1b67446eab87 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:42.776713 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-8b087988-5ae1-4bf5-9de3-1b67446eab87 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:42.777766 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-8b087988-5ae1-4bf5-9de3-1b67446eab87 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:42.778369 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-8b087988-5ae1-4bf5-9de3-1b67446eab87 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:43.077557 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-8b087988-5ae1-4bf5-9de3-1b67446eab87 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8a3eed3ee0b42f69948aced53729d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4daab5960f4c98874faea2066b1909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:41:43.086592 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-8b087988-5ae1-4bf5-9de3-1b67446eab87 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] 10.222.0.66 "GET /compute/v2.1/servers/11b75ab4-ac6b-43cf-b7c4-b81b0101c6cb" status: 200 len: 1314 microversion: 2.1 time: 0.335647 Aug 04 03:41:43.090508 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 186/370] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:41:42 2022] GET /compute/v2.1/servers/11b75ab4-ac6b-43cf-b7c4-b81b0101c6cb => generated 1314 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:41:43.519363 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-f080ed5b-47cb-44f9-96db-ca0d2b01d08d tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:41:43.520186 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-f080ed5b-47cb-44f9-96db-ca0d2b01d08d tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] [instance: 8620bffd-405f-41cc-9388-abdb301923d5] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:41:43.531851 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-f080ed5b-47cb-44f9-96db-ca0d2b01d08d tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:43.535629 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-f080ed5b-47cb-44f9-96db-ca0d2b01d08d tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:43.536590 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-f080ed5b-47cb-44f9-96db-ca0d2b01d08d tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:43.536894 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-f080ed5b-47cb-44f9-96db-ca0d2b01d08d tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:43.821345 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-f080ed5b-47cb-44f9-96db-ca0d2b01d08d tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec8d131a9764028a096314a4ecd58f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9ff6952b014d0a9abb28dcf0b818b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:41:43.850008 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-f080ed5b-47cb-44f9-96db-ca0d2b01d08d tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] 10.222.0.66 "GET /compute/v2.1/servers/8620bffd-405f-41cc-9388-abdb301923d5" status: 200 len: 1510 microversion: 2.1 time: 0.334254 Aug 04 03:41:43.853672 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 185/371] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:41:43 2022] GET /compute/v2.1/servers/8620bffd-405f-41cc-9388-abdb301923d5 => generated 1510 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 03:41:44.112513 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-77a49c0d-6fa3-4f40-9b6a-96770ff93a9a tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:41:44.113344 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-77a49c0d-6fa3-4f40-9b6a-96770ff93a9a tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] [instance: 11b75ab4-ac6b-43cf-b7c4-b81b0101c6cb] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:41:44.132135 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-77a49c0d-6fa3-4f40-9b6a-96770ff93a9a tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:44.132135 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-77a49c0d-6fa3-4f40-9b6a-96770ff93a9a tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:44.132135 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-77a49c0d-6fa3-4f40-9b6a-96770ff93a9a tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:44.132135 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-77a49c0d-6fa3-4f40-9b6a-96770ff93a9a tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:44.451719 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-77a49c0d-6fa3-4f40-9b6a-96770ff93a9a tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8a3eed3ee0b42f69948aced53729d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4daab5960f4c98874faea2066b1909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:41:44.475189 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-77a49c0d-6fa3-4f40-9b6a-96770ff93a9a tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] 10.222.0.66 "GET /compute/v2.1/servers/11b75ab4-ac6b-43cf-b7c4-b81b0101c6cb" status: 200 len: 1314 microversion: 2.1 time: 0.365454 Aug 04 03:41:44.478332 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 187/372] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:41:44 2022] GET /compute/v2.1/servers/11b75ab4-ac6b-43cf-b7c4-b81b0101c6cb => generated 1314 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:41:44.882579 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-0a7de44c-fe20-4d7a-9387-2e4407f13a9b tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:41:44.886683 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-0a7de44c-fe20-4d7a-9387-2e4407f13a9b tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] [instance: 8620bffd-405f-41cc-9388-abdb301923d5] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:41:44.888583 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG dbcounter [-] [130263] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=3 {{(pid=130263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:41:44.893109 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-0a7de44c-fe20-4d7a-9387-2e4407f13a9b tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:44.894022 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-0a7de44c-fe20-4d7a-9387-2e4407f13a9b tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:44.895081 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-0a7de44c-fe20-4d7a-9387-2e4407f13a9b tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:44.896036 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-0a7de44c-fe20-4d7a-9387-2e4407f13a9b tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:45.189317 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-0a7de44c-fe20-4d7a-9387-2e4407f13a9b tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec8d131a9764028a096314a4ecd58f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9ff6952b014d0a9abb28dcf0b818b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:41:45.199884 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-0a7de44c-fe20-4d7a-9387-2e4407f13a9b tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] 10.222.0.66 "GET /compute/v2.1/servers/8620bffd-405f-41cc-9388-abdb301923d5" status: 200 len: 1516 microversion: 2.1 time: 0.321419 Aug 04 03:41:45.200691 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 186/373] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:41:44 2022] GET /compute/v2.1/servers/8620bffd-405f-41cc-9388-abdb301923d5 => generated 1516 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:41:45.503788 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-8dd25736-6252-4e56-bb8b-e03b78c54082 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:41:45.504458 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-8dd25736-6252-4e56-bb8b-e03b78c54082 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] [instance: 11b75ab4-ac6b-43cf-b7c4-b81b0101c6cb] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:41:45.518330 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG dbcounter [-] [130262] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=1 {{(pid=130262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:41:45.531378 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-8dd25736-6252-4e56-bb8b-e03b78c54082 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:45.532113 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-8dd25736-6252-4e56-bb8b-e03b78c54082 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:45.532905 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-8dd25736-6252-4e56-bb8b-e03b78c54082 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:45.533418 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-8dd25736-6252-4e56-bb8b-e03b78c54082 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:45.793284 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-8dd25736-6252-4e56-bb8b-e03b78c54082 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8a3eed3ee0b42f69948aced53729d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4daab5960f4c98874faea2066b1909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:41:45.801182 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-8dd25736-6252-4e56-bb8b-e03b78c54082 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] 10.222.0.66 "GET /compute/v2.1/servers/11b75ab4-ac6b-43cf-b7c4-b81b0101c6cb" status: 200 len: 1314 microversion: 2.1 time: 0.302382 Aug 04 03:41:45.801787 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 188/374] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:41:45 2022] GET /compute/v2.1/servers/11b75ab4-ac6b-43cf-b7c4-b81b0101c6cb => generated 1314 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:41:46.826559 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-fa1bdb0e-475b-443f-85d0-e6de1127dea2 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:41:46.827708 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-fa1bdb0e-475b-443f-85d0-e6de1127dea2 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] [instance: 11b75ab4-ac6b-43cf-b7c4-b81b0101c6cb] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:41:46.842585 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-fa1bdb0e-475b-443f-85d0-e6de1127dea2 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:46.844887 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-fa1bdb0e-475b-443f-85d0-e6de1127dea2 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:46.848994 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-fa1bdb0e-475b-443f-85d0-e6de1127dea2 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:46.851898 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-fa1bdb0e-475b-443f-85d0-e6de1127dea2 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:46.854239 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-ce3c66e2-0788-4b5d-9011-24d92b94cb4e tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Action: 'create', calling method: .version_select at 0x7f72e823c8b0>, body: {"keypair": {"name": "tempest-keypair-1362409090", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDCdJW/IdesB6D/r/7f1JmbjIO6isrzov5ig+3HfEsPKdtbwEwroHV6kyPUnktJ1iRRfv1MCl2WqhLwor7Z+eSdeokUv6Bp08ZtSeeswlosrosFIAyGdU8IjZSVawTqRiw=="}} {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 03:41:46.895581 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.quota [None req-ce3c66e2-0788-4b5d-9011-24d92b94cb4e tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Getting quotas for project 274bea7582354f49841b893c0a39ffdf. Resources: {'key_pairs'} {{(pid=130263) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 03:41:46.900273 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.quota [None req-ce3c66e2-0788-4b5d-9011-24d92b94cb4e tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Getting quotas for user 55beb38ea2994ea7987fe546235b58a5 and project 274bea7582354f49841b893c0a39ffdf. Resources: {'key_pairs'} {{(pid=130263) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 03:41:47.030498 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-ce3c66e2-0788-4b5d-9011-24d92b94cb4e tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.400411 Aug 04 03:41:47.031407 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 187/375] 10.222.0.66 () {62 vars in 1200 bytes} [Thu Aug 4 03:41:46 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 402 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 04 03:41:47.306530 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-fa1bdb0e-475b-443f-85d0-e6de1127dea2 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8a3eed3ee0b42f69948aced53729d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4daab5960f4c98874faea2066b1909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:41:47.334899 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-fa1bdb0e-475b-443f-85d0-e6de1127dea2 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] 10.222.0.66 "GET /compute/v2.1/servers/11b75ab4-ac6b-43cf-b7c4-b81b0101c6cb" status: 200 len: 1314 microversion: 2.1 time: 0.513785 Aug 04 03:41:47.336233 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 189/376] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:41:46 2022] GET /compute/v2.1/servers/11b75ab4-ac6b-43cf-b7c4-b81b0101c6cb => generated 1314 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:41:48.281886 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-51895524-b436-4074-a3f9-4aed0ccc684c tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Action: 'create', calling method: .version_select at 0x7f72e8138160>, body: {"keypair": {"name": "tempest-keypair-1363533838", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEzkEIj/YHpLo05EugLEDu5oYD4Z8m1/A7jVjtB1UCTKbr+ZMd9ChmH6PcoKd8tPmwJfvVIPU4/Q3r/3nud0RLutOVVjmGAo5ZiKaYkj4E8cGiy2hg99YyXmNzHEwqYWSg=="}} {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 03:41:48.321979 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.quota [None req-51895524-b436-4074-a3f9-4aed0ccc684c tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Getting quotas for project 7d9ff6952b014d0a9abb28dcf0b818b0. Resources: {'key_pairs'} {{(pid=130263) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 03:41:48.333068 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.quota [None req-51895524-b436-4074-a3f9-4aed0ccc684c tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Getting quotas for user 3ec8d131a9764028a096314a4ecd58f9 and project 7d9ff6952b014d0a9abb28dcf0b818b0. Resources: {'key_pairs'} {{(pid=130263) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 03:41:48.356559 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-ddb75f0b-0bd0-464c-bb61-72fc6a55a26c tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:41:48.357034 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-ddb75f0b-0bd0-464c-bb61-72fc6a55a26c tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] [instance: 11b75ab4-ac6b-43cf-b7c4-b81b0101c6cb] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:41:48.370195 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-ddb75f0b-0bd0-464c-bb61-72fc6a55a26c tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:48.370644 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-ddb75f0b-0bd0-464c-bb61-72fc6a55a26c tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:48.371430 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-ddb75f0b-0bd0-464c-bb61-72fc6a55a26c tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:48.371866 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-ddb75f0b-0bd0-464c-bb61-72fc6a55a26c tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:48.491931 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-51895524-b436-4074-a3f9-4aed0ccc684c tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.206233 Aug 04 03:41:48.491931 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 188/377] 10.222.0.66 () {60 vars in 1159 bytes} [Thu Aug 4 03:41:48 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 03:41:48.797028 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-ddb75f0b-0bd0-464c-bb61-72fc6a55a26c tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8a3eed3ee0b42f69948aced53729d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4daab5960f4c98874faea2066b1909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:41:48.809000 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-ddb75f0b-0bd0-464c-bb61-72fc6a55a26c tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] 10.222.0.66 "GET /compute/v2.1/servers/11b75ab4-ac6b-43cf-b7c4-b81b0101c6cb" status: 200 len: 1498 microversion: 2.1 time: 0.457363 Aug 04 03:41:48.809902 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 190/378] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:41:48 2022] GET /compute/v2.1/servers/11b75ab4-ac6b-43cf-b7c4-b81b0101c6cb => generated 1498 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 03:41:50.288484 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-92c09e0f-d16f-40c2-93ed-3930616b6090 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:41:50.289750 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-92c09e0f-d16f-40c2-93ed-3930616b6090 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] [instance: 11b75ab4-ac6b-43cf-b7c4-b81b0101c6cb] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:41:50.299086 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-92c09e0f-d16f-40c2-93ed-3930616b6090 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:50.306515 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-92c09e0f-d16f-40c2-93ed-3930616b6090 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:50.313385 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-92c09e0f-d16f-40c2-93ed-3930616b6090 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:50.313944 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-92c09e0f-d16f-40c2-93ed-3930616b6090 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:50.357985 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-92c09e0f-d16f-40c2-93ed-3930616b6090 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] [instance: 11b75ab4-ac6b-43cf-b7c4-b81b0101c6cb] Going to try to terminate instance {{(pid=130263) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 03:41:50.745064 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-92c09e0f-d16f-40c2-93ed-3930616b6090 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] 10.222.0.66 "DELETE /compute/v2.1/servers/11b75ab4-ac6b-43cf-b7c4-b81b0101c6cb" status: 204 len: 0 microversion: 2.1 time: 0.460310 Aug 04 03:41:50.749449 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 189/379] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 03:41:50 2022] DELETE /compute/v2.1/servers/11b75ab4-ac6b-43cf-b7c4-b81b0101c6cb => generated 0 bytes in 462 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 03:41:50.756895 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-1e767a9e-393c-4833-9109-ca0f3bbfee21 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:41:50.756895 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-1e767a9e-393c-4833-9109-ca0f3bbfee21 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] [instance: 11b75ab4-ac6b-43cf-b7c4-b81b0101c6cb] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:41:50.769162 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-1e767a9e-393c-4833-9109-ca0f3bbfee21 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:50.771943 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-1e767a9e-393c-4833-9109-ca0f3bbfee21 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:50.773272 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-1e767a9e-393c-4833-9109-ca0f3bbfee21 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:50.773860 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-1e767a9e-393c-4833-9109-ca0f3bbfee21 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:51.102189 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-12f1f3a9-3dc3-4764-98b7-44ab16910562 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-224570134", "imageRef": "0208f4b3-1d2f-42e4-a9b4-528bf5066fe1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "643c3c50-31c5-4c02-91db-4d069e60f726"}], "security_groups": [{"name": "tempest-securitygroup--1356904782"}], "key_name": "tempest-keypair-1362409090", "user_data": "}} {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 03:41:51.468235 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.network.neutron [None req-12f1f3a9-3dc3-4764-98b7-44ab16910562 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] validate_networks() for [('643c3c50-31c5-4c02-91db-4d069e60f726', None, None, None, None, None)] {{(pid=130263) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 03:41:51.672428 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-1e767a9e-393c-4833-9109-ca0f3bbfee21 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8a3eed3ee0b42f69948aced53729d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4daab5960f4c98874faea2066b1909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:41:51.681327 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-1e767a9e-393c-4833-9109-ca0f3bbfee21 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] 10.222.0.66 "GET /compute/v2.1/servers/11b75ab4-ac6b-43cf-b7c4-b81b0101c6cb" status: 200 len: 1504 microversion: 2.1 time: 0.930415 Aug 04 03:41:51.682731 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 191/380] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:41:50 2022] GET /compute/v2.1/servers/11b75ab4-ac6b-43cf-b7c4-b81b0101c6cb => generated 1504 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 03:41:52.703747 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-dc3b9398-3391-409e-b205-f67694946788 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:41:52.705494 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-dc3b9398-3391-409e-b205-f67694946788 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] [instance: 11b75ab4-ac6b-43cf-b7c4-b81b0101c6cb] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:41:52.713723 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-dc3b9398-3391-409e-b205-f67694946788 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:52.714320 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-dc3b9398-3391-409e-b205-f67694946788 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:52.715720 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-dc3b9398-3391-409e-b205-f67694946788 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:52.716396 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-dc3b9398-3391-409e-b205-f67694946788 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:53.070047 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.virt.hardware [None req-12f1f3a9-3dc3-4764-98b7-44ab16910562 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Flavor limits 0:0:0 {{(pid=130263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 03:41:53.071145 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.virt.hardware [None req-12f1f3a9-3dc3-4764-98b7-44ab16910562 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Image limits 0:0:0 {{(pid=130263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 03:41:53.072401 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.virt.hardware [None req-12f1f3a9-3dc3-4764-98b7-44ab16910562 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Flavor pref 0:0:0 {{(pid=130263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 03:41:53.073089 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.virt.hardware [None req-12f1f3a9-3dc3-4764-98b7-44ab16910562 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Image pref 0:0:0 {{(pid=130263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 03:41:53.073750 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.virt.hardware [None req-12f1f3a9-3dc3-4764-98b7-44ab16910562 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 03:41:53.086539 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-12f1f3a9-3dc3-4764-98b7-44ab16910562 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:53.088033 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-12f1f3a9-3dc3-4764-98b7-44ab16910562 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:53.094223 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-12f1f3a9-3dc3-4764-98b7-44ab16910562 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:53.094223 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-12f1f3a9-3dc3-4764-98b7-44ab16910562 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:53.116121 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.quota [None req-12f1f3a9-3dc3-4764-98b7-44ab16910562 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Getting quotas for project 274bea7582354f49841b893c0a39ffdf. Resources: {'instances', 'ram', 'cores'} {{(pid=130263) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 03:41:53.123022 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.quota [None req-12f1f3a9-3dc3-4764-98b7-44ab16910562 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Getting quotas for user 55beb38ea2994ea7987fe546235b58a5 and project 274bea7582354f49841b893c0a39ffdf. Resources: {'instances', 'ram', 'cores'} {{(pid=130263) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 03:41:53.139060 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-12f1f3a9-3dc3-4764-98b7-44ab16910562 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Going to run 1 instances... {{(pid=130263) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 03:41:53.142904 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-12f1f3a9-3dc3-4764-98b7-44ab16910562 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] [instance: 3bf41d49-2b84-4f59-a019-a8b1e45891d1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0208f4b3-1d2f-42e4-a9b4-528bf5066fe1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130263) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 03:41:53.267018 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-dc3b9398-3391-409e-b205-f67694946788 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8a3eed3ee0b42f69948aced53729d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4daab5960f4c98874faea2066b1909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:41:53.298266 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-dc3b9398-3391-409e-b205-f67694946788 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] 10.222.0.66 "GET /compute/v2.1/servers/11b75ab4-ac6b-43cf-b7c4-b81b0101c6cb" status: 200 len: 1504 microversion: 2.1 time: 0.596458 Aug 04 03:41:53.305417 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 192/381] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:41:52 2022] GET /compute/v2.1/servers/11b75ab4-ac6b-43cf-b7c4-b81b0101c6cb => generated 1504 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 03:41:53.311752 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-12f1f3a9-3dc3-4764-98b7-44ab16910562 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 2.216799 Aug 04 03:41:53.312627 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 190/382] 10.222.0.66 () {62 vars in 1188 bytes} [Thu Aug 4 03:41:51 2022] POST /compute/v2.1/servers => generated 402 bytes in 2219 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 04 03:41:53.333000 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-282b7d57-0f92-4aa4-94d9-d7e387726f96 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:41:53.333726 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-282b7d57-0f92-4aa4-94d9-d7e387726f96 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] [instance: 3bf41d49-2b84-4f59-a019-a8b1e45891d1] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:41:53.508195 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [req-364a7c7b-0308-4774-aebb-54ab29799488 req-011faa7e-6a14-4c89-a07e-284ba15ea00b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11b75ab4-ac6b-43cf-b7c4-b81b0101c6cb", "name": "network-vif-deleted", "tag": "609f1a95-58c6-40c6-981e-09b86ea7c0b5"}]} {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 03:41:53.527704 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [req-364a7c7b-0308-4774-aebb-54ab29799488 req-011faa7e-6a14-4c89-a07e-284ba15ea00b service nova] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:53.531890 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-282b7d57-0f92-4aa4-94d9-d7e387726f96 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:41:53.546847 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-282b7d57-0f92-4aa4-94d9-d7e387726f96 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:41:53.548354 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-282b7d57-0f92-4aa4-94d9-d7e387726f96 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:41:53.549484 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-282b7d57-0f92-4aa4-94d9-d7e387726f96 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] 10.222.0.66 "GET /compute/v2.1/servers/3bf41d49-2b84-4f59-a019-a8b1e45891d1" status: 200 len: 1281 microversion: 2.20 time: 0.224124 Aug 04 03:41:53.550121 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 193/383] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 03:41:53 2022] GET /compute/v2.1/servers/3bf41d49-2b84-4f59-a019-a8b1e45891d1 => generated 1281 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 03:41:53.550536 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [req-364a7c7b-0308-4774-aebb-54ab29799488 req-011faa7e-6a14-4c89-a07e-284ba15ea00b service nova] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:53.573791 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.compute.server_external_events [req-364a7c7b-0308-4774-aebb-54ab29799488 req-011faa7e-6a14-4c89-a07e-284ba15ea00b service nova] Creating event network-vif-deleted:609f1a95-58c6-40c6-981e-09b86ea7c0b5 for instance 11b75ab4-ac6b-43cf-b7c4-b81b0101c6cb on hv-cinder-73306 Aug 04 03:41:53.579979 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [req-364a7c7b-0308-4774-aebb-54ab29799488 req-011faa7e-6a14-4c89-a07e-284ba15ea00b service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075427 Aug 04 03:41:53.580911 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 191/384] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 03:41:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 03:41:54.325620 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-a2ed2597-b755-4ddb-b3de-842de94e2a05 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:41:54.326974 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-a2ed2597-b755-4ddb-b3de-842de94e2a05 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] [instance: 11b75ab4-ac6b-43cf-b7c4-b81b0101c6cb] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:41:54.367922 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-a2ed2597-b755-4ddb-b3de-842de94e2a05 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:54.369985 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-a2ed2597-b755-4ddb-b3de-842de94e2a05 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.034s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:54.370850 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-a2ed2597-b755-4ddb-b3de-842de94e2a05 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:54.371293 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-a2ed2597-b755-4ddb-b3de-842de94e2a05 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:54.458107 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-a2ed2597-b755-4ddb-b3de-842de94e2a05 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:54.458107 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-a2ed2597-b755-4ddb-b3de-842de94e2a05 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:54.458511 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.objects.instance [None req-a2ed2597-b755-4ddb-b3de-842de94e2a05 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lazy-loading 'fault' on Instance uuid 11b75ab4-ac6b-43cf-b7c4-b81b0101c6cb {{(pid=130262) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 03:41:54.577227 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-ee62191d-7cb5-479c-964f-9be3ff251d56 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:41:54.579595 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-ee62191d-7cb5-479c-964f-9be3ff251d56 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] [instance: 3bf41d49-2b84-4f59-a019-a8b1e45891d1] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:41:54.818297 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-a2ed2597-b755-4ddb-b3de-842de94e2a05 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8a3eed3ee0b42f69948aced53729d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c4daab5960f4c98874faea2066b1909', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:41:54.826403 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-a2ed2597-b755-4ddb-b3de-842de94e2a05 tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] 10.222.0.66 "GET /compute/v2.1/servers/11b75ab4-ac6b-43cf-b7c4-b81b0101c6cb" status: 200 len: 1304 microversion: 2.1 time: 0.507642 Aug 04 03:41:54.833972 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 194/385] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:41:54 2022] GET /compute/v2.1/servers/11b75ab4-ac6b-43cf-b7c4-b81b0101c6cb => generated 1304 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:41:54.841126 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-ee62191d-7cb5-479c-964f-9be3ff251d56 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:41:54.851258 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-ee62191d-7cb5-479c-964f-9be3ff251d56 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:41:54.856735 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-ee62191d-7cb5-479c-964f-9be3ff251d56 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:41:54.862121 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-ee62191d-7cb5-479c-964f-9be3ff251d56 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] 10.222.0.66 "GET /compute/v2.1/servers/3bf41d49-2b84-4f59-a019-a8b1e45891d1" status: 200 len: 1281 microversion: 2.20 time: 0.289770 Aug 04 03:41:54.863960 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 192/386] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 03:41:54 2022] GET /compute/v2.1/servers/3bf41d49-2b84-4f59-a019-a8b1e45891d1 => generated 1281 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 03:41:55.106666 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-9a7271d0-633c-45af-8968-b6b282279e46 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1583748467", "imageRef": "0208f4b3-1d2f-42e4-a9b4-528bf5066fe1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "cab855e4-301b-40e9-91e6-cb378cff2fa6"}], "security_groups": [{"name": "tempest-securitygroup--1054635841"}], "key_name": "tempest-keypair-1363533838", "user_data": "}} {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 03:41:55.356275 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.network.neutron [None req-9a7271d0-633c-45af-8968-b6b282279e46 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] validate_networks() for [('cab855e4-301b-40e9-91e6-cb378cff2fa6', None, None, None, None, None)] {{(pid=130262) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 03:41:55.859620 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-7d2bf6e1-ab94-429c-ac4f-6e72ea54b30b tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:41:55.860230 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-7d2bf6e1-ab94-429c-ac4f-6e72ea54b30b tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] [instance: 11b75ab4-ac6b-43cf-b7c4-b81b0101c6cb] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:41:55.871223 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-7d2bf6e1-ab94-429c-ac4f-6e72ea54b30b tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:55.876260 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-7d2bf6e1-ab94-429c-ac4f-6e72ea54b30b tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:55.877106 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-7d2bf6e1-ab94-429c-ac4f-6e72ea54b30b tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:55.877788 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-7d2bf6e1-ab94-429c-ac4f-6e72ea54b30b tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:55.901776 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.wsgi [None req-7d2bf6e1-ab94-429c-ac4f-6e72ea54b30b tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] HTTP exception thrown: Instance 11b75ab4-ac6b-43cf-b7c4-b81b0101c6cb could not be found. Aug 04 03:41:55.909846 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-7d2bf6e1-ab94-429c-ac4f-6e72ea54b30b tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Request method failure captured: Aug 04 03:41:55.909846 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: request: GET /compute/v2.1/servers/11b75ab4-ac6b-43cf-b7c4-b81b0101c6cb HTTP/1.1 Aug 04 03:41:55.909846 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Accept: application/json Aug 04 03:41:55.909846 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Accept-Encoding: identity Aug 04 03:41:55.909846 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Connection: close Aug 04 03:41:55.909846 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Content-Length: 0 Aug 04 03:41:55.909846 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Content-Type: application/json Aug 04 03:41:55.909846 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Host: 10.222.0.66 Aug 04 03:41:55.909846 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Openstack-System-Scope: None Aug 04 03:41:55.909846 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: User-Agent: python-urllib3/1.26.11 Aug 04 03:41:55.909846 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Auth-Token: gAAAAABi6z-qEYzO33wR1ytEwZPdccOcO7toLG8-sBHogtriF87tP1yzrlM6aPDdtaOwaY7UIt2UKW7uUZduG8xb6Dt8T-qfCuwK8xYJnFs6KaNOVBR-4SgILbLRTyR0qUyoEQEzkmfJJKpe6JXB7B2qdCZxjKhbe6w3OQarPATLZJ4HlOMvIok Aug 04 03:41:55.909846 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Domain-Id: None Aug 04 03:41:55.909846 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Domain-Name: None Aug 04 03:41:55.909846 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Identity-Status: Confirmed Aug 04 03:41:55.909846 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Is-Admin-Project: True Aug 04 03:41:55.909846 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Project-Domain-Id: default Aug 04 03:41:55.909846 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Project-Domain-Name: Default Aug 04 03:41:55.909846 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Project-Id: 1c4daab5960f4c98874faea2066b1909 Aug 04 03:41:55.909846 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Project-Name: tempest-VolumesActionsTest-1014326987 Aug 04 03:41:55.909846 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Role: member,reader Aug 04 03:41:55.909846 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Roles: member,reader Aug 04 03:41:55.911163 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/1c4daab5960f4c98874faea2066b1909"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/1c4daab5960f4c98874faea2066b1909"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/1c4daab5960f4c98874faea2066b1909"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_1c4daab5960f4c98874faea2066b1909"}]}] Aug 04 03:41:55.911163 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Tenant: tempest-VolumesActionsTest-1014326987 Aug 04 03:41:55.911163 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Tenant-Id: 1c4daab5960f4c98874faea2066b1909 Aug 04 03:41:55.911163 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Tenant-Name: tempest-VolumesActionsTest-1014326987 Aug 04 03:41:55.911163 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-User: tempest-VolumesActionsTest-1014326987-project Aug 04 03:41:55.911163 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-User-Domain-Id: default Aug 04 03:41:55.911163 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-User-Domain-Name: Default Aug 04 03:41:55.911163 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-User-Id: d8a3eed3ee0b42f69948aced53729d6f Aug 04 03:41:55.911163 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-User-Name: tempest-VolumesActionsTest-1014326987-project Aug 04 03:41:55.911163 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: method: > Aug 04 03:41:55.911163 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: exception: Instance 11b75ab4-ac6b-43cf-b7c4-b81b0101c6cb could not be found. Aug 04 03:41:55.911163 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: action_args: {'id': '11b75ab4-ac6b-43cf-b7c4-b81b0101c6cb'} Aug 04 03:41:55.911856 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 03:41:55.911856 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 03:41:55.911856 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 03:41:55.911856 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 03:41:55.911856 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 03:41:55.911856 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 03:41:55.911856 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 03:41:55.911856 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 03:41:55.911856 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 03:41:55.911856 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 03:41:55.911856 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11b75ab4-ac6b-43cf-b7c4-b81b0101c6cb could not be found. Aug 04 03:41:55.911856 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Aug 04 03:41:55.911856 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 03:41:55.911856 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Aug 04 03:41:55.911856 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 03:41:55.911856 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 03:41:55.911856 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 03:41:55.911856 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 03:41:55.911856 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 03:41:55.911856 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 03:41:55.913125 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 03:41:55.913125 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 03:41:55.913125 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 03:41:55.913125 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 03:41:55.913125 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 03:41:55.913125 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 03:41:55.913125 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 03:41:55.913125 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11b75ab4-ac6b-43cf-b7c4-b81b0101c6cb could not be found. Aug 04 03:41:55.913125 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Aug 04 03:41:55.913125 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 03:41:55.913125 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Aug 04 03:41:55.913125 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 03:41:55.913125 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 03:41:55.913125 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 03:41:55.913125 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 03:41:55.913125 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 03:41:55.913125 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11b75ab4-ac6b-43cf-b7c4-b81b0101c6cb could not be found. Aug 04 03:41:55.913125 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Aug 04 03:41:55.916378 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-7d2bf6e1-ab94-429c-ac4f-6e72ea54b30b tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] Returning 404 to user: Instance 11b75ab4-ac6b-43cf-b7c4-b81b0101c6cb could not be found. {{(pid=130263) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 03:41:55.917509 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-7d2bf6e1-ab94-429c-ac4f-6e72ea54b30b tempest-VolumesActionsTest-1014326987 tempest-VolumesActionsTest-1014326987-project] 10.222.0.66 "GET /compute/v2.1/servers/11b75ab4-ac6b-43cf-b7c4-b81b0101c6cb" status: 404 len: 111 microversion: 2.1 time: 0.062112 Aug 04 03:41:55.918319 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 193/387] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:41:55 2022] GET /compute/v2.1/servers/11b75ab4-ac6b-43cf-b7c4-b81b0101c6cb => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 03:41:55.945854 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-0c369ae0-2d34-4fb4-86cd-605ecfe0e61c tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:41:55.947430 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-0c369ae0-2d34-4fb4-86cd-605ecfe0e61c tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] [instance: 3bf41d49-2b84-4f59-a019-a8b1e45891d1] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:41:55.960153 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-0c369ae0-2d34-4fb4-86cd-605ecfe0e61c tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:55.962891 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-0c369ae0-2d34-4fb4-86cd-605ecfe0e61c tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:55.963783 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-0c369ae0-2d34-4fb4-86cd-605ecfe0e61c tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:55.964234 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-0c369ae0-2d34-4fb4-86cd-605ecfe0e61c tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:56.287329 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-0c369ae0-2d34-4fb4-86cd-605ecfe0e61c tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:41:56.328328 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-0c369ae0-2d34-4fb4-86cd-605ecfe0e61c tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:41:56.333611 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-0c369ae0-2d34-4fb4-86cd-605ecfe0e61c tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:41:56.341068 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-0c369ae0-2d34-4fb4-86cd-605ecfe0e61c tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] 10.222.0.66 "GET /compute/v2.1/servers/3bf41d49-2b84-4f59-a019-a8b1e45891d1" status: 200 len: 1333 microversion: 2.20 time: 0.415896 Aug 04 03:41:56.342280 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 194/388] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 03:41:55 2022] GET /compute/v2.1/servers/3bf41d49-2b84-4f59-a019-a8b1e45891d1 => generated 1333 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 03:41:56.604265 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.virt.hardware [None req-9a7271d0-633c-45af-8968-b6b282279e46 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Flavor limits 0:0:0 {{(pid=130262) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 03:41:56.604696 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.virt.hardware [None req-9a7271d0-633c-45af-8968-b6b282279e46 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Image limits 0:0:0 {{(pid=130262) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 03:41:56.605152 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.virt.hardware [None req-9a7271d0-633c-45af-8968-b6b282279e46 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Flavor pref 0:0:0 {{(pid=130262) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 03:41:56.605839 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.virt.hardware [None req-9a7271d0-633c-45af-8968-b6b282279e46 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Image pref 0:0:0 {{(pid=130262) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 03:41:56.606046 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.virt.hardware [None req-9a7271d0-633c-45af-8968-b6b282279e46 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130262) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 03:41:56.618136 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-9a7271d0-633c-45af-8968-b6b282279e46 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:56.618940 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-9a7271d0-633c-45af-8968-b6b282279e46 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:56.620042 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-9a7271d0-633c-45af-8968-b6b282279e46 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:56.620739 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-9a7271d0-633c-45af-8968-b6b282279e46 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:56.690364 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.quota [None req-9a7271d0-633c-45af-8968-b6b282279e46 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Getting quotas for project 7d9ff6952b014d0a9abb28dcf0b818b0. Resources: {'instances', 'ram', 'cores'} {{(pid=130262) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 03:41:56.695490 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.quota [None req-9a7271d0-633c-45af-8968-b6b282279e46 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Getting quotas for user 3ec8d131a9764028a096314a4ecd58f9 and project 7d9ff6952b014d0a9abb28dcf0b818b0. Resources: {'instances', 'ram', 'cores'} {{(pid=130262) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 03:41:56.725298 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-9a7271d0-633c-45af-8968-b6b282279e46 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Going to run 1 instances... {{(pid=130262) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 03:41:56.729573 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-9a7271d0-633c-45af-8968-b6b282279e46 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] [instance: f69fd00d-cf45-4c17-aee5-701e87ebab82] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0208f4b3-1d2f-42e4-a9b4-528bf5066fe1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130262) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 03:41:56.854533 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-9a7271d0-633c-45af-8968-b6b282279e46 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.752598 Aug 04 03:41:56.856400 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 195/389] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 03:41:55 2022] POST /compute/v2.1/servers => generated 409 bytes in 1755 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 03:41:56.869750 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-b896ae8b-b4f4-4a76-a911-a4621b1c1989 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:41:56.871026 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-b896ae8b-b4f4-4a76-a911-a4621b1c1989 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] [instance: f69fd00d-cf45-4c17-aee5-701e87ebab82] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:41:56.979462 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-b896ae8b-b4f4-4a76-a911-a4621b1c1989 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec8d131a9764028a096314a4ecd58f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9ff6952b014d0a9abb28dcf0b818b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:41:56.987822 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-b896ae8b-b4f4-4a76-a911-a4621b1c1989 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] 10.222.0.66 "GET /compute/v2.1/servers/f69fd00d-cf45-4c17-aee5-701e87ebab82" status: 200 len: 1246 microversion: 2.1 time: 0.124807 Aug 04 03:41:56.988865 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 195/390] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:41:56 2022] GET /compute/v2.1/servers/f69fd00d-cf45-4c17-aee5-701e87ebab82 => generated 1246 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:41:57.262080 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-9e5796a7-da44-4a4a-b490-c7181c8fe955 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Action: 'create', calling method: .version_select at 0x7f72e82bfc10>, body: {"keypair": {"name": "tempest-TestShelveInstance-1601506750", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKXRPq2x/4rhlhndsqkVxNLfVTETLdeQTeleNqO1vAV7vUyQI3cllCINRR32lU34gYg1HDZIzJMz4NNBj1hw+3zrU74mFXJIFQyr8nyPgskulzAyGO6Y0y3vBXB4h3mf2Q=="}} {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 03:41:57.290796 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.quota [None req-9e5796a7-da44-4a4a-b490-c7181c8fe955 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Getting quotas for project cf95e3e43d0e482ba4d27b769fb48628. Resources: {'key_pairs'} {{(pid=130262) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 03:41:57.296799 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.quota [None req-9e5796a7-da44-4a4a-b490-c7181c8fe955 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Getting quotas for user dcc12077b11448a3b1ec2e7dbf2707ef and project cf95e3e43d0e482ba4d27b769fb48628. Resources: {'key_pairs'} {{(pid=130262) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 03:41:57.374112 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-f70794a0-0f68-4892-8a6d-389dbbdd229a tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:41:57.374760 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-f70794a0-0f68-4892-8a6d-389dbbdd229a tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] [instance: 3bf41d49-2b84-4f59-a019-a8b1e45891d1] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:41:57.390989 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-f70794a0-0f68-4892-8a6d-389dbbdd229a tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:57.391448 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-f70794a0-0f68-4892-8a6d-389dbbdd229a tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:57.393186 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-f70794a0-0f68-4892-8a6d-389dbbdd229a tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:57.393766 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-f70794a0-0f68-4892-8a6d-389dbbdd229a tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:57.438230 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-9e5796a7-da44-4a4a-b490-c7181c8fe955 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.386750 Aug 04 03:41:57.438994 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 196/391] 10.222.0.66 () {60 vars in 1159 bytes} [Thu Aug 4 03:41:57 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 03:41:57.539849 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-f70794a0-0f68-4892-8a6d-389dbbdd229a tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:41:57.570786 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-f70794a0-0f68-4892-8a6d-389dbbdd229a tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:41:57.580580 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-f70794a0-0f68-4892-8a6d-389dbbdd229a tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:41:57.583065 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-f70794a0-0f68-4892-8a6d-389dbbdd229a tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] 10.222.0.66 "GET /compute/v2.1/servers/3bf41d49-2b84-4f59-a019-a8b1e45891d1" status: 200 len: 1339 microversion: 2.20 time: 0.215387 Aug 04 03:41:57.597258 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 196/392] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 03:41:57 2022] GET /compute/v2.1/servers/3bf41d49-2b84-4f59-a019-a8b1e45891d1 => generated 1339 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 03:41:58.011223 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-d23642ff-d8fe-4512-8c93-6873090914ac tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:41:58.012669 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-d23642ff-d8fe-4512-8c93-6873090914ac tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] [instance: f69fd00d-cf45-4c17-aee5-701e87ebab82] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:41:58.027263 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-d23642ff-d8fe-4512-8c93-6873090914ac tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:58.028395 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-d23642ff-d8fe-4512-8c93-6873090914ac tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:58.029542 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-d23642ff-d8fe-4512-8c93-6873090914ac tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:58.030231 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-d23642ff-d8fe-4512-8c93-6873090914ac tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:58.112531 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-d23642ff-d8fe-4512-8c93-6873090914ac tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec8d131a9764028a096314a4ecd58f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9ff6952b014d0a9abb28dcf0b818b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:41:58.121717 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-d23642ff-d8fe-4512-8c93-6873090914ac tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] 10.222.0.66 "GET /compute/v2.1/servers/f69fd00d-cf45-4c17-aee5-701e87ebab82" status: 200 len: 1250 microversion: 2.1 time: 0.115415 Aug 04 03:41:58.123072 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 197/393] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:41:58 2022] GET /compute/v2.1/servers/f69fd00d-cf45-4c17-aee5-701e87ebab82 => generated 1250 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:41:58.608941 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-fd30010b-c79d-4e34-b147-964c43e50f89 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:41:58.609622 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-fd30010b-c79d-4e34-b147-964c43e50f89 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] [instance: 3bf41d49-2b84-4f59-a019-a8b1e45891d1] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:41:58.629271 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-fd30010b-c79d-4e34-b147-964c43e50f89 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:58.629743 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-fd30010b-c79d-4e34-b147-964c43e50f89 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:58.630983 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-fd30010b-c79d-4e34-b147-964c43e50f89 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:58.631434 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-fd30010b-c79d-4e34-b147-964c43e50f89 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:58.917918 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-fd30010b-c79d-4e34-b147-964c43e50f89 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:41:58.933884 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-fd30010b-c79d-4e34-b147-964c43e50f89 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:41:58.936789 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-fd30010b-c79d-4e34-b147-964c43e50f89 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:41:58.940459 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-fd30010b-c79d-4e34-b147-964c43e50f89 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] 10.222.0.66 "GET /compute/v2.1/servers/3bf41d49-2b84-4f59-a019-a8b1e45891d1" status: 200 len: 1407 microversion: 2.20 time: 0.334903 Aug 04 03:41:58.942812 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 197/394] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 03:41:58 2022] GET /compute/v2.1/servers/3bf41d49-2b84-4f59-a019-a8b1e45891d1 => generated 1407 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 03:41:59.142600 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-c0040920-c850-402e-b55c-b73f38195e03 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:41:59.143745 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-c0040920-c850-402e-b55c-b73f38195e03 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] [instance: f69fd00d-cf45-4c17-aee5-701e87ebab82] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:41:59.150256 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-c0040920-c850-402e-b55c-b73f38195e03 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:59.150869 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-c0040920-c850-402e-b55c-b73f38195e03 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:59.151688 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-c0040920-c850-402e-b55c-b73f38195e03 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:59.152298 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-c0040920-c850-402e-b55c-b73f38195e03 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:59.220402 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-c0040920-c850-402e-b55c-b73f38195e03 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec8d131a9764028a096314a4ecd58f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9ff6952b014d0a9abb28dcf0b818b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:41:59.241935 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-c0040920-c850-402e-b55c-b73f38195e03 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] 10.222.0.66 "GET /compute/v2.1/servers/f69fd00d-cf45-4c17-aee5-701e87ebab82" status: 200 len: 1298 microversion: 2.1 time: 0.103102 Aug 04 03:41:59.244749 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 198/395] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:41:59 2022] GET /compute/v2.1/servers/f69fd00d-cf45-4c17-aee5-701e87ebab82 => generated 1298 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:41:59.727477 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [req-e7fd7cea-35aa-48b3-b1a9-c938bde2e489 req-00255c30-7cef-425b-beb9-91fbfd750f66 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3bf41d49-2b84-4f59-a019-a8b1e45891d1", "tag": "8144b5cf-3a6c-452a-a3bb-81896a2ba4e0"}]} {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 03:41:59.739978 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [req-e7fd7cea-35aa-48b3-b1a9-c938bde2e489 req-00255c30-7cef-425b-beb9-91fbfd750f66 service nova] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:59.740714 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [req-e7fd7cea-35aa-48b3-b1a9-c938bde2e489 req-00255c30-7cef-425b-beb9-91fbfd750f66 service nova] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:59.760084 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.compute.server_external_events [req-e7fd7cea-35aa-48b3-b1a9-c938bde2e489 req-00255c30-7cef-425b-beb9-91fbfd750f66 service nova] Creating event network-changed:8144b5cf-3a6c-452a-a3bb-81896a2ba4e0 for instance 3bf41d49-2b84-4f59-a019-a8b1e45891d1 on hv-cinder-73306 Aug 04 03:41:59.767609 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [req-e7fd7cea-35aa-48b3-b1a9-c938bde2e489 req-00255c30-7cef-425b-beb9-91fbfd750f66 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044685 Aug 04 03:41:59.768594 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 198/396] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 03:41:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 03:41:59.969984 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-ad06cea0-f829-405c-87a2-26f27121427d tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:41:59.970453 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-ad06cea0-f829-405c-87a2-26f27121427d tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] [instance: 3bf41d49-2b84-4f59-a019-a8b1e45891d1] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:41:59.976544 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-ad06cea0-f829-405c-87a2-26f27121427d tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:59.977602 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-ad06cea0-f829-405c-87a2-26f27121427d tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:41:59.979400 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-ad06cea0-f829-405c-87a2-26f27121427d tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:41:59.980056 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-ad06cea0-f829-405c-87a2-26f27121427d tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:42:00.256990 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-ad06cea0-f829-405c-87a2-26f27121427d tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:42:00.271061 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-ad06cea0-f829-405c-87a2-26f27121427d tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:42:00.271298 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-9ee5360b-e4cc-4ba5-8100-3340738af10a tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:42:00.272236 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-9ee5360b-e4cc-4ba5-8100-3340738af10a tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] [instance: f69fd00d-cf45-4c17-aee5-701e87ebab82] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:42:00.274418 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-ad06cea0-f829-405c-87a2-26f27121427d tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:42:00.275466 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-ad06cea0-f829-405c-87a2-26f27121427d tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] 10.222.0.66 "GET /compute/v2.1/servers/3bf41d49-2b84-4f59-a019-a8b1e45891d1" status: 200 len: 1407 microversion: 2.20 time: 0.309825 Aug 04 03:42:00.276466 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 199/397] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 03:41:59 2022] GET /compute/v2.1/servers/3bf41d49-2b84-4f59-a019-a8b1e45891d1 => generated 1407 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 03:42:00.297669 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-9ee5360b-e4cc-4ba5-8100-3340738af10a tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:42:00.297669 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-9ee5360b-e4cc-4ba5-8100-3340738af10a tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:42:00.297669 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-9ee5360b-e4cc-4ba5-8100-3340738af10a tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:42:00.297669 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-9ee5360b-e4cc-4ba5-8100-3340738af10a tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:42:00.411068 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-9ee5360b-e4cc-4ba5-8100-3340738af10a tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec8d131a9764028a096314a4ecd58f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9ff6952b014d0a9abb28dcf0b818b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:42:00.420149 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-9ee5360b-e4cc-4ba5-8100-3340738af10a tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] 10.222.0.66 "GET /compute/v2.1/servers/f69fd00d-cf45-4c17-aee5-701e87ebab82" status: 200 len: 1298 microversion: 2.1 time: 0.158585 Aug 04 03:42:00.447404 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 199/398] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:42:00 2022] GET /compute/v2.1/servers/f69fd00d-cf45-4c17-aee5-701e87ebab82 => generated 1298 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 03:42:01.298941 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-ee4de2ed-5f9d-424d-9587-b172e545c7b5 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:42:01.299546 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-ee4de2ed-5f9d-424d-9587-b172e545c7b5 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] [instance: 3bf41d49-2b84-4f59-a019-a8b1e45891d1] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:42:01.306567 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-ee4de2ed-5f9d-424d-9587-b172e545c7b5 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:42:01.312320 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-ee4de2ed-5f9d-424d-9587-b172e545c7b5 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:42:01.312320 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-ee4de2ed-5f9d-424d-9587-b172e545c7b5 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:42:01.312320 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-ee4de2ed-5f9d-424d-9587-b172e545c7b5 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:42:01.441549 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-b0ced1be-82c7-4ccc-9f6e-a7389af48d8a tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:42:01.442267 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-b0ced1be-82c7-4ccc-9f6e-a7389af48d8a tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] [instance: f69fd00d-cf45-4c17-aee5-701e87ebab82] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:42:01.454225 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-b0ced1be-82c7-4ccc-9f6e-a7389af48d8a tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:42:01.454686 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-b0ced1be-82c7-4ccc-9f6e-a7389af48d8a tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:42:01.455463 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-b0ced1be-82c7-4ccc-9f6e-a7389af48d8a tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:42:01.455899 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-b0ced1be-82c7-4ccc-9f6e-a7389af48d8a tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:42:01.578680 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-ee4de2ed-5f9d-424d-9587-b172e545c7b5 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:42:01.589418 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-ee4de2ed-5f9d-424d-9587-b172e545c7b5 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:42:01.591017 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-ee4de2ed-5f9d-424d-9587-b172e545c7b5 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:42:01.601934 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-ee4de2ed-5f9d-424d-9587-b172e545c7b5 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] 10.222.0.66 "GET /compute/v2.1/servers/3bf41d49-2b84-4f59-a019-a8b1e45891d1" status: 200 len: 1407 microversion: 2.20 time: 0.306688 Aug 04 03:42:01.603015 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 200/399] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 03:42:01 2022] GET /compute/v2.1/servers/3bf41d49-2b84-4f59-a019-a8b1e45891d1 => generated 1407 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 03:42:01.614724 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-b0ced1be-82c7-4ccc-9f6e-a7389af48d8a tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec8d131a9764028a096314a4ecd58f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9ff6952b014d0a9abb28dcf0b818b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:42:01.627449 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-b0ced1be-82c7-4ccc-9f6e-a7389af48d8a tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] 10.222.0.66 "GET /compute/v2.1/servers/f69fd00d-cf45-4c17-aee5-701e87ebab82" status: 200 len: 1298 microversion: 2.1 time: 0.187439 Aug 04 03:42:01.629248 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 200/400] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:42:01 2022] GET /compute/v2.1/servers/f69fd00d-cf45-4c17-aee5-701e87ebab82 => generated 1298 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:42:02.625675 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-6e1145e5-b6b5-4fbb-a486-e7e323cf8f2a tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:42:02.626787 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-6e1145e5-b6b5-4fbb-a486-e7e323cf8f2a tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] [instance: 3bf41d49-2b84-4f59-a019-a8b1e45891d1] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:42:02.633637 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-6e1145e5-b6b5-4fbb-a486-e7e323cf8f2a tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:42:02.634891 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-6e1145e5-b6b5-4fbb-a486-e7e323cf8f2a tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:42:02.635894 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-6e1145e5-b6b5-4fbb-a486-e7e323cf8f2a tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:42:02.636733 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-6e1145e5-b6b5-4fbb-a486-e7e323cf8f2a tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:42:02.652466 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-909447a9-330f-408f-861a-b0ac63211872 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:42:02.653691 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-909447a9-330f-408f-861a-b0ac63211872 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] [instance: f69fd00d-cf45-4c17-aee5-701e87ebab82] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:42:02.660901 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-909447a9-330f-408f-861a-b0ac63211872 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:42:02.661621 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-909447a9-330f-408f-861a-b0ac63211872 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:42:02.663227 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-909447a9-330f-408f-861a-b0ac63211872 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:42:02.663817 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-909447a9-330f-408f-861a-b0ac63211872 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:42:02.763669 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-909447a9-330f-408f-861a-b0ac63211872 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec8d131a9764028a096314a4ecd58f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9ff6952b014d0a9abb28dcf0b818b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:42:02.774280 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-909447a9-330f-408f-861a-b0ac63211872 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] 10.222.0.66 "GET /compute/v2.1/servers/f69fd00d-cf45-4c17-aee5-701e87ebab82" status: 200 len: 1298 microversion: 2.1 time: 0.126953 Aug 04 03:42:02.775081 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 201/401] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:42:02 2022] GET /compute/v2.1/servers/f69fd00d-cf45-4c17-aee5-701e87ebab82 => generated 1298 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:42:02.887374 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-6e1145e5-b6b5-4fbb-a486-e7e323cf8f2a tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:42:02.901214 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-6e1145e5-b6b5-4fbb-a486-e7e323cf8f2a tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:42:02.902895 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-6e1145e5-b6b5-4fbb-a486-e7e323cf8f2a tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:42:02.904055 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-6e1145e5-b6b5-4fbb-a486-e7e323cf8f2a tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] 10.222.0.66 "GET /compute/v2.1/servers/3bf41d49-2b84-4f59-a019-a8b1e45891d1" status: 200 len: 1407 microversion: 2.20 time: 0.282332 Aug 04 03:42:02.908111 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 201/402] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 03:42:02 2022] GET /compute/v2.1/servers/3bf41d49-2b84-4f59-a019-a8b1e45891d1 => generated 1407 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 03:42:03.803945 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-89fa8127-c6d2-4daf-ae3f-146334ca00f7 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:42:03.805546 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-89fa8127-c6d2-4daf-ae3f-146334ca00f7 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] [instance: f69fd00d-cf45-4c17-aee5-701e87ebab82] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:42:03.826354 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG dbcounter [-] [130263] Writing DB stats nova_cell0:SELECT=2 {{(pid=130263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:42:03.839155 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-89fa8127-c6d2-4daf-ae3f-146334ca00f7 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:42:03.839909 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-89fa8127-c6d2-4daf-ae3f-146334ca00f7 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:42:03.841434 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-89fa8127-c6d2-4daf-ae3f-146334ca00f7 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:42:03.842970 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-89fa8127-c6d2-4daf-ae3f-146334ca00f7 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:42:03.936303 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-d6c28780-6968-46e5-8e75-b4458345adf4 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:42:03.938943 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-d6c28780-6968-46e5-8e75-b4458345adf4 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] [instance: 3bf41d49-2b84-4f59-a019-a8b1e45891d1] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:42:03.952544 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-d6c28780-6968-46e5-8e75-b4458345adf4 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:42:03.954002 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-d6c28780-6968-46e5-8e75-b4458345adf4 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:42:03.955421 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-d6c28780-6968-46e5-8e75-b4458345adf4 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:42:03.957562 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-d6c28780-6968-46e5-8e75-b4458345adf4 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:42:04.028524 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-89fa8127-c6d2-4daf-ae3f-146334ca00f7 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec8d131a9764028a096314a4ecd58f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9ff6952b014d0a9abb28dcf0b818b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:42:04.070675 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-89fa8127-c6d2-4daf-ae3f-146334ca00f7 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] 10.222.0.66 "GET /compute/v2.1/servers/f69fd00d-cf45-4c17-aee5-701e87ebab82" status: 200 len: 1298 microversion: 2.1 time: 0.278357 Aug 04 03:42:04.077483 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 202/403] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:42:03 2022] GET /compute/v2.1/servers/f69fd00d-cf45-4c17-aee5-701e87ebab82 => generated 1298 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:42:04.253829 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-d6c28780-6968-46e5-8e75-b4458345adf4 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:42:04.267719 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-d6c28780-6968-46e5-8e75-b4458345adf4 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:42:04.272890 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-d6c28780-6968-46e5-8e75-b4458345adf4 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:42:04.274103 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-d6c28780-6968-46e5-8e75-b4458345adf4 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] 10.222.0.66 "GET /compute/v2.1/servers/3bf41d49-2b84-4f59-a019-a8b1e45891d1" status: 200 len: 1407 microversion: 2.20 time: 0.343868 Aug 04 03:42:04.275793 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 202/404] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 03:42:03 2022] GET /compute/v2.1/servers/3bf41d49-2b84-4f59-a019-a8b1e45891d1 => generated 1407 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 03:42:05.100605 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-17a7878c-c9bf-48f0-b4ea-52d49298cd30 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:42:05.101458 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-17a7878c-c9bf-48f0-b4ea-52d49298cd30 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] [instance: f69fd00d-cf45-4c17-aee5-701e87ebab82] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:42:05.132852 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-17a7878c-c9bf-48f0-b4ea-52d49298cd30 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:42:05.137886 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-17a7878c-c9bf-48f0-b4ea-52d49298cd30 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:42:05.140320 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-17a7878c-c9bf-48f0-b4ea-52d49298cd30 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:42:05.143475 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-17a7878c-c9bf-48f0-b4ea-52d49298cd30 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:42:05.300512 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-460f198a-e5a1-470d-ac28-68e8e55a66de tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:42:05.307273 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-460f198a-e5a1-470d-ac28-68e8e55a66de tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] [instance: 3bf41d49-2b84-4f59-a019-a8b1e45891d1] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:42:05.323467 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-460f198a-e5a1-470d-ac28-68e8e55a66de tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:42:05.324271 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-460f198a-e5a1-470d-ac28-68e8e55a66de tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:42:05.327917 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-460f198a-e5a1-470d-ac28-68e8e55a66de tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:42:05.328655 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-460f198a-e5a1-470d-ac28-68e8e55a66de tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:42:05.338735 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-17a7878c-c9bf-48f0-b4ea-52d49298cd30 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec8d131a9764028a096314a4ecd58f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9ff6952b014d0a9abb28dcf0b818b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:42:05.354268 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-17a7878c-c9bf-48f0-b4ea-52d49298cd30 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] 10.222.0.66 "GET /compute/v2.1/servers/f69fd00d-cf45-4c17-aee5-701e87ebab82" status: 200 len: 1304 microversion: 2.1 time: 0.257339 Aug 04 03:42:05.359189 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 203/405] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:42:05 2022] GET /compute/v2.1/servers/f69fd00d-cf45-4c17-aee5-701e87ebab82 => generated 1304 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:42:05.573598 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-460f198a-e5a1-470d-ac28-68e8e55a66de tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:42:05.585825 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-460f198a-e5a1-470d-ac28-68e8e55a66de tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:42:05.595149 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-460f198a-e5a1-470d-ac28-68e8e55a66de tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:42:05.599313 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-460f198a-e5a1-470d-ac28-68e8e55a66de tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] 10.222.0.66 "GET /compute/v2.1/servers/3bf41d49-2b84-4f59-a019-a8b1e45891d1" status: 200 len: 1407 microversion: 2.20 time: 0.303357 Aug 04 03:42:05.617537 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 203/406] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 03:42:05 2022] GET /compute/v2.1/servers/3bf41d49-2b84-4f59-a019-a8b1e45891d1 => generated 1407 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 03:42:06.379354 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-2f37c94a-f48b-43ac-aadc-c00a829fb6ae tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:42:06.578020 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-2f37c94a-f48b-43ac-aadc-c00a829fb6ae tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] [instance: f69fd00d-cf45-4c17-aee5-701e87ebab82] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:42:06.578020 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-2f37c94a-f48b-43ac-aadc-c00a829fb6ae tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:42:06.578020 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-2f37c94a-f48b-43ac-aadc-c00a829fb6ae tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:42:06.578020 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-2f37c94a-f48b-43ac-aadc-c00a829fb6ae tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:42:06.579521 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-2f37c94a-f48b-43ac-aadc-c00a829fb6ae tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:42:06.624709 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-307da990-c57a-42e6-bd84-2b340274a925 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:42:06.625515 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-307da990-c57a-42e6-bd84-2b340274a925 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] [instance: 3bf41d49-2b84-4f59-a019-a8b1e45891d1] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:42:06.638597 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-307da990-c57a-42e6-bd84-2b340274a925 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:42:06.677694 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-307da990-c57a-42e6-bd84-2b340274a925 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:42:06.677694 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-307da990-c57a-42e6-bd84-2b340274a925 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:42:06.677694 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-307da990-c57a-42e6-bd84-2b340274a925 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:42:06.677694 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG dbcounter [-] [130262] Writing DB stats nova_cell0:SELECT=2 {{(pid=130262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:42:06.983991 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG dbcounter [-] [130263] Writing DB stats nova_cell0:SELECT=18 {{(pid=130263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:42:06.997865 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-2f37c94a-f48b-43ac-aadc-c00a829fb6ae tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec8d131a9764028a096314a4ecd58f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9ff6952b014d0a9abb28dcf0b818b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:42:07.008186 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-2f37c94a-f48b-43ac-aadc-c00a829fb6ae tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] 10.222.0.66 "GET /compute/v2.1/servers/f69fd00d-cf45-4c17-aee5-701e87ebab82" status: 200 len: 1372 microversion: 2.1 time: 0.633261 Aug 04 03:42:07.011696 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 204/407] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:42:06 2022] GET /compute/v2.1/servers/f69fd00d-cf45-4c17-aee5-701e87ebab82 => generated 1372 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:42:07.129064 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-307da990-c57a-42e6-bd84-2b340274a925 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:42:07.136167 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG dbcounter [-] [130262] Writing DB stats nova_cell1:SELECT=100 {{(pid=130262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:42:07.143384 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-307da990-c57a-42e6-bd84-2b340274a925 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:42:07.145004 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-307da990-c57a-42e6-bd84-2b340274a925 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:42:07.146184 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-307da990-c57a-42e6-bd84-2b340274a925 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] 10.222.0.66 "GET /compute/v2.1/servers/3bf41d49-2b84-4f59-a019-a8b1e45891d1" status: 200 len: 1407 microversion: 2.20 time: 0.526111 Aug 04 03:42:07.154148 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 204/408] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 03:42:06 2022] GET /compute/v2.1/servers/3bf41d49-2b84-4f59-a019-a8b1e45891d1 => generated 1407 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 03:42:07.991768 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-aeb46ce6-ff84-4ce0-9c20-458a960aa0a9 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Action: 'create', calling method: .version_select at 0x7f72e82a84c0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-908000990", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBJKSr4nMSNv0f7A7MO7c4unuI06ze0XROpGPloiLHB89OCHsZLzbGJJ0rqlkex7QjeFkP/Uvc6p1toPSeUclW8aCe6fp4CWBlPmq8LhMdX9qbDiu74xj/Y5ShXAk7E2Ig=="}} {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 03:42:08.011034 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.quota [None req-aeb46ce6-ff84-4ce0-9c20-458a960aa0a9 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Getting quotas for project 32813adc26c64016b99c9c5fd838d391. Resources: {'key_pairs'} {{(pid=130263) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 03:42:08.015693 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.quota [None req-aeb46ce6-ff84-4ce0-9c20-458a960aa0a9 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Getting quotas for user ac48e585c133487dadbe0a1e095bfde0 and project 32813adc26c64016b99c9c5fd838d391. Resources: {'key_pairs'} {{(pid=130263) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 03:42:08.031089 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-cf89e2ec-6227-4eec-b73c-7599ff02fce0 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:42:08.036057 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-cf89e2ec-6227-4eec-b73c-7599ff02fce0 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] [instance: f69fd00d-cf45-4c17-aee5-701e87ebab82] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:42:08.036057 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG dbcounter [-] [130262] Writing DB stats nova_cell0:SELECT=12 {{(pid=130262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:42:08.039212 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-cf89e2ec-6227-4eec-b73c-7599ff02fce0 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:42:08.039871 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-cf89e2ec-6227-4eec-b73c-7599ff02fce0 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:42:08.041816 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-cf89e2ec-6227-4eec-b73c-7599ff02fce0 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:42:08.042427 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-cf89e2ec-6227-4eec-b73c-7599ff02fce0 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:42:08.118690 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-aeb46ce6-ff84-4ce0-9c20-458a960aa0a9 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.321796 Aug 04 03:42:08.120700 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 205/409] 10.222.0.66 () {60 vars in 1159 bytes} [Thu Aug 4 03:42:07 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 03:42:08.172320 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-743c063f-28d5-40c7-8363-83277926a799 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:42:08.173492 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-743c063f-28d5-40c7-8363-83277926a799 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] [instance: 3bf41d49-2b84-4f59-a019-a8b1e45891d1] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:42:08.186638 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-743c063f-28d5-40c7-8363-83277926a799 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:42:08.191645 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-743c063f-28d5-40c7-8363-83277926a799 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:42:08.193492 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-743c063f-28d5-40c7-8363-83277926a799 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:42:08.197214 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-743c063f-28d5-40c7-8363-83277926a799 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:42:08.223505 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-cf89e2ec-6227-4eec-b73c-7599ff02fce0 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec8d131a9764028a096314a4ecd58f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9ff6952b014d0a9abb28dcf0b818b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:42:08.230439 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG dbcounter [-] [130263] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:42:08.234390 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-cf89e2ec-6227-4eec-b73c-7599ff02fce0 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] 10.222.0.66 "GET /compute/v2.1/servers/f69fd00d-cf45-4c17-aee5-701e87ebab82" status: 200 len: 1372 microversion: 2.1 time: 0.207685 Aug 04 03:42:08.234954 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 205/410] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:42:08 2022] GET /compute/v2.1/servers/f69fd00d-cf45-4c17-aee5-701e87ebab82 => generated 1372 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:42:08.466717 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-743c063f-28d5-40c7-8363-83277926a799 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:42:08.484370 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-743c063f-28d5-40c7-8363-83277926a799 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:42:08.494202 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-743c063f-28d5-40c7-8363-83277926a799 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:42:08.511570 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-743c063f-28d5-40c7-8363-83277926a799 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] 10.222.0.66 "GET /compute/v2.1/servers/3bf41d49-2b84-4f59-a019-a8b1e45891d1" status: 200 len: 1407 microversion: 2.20 time: 0.329201 Aug 04 03:42:08.511570 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 206/411] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 03:42:08 2022] GET /compute/v2.1/servers/3bf41d49-2b84-4f59-a019-a8b1e45891d1 => generated 1407 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 03:42:09.256214 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-6b261ed9-3b74-4959-8d59-aa67f1c2921f tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:42:09.257017 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-6b261ed9-3b74-4959-8d59-aa67f1c2921f tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] [instance: f69fd00d-cf45-4c17-aee5-701e87ebab82] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:42:09.271318 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-6b261ed9-3b74-4959-8d59-aa67f1c2921f tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:42:09.272010 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-6b261ed9-3b74-4959-8d59-aa67f1c2921f tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:42:09.273002 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-6b261ed9-3b74-4959-8d59-aa67f1c2921f tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:42:09.273697 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-6b261ed9-3b74-4959-8d59-aa67f1c2921f tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:42:09.484432 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-6b261ed9-3b74-4959-8d59-aa67f1c2921f tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec8d131a9764028a096314a4ecd58f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9ff6952b014d0a9abb28dcf0b818b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:42:09.496013 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-6b261ed9-3b74-4959-8d59-aa67f1c2921f tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] 10.222.0.66 "GET /compute/v2.1/servers/f69fd00d-cf45-4c17-aee5-701e87ebab82" status: 200 len: 1372 microversion: 2.1 time: 0.243370 Aug 04 03:42:09.509547 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 206/412] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:42:09 2022] GET /compute/v2.1/servers/f69fd00d-cf45-4c17-aee5-701e87ebab82 => generated 1372 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:42:09.521906 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-91d1d777-60b9-4ddd-9843-7321be121d43 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:42:09.527454 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-91d1d777-60b9-4ddd-9843-7321be121d43 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] [instance: 3bf41d49-2b84-4f59-a019-a8b1e45891d1] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:42:09.533487 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-91d1d777-60b9-4ddd-9843-7321be121d43 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:42:09.535178 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-91d1d777-60b9-4ddd-9843-7321be121d43 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:42:09.539287 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-91d1d777-60b9-4ddd-9843-7321be121d43 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:42:09.541593 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-91d1d777-60b9-4ddd-9843-7321be121d43 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:42:09.817611 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-91d1d777-60b9-4ddd-9843-7321be121d43 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:42:09.832252 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-91d1d777-60b9-4ddd-9843-7321be121d43 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:42:09.836069 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-91d1d777-60b9-4ddd-9843-7321be121d43 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:42:09.840251 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-91d1d777-60b9-4ddd-9843-7321be121d43 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] 10.222.0.66 "GET /compute/v2.1/servers/3bf41d49-2b84-4f59-a019-a8b1e45891d1" status: 200 len: 1407 microversion: 2.20 time: 0.325668 Aug 04 03:42:09.841040 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 207/413] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 03:42:09 2022] GET /compute/v2.1/servers/3bf41d49-2b84-4f59-a019-a8b1e45891d1 => generated 1407 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 03:42:10.527070 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-e15719ef-0779-4f9d-849e-d13af0377e2e tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:42:10.527850 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-e15719ef-0779-4f9d-849e-d13af0377e2e tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] [instance: f69fd00d-cf45-4c17-aee5-701e87ebab82] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:42:10.532820 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [req-19496f2f-a709-47a6-a46b-c473ff3fcd03 req-99cc87f7-efa2-41da-8948-0fa5510a839a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f69fd00d-cf45-4c17-aee5-701e87ebab82", "tag": "792bb385-f4d3-479d-9f3d-2a0bf239cd0d"}]} {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 03:42:10.544756 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG dbcounter [-] [130263] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=130263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:42:10.585548 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-e15719ef-0779-4f9d-849e-d13af0377e2e tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:42:10.588434 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [req-19496f2f-a709-47a6-a46b-c473ff3fcd03 req-99cc87f7-efa2-41da-8948-0fa5510a839a service nova] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:42:10.588885 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [req-19496f2f-a709-47a6-a46b-c473ff3fcd03 req-99cc87f7-efa2-41da-8948-0fa5510a839a service nova] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:42:10.590642 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-e15719ef-0779-4f9d-849e-d13af0377e2e tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:42:10.598958 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-e15719ef-0779-4f9d-849e-d13af0377e2e tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:42:10.599257 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-e15719ef-0779-4f9d-849e-d13af0377e2e tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:42:10.653872 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.compute.server_external_events [req-19496f2f-a709-47a6-a46b-c473ff3fcd03 req-99cc87f7-efa2-41da-8948-0fa5510a839a service nova] Creating event network-changed:792bb385-f4d3-479d-9f3d-2a0bf239cd0d for instance f69fd00d-cf45-4c17-aee5-701e87ebab82 on hv-cinder-73306 Aug 04 03:42:10.672725 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [req-19496f2f-a709-47a6-a46b-c473ff3fcd03 req-99cc87f7-efa2-41da-8948-0fa5510a839a service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.167475 Aug 04 03:42:10.675814 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 207/414] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 03:42:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 03:42:10.870401 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-f40e1cd2-d42d-4725-9150-f0bebd664d3b tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:42:10.871913 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-f40e1cd2-d42d-4725-9150-f0bebd664d3b tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] [instance: 3bf41d49-2b84-4f59-a019-a8b1e45891d1] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:42:10.879690 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-f40e1cd2-d42d-4725-9150-f0bebd664d3b tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:42:10.888152 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-f40e1cd2-d42d-4725-9150-f0bebd664d3b tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:42:10.889455 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-f40e1cd2-d42d-4725-9150-f0bebd664d3b tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:42:10.890090 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-f40e1cd2-d42d-4725-9150-f0bebd664d3b tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:42:11.166773 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-e15719ef-0779-4f9d-849e-d13af0377e2e tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec8d131a9764028a096314a4ecd58f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9ff6952b014d0a9abb28dcf0b818b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:42:11.174073 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-e15719ef-0779-4f9d-849e-d13af0377e2e tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] 10.222.0.66 "GET /compute/v2.1/servers/f69fd00d-cf45-4c17-aee5-701e87ebab82" status: 200 len: 1372 microversion: 2.1 time: 0.659728 Aug 04 03:42:11.181878 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 208/415] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:42:10 2022] GET /compute/v2.1/servers/f69fd00d-cf45-4c17-aee5-701e87ebab82 => generated 1372 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 03:42:11.289142 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-f40e1cd2-d42d-4725-9150-f0bebd664d3b tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:42:11.301050 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-f40e1cd2-d42d-4725-9150-f0bebd664d3b tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:42:11.307344 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-f40e1cd2-d42d-4725-9150-f0bebd664d3b tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:42:11.308753 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-f40e1cd2-d42d-4725-9150-f0bebd664d3b tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] 10.222.0.66 "GET /compute/v2.1/servers/3bf41d49-2b84-4f59-a019-a8b1e45891d1" status: 200 len: 1407 microversion: 2.20 time: 0.445328 Aug 04 03:42:11.312255 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 208/416] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 03:42:10 2022] GET /compute/v2.1/servers/3bf41d49-2b84-4f59-a019-a8b1e45891d1 => generated 1407 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 03:42:12.211978 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-fd21e5aa-a6b5-4e66-8abf-08baf8cb3f6a tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:42:12.212715 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-fd21e5aa-a6b5-4e66-8abf-08baf8cb3f6a tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] [instance: f69fd00d-cf45-4c17-aee5-701e87ebab82] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:42:12.230283 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-fd21e5aa-a6b5-4e66-8abf-08baf8cb3f6a tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:42:12.233733 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-fd21e5aa-a6b5-4e66-8abf-08baf8cb3f6a tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:42:12.242744 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-fd21e5aa-a6b5-4e66-8abf-08baf8cb3f6a tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:42:12.242744 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-fd21e5aa-a6b5-4e66-8abf-08baf8cb3f6a tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:42:12.334622 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-3d681b46-68c5-4390-b5ec-a8e56863db29 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:42:12.336102 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-3d681b46-68c5-4390-b5ec-a8e56863db29 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] [instance: 3bf41d49-2b84-4f59-a019-a8b1e45891d1] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:42:12.348240 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-3d681b46-68c5-4390-b5ec-a8e56863db29 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:42:12.348960 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-3d681b46-68c5-4390-b5ec-a8e56863db29 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:42:12.352188 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-3d681b46-68c5-4390-b5ec-a8e56863db29 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:42:12.354925 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-3d681b46-68c5-4390-b5ec-a8e56863db29 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:42:12.702206 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-fd21e5aa-a6b5-4e66-8abf-08baf8cb3f6a tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec8d131a9764028a096314a4ecd58f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9ff6952b014d0a9abb28dcf0b818b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:42:12.716828 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-fd21e5aa-a6b5-4e66-8abf-08baf8cb3f6a tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] 10.222.0.66 "GET /compute/v2.1/servers/f69fd00d-cf45-4c17-aee5-701e87ebab82" status: 200 len: 1372 microversion: 2.1 time: 0.503800 Aug 04 03:42:12.729828 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 209/417] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:42:12 2022] GET /compute/v2.1/servers/f69fd00d-cf45-4c17-aee5-701e87ebab82 => generated 1372 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:42:12.738165 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [req-ea0103fb-9fa1-4db0-bf63-9b8583b3c8c8 req-6aa69b5e-20d7-49a8-8d63-e932aa8e1437 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3bf41d49-2b84-4f59-a019-a8b1e45891d1", "name": "network-vif-plugged", "status": "completed", "tag": "8144b5cf-3a6c-452a-a3bb-81896a2ba4e0"}]} {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 03:42:12.757111 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [req-ea0103fb-9fa1-4db0-bf63-9b8583b3c8c8 req-6aa69b5e-20d7-49a8-8d63-e932aa8e1437 service nova] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:42:12.764717 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-3d681b46-68c5-4390-b5ec-a8e56863db29 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:42:12.769579 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [req-ea0103fb-9fa1-4db0-bf63-9b8583b3c8c8 req-6aa69b5e-20d7-49a8-8d63-e932aa8e1437 service nova] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:42:12.779449 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-3d681b46-68c5-4390-b5ec-a8e56863db29 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:42:12.783808 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-3d681b46-68c5-4390-b5ec-a8e56863db29 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:42:12.787656 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-3d681b46-68c5-4390-b5ec-a8e56863db29 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] 10.222.0.66 "GET /compute/v2.1/servers/3bf41d49-2b84-4f59-a019-a8b1e45891d1" status: 200 len: 1407 microversion: 2.20 time: 0.457632 Aug 04 03:42:12.795247 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 209/418] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 03:42:12 2022] GET /compute/v2.1/servers/3bf41d49-2b84-4f59-a019-a8b1e45891d1 => generated 1407 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 03:42:12.800838 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.compute.server_external_events [req-ea0103fb-9fa1-4db0-bf63-9b8583b3c8c8 req-6aa69b5e-20d7-49a8-8d63-e932aa8e1437 service nova] Creating event network-vif-plugged:8144b5cf-3a6c-452a-a3bb-81896a2ba4e0 for instance 3bf41d49-2b84-4f59-a019-a8b1e45891d1 on hv-cinder-73306 Aug 04 03:42:12.806411 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [req-ea0103fb-9fa1-4db0-bf63-9b8583b3c8c8 req-6aa69b5e-20d7-49a8-8d63-e932aa8e1437 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087578 Aug 04 03:42:12.807516 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 210/419] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 03:42:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 03:42:13.740199 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-1e30aee2-c440-4eef-8424-4a0b152719ce tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:42:13.741424 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-1e30aee2-c440-4eef-8424-4a0b152719ce tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] [instance: f69fd00d-cf45-4c17-aee5-701e87ebab82] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:42:13.749415 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-1e30aee2-c440-4eef-8424-4a0b152719ce tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:42:13.749415 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-1e30aee2-c440-4eef-8424-4a0b152719ce tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:42:13.749827 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-1e30aee2-c440-4eef-8424-4a0b152719ce tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:42:13.750295 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-1e30aee2-c440-4eef-8424-4a0b152719ce tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:42:13.818687 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-a5ee9a5d-b7e9-4f89-8008-7f7b13d7a18c tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:42:13.820113 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-a5ee9a5d-b7e9-4f89-8008-7f7b13d7a18c tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] [instance: 3bf41d49-2b84-4f59-a019-a8b1e45891d1] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:42:13.828164 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-a5ee9a5d-b7e9-4f89-8008-7f7b13d7a18c tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:42:13.828726 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-a5ee9a5d-b7e9-4f89-8008-7f7b13d7a18c tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:42:13.829644 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-a5ee9a5d-b7e9-4f89-8008-7f7b13d7a18c tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:42:13.830161 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-a5ee9a5d-b7e9-4f89-8008-7f7b13d7a18c tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:42:13.929901 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-1e30aee2-c440-4eef-8424-4a0b152719ce tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec8d131a9764028a096314a4ecd58f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9ff6952b014d0a9abb28dcf0b818b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:42:13.939284 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-1e30aee2-c440-4eef-8424-4a0b152719ce tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] 10.222.0.66 "GET /compute/v2.1/servers/f69fd00d-cf45-4c17-aee5-701e87ebab82" status: 200 len: 1372 microversion: 2.1 time: 0.202815 Aug 04 03:42:13.940347 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 210/420] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:42:13 2022] GET /compute/v2.1/servers/f69fd00d-cf45-4c17-aee5-701e87ebab82 => generated 1372 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:42:14.015816 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-a5ee9a5d-b7e9-4f89-8008-7f7b13d7a18c tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:42:14.030334 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-a5ee9a5d-b7e9-4f89-8008-7f7b13d7a18c tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:42:14.031862 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-a5ee9a5d-b7e9-4f89-8008-7f7b13d7a18c tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:42:14.034080 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-a5ee9a5d-b7e9-4f89-8008-7f7b13d7a18c tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] 10.222.0.66 "GET /compute/v2.1/servers/3bf41d49-2b84-4f59-a019-a8b1e45891d1" status: 200 len: 1407 microversion: 2.20 time: 0.220250 Aug 04 03:42:14.046228 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 211/421] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 03:42:13 2022] GET /compute/v2.1/servers/3bf41d49-2b84-4f59-a019-a8b1e45891d1 => generated 1407 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 03:42:14.960699 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-3e690426-d316-4892-84e9-e9466a4db681 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:42:14.962643 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-3e690426-d316-4892-84e9-e9466a4db681 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] [instance: f69fd00d-cf45-4c17-aee5-701e87ebab82] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:42:14.976449 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-3e690426-d316-4892-84e9-e9466a4db681 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:42:14.978926 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-3e690426-d316-4892-84e9-e9466a4db681 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:42:14.978926 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-3e690426-d316-4892-84e9-e9466a4db681 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:42:14.979388 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-3e690426-d316-4892-84e9-e9466a4db681 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:42:15.060533 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-1e99bc52-2016-40cc-83fb-127e23fe6da4 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:42:15.062340 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-1e99bc52-2016-40cc-83fb-127e23fe6da4 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] [instance: 3bf41d49-2b84-4f59-a019-a8b1e45891d1] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:42:15.075869 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-1e99bc52-2016-40cc-83fb-127e23fe6da4 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:42:15.084982 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-1e99bc52-2016-40cc-83fb-127e23fe6da4 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:42:15.087349 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-1e99bc52-2016-40cc-83fb-127e23fe6da4 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:42:15.088544 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-1e99bc52-2016-40cc-83fb-127e23fe6da4 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:42:15.154377 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-3e690426-d316-4892-84e9-e9466a4db681 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec8d131a9764028a096314a4ecd58f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9ff6952b014d0a9abb28dcf0b818b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:42:15.162586 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-3e690426-d316-4892-84e9-e9466a4db681 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] 10.222.0.66 "GET /compute/v2.1/servers/f69fd00d-cf45-4c17-aee5-701e87ebab82" status: 200 len: 1372 microversion: 2.1 time: 0.206259 Aug 04 03:42:15.181413 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 211/422] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:42:14 2022] GET /compute/v2.1/servers/f69fd00d-cf45-4c17-aee5-701e87ebab82 => generated 1372 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:42:15.312712 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-1e99bc52-2016-40cc-83fb-127e23fe6da4 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:42:15.326401 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-1e99bc52-2016-40cc-83fb-127e23fe6da4 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:42:15.328888 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-1e99bc52-2016-40cc-83fb-127e23fe6da4 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:42:15.330459 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-1e99bc52-2016-40cc-83fb-127e23fe6da4 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] 10.222.0.66 "GET /compute/v2.1/servers/3bf41d49-2b84-4f59-a019-a8b1e45891d1" status: 200 len: 1407 microversion: 2.20 time: 0.277372 Aug 04 03:42:15.345015 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 212/423] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 03:42:15 2022] GET /compute/v2.1/servers/3bf41d49-2b84-4f59-a019-a8b1e45891d1 => generated 1407 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 03:42:16.188685 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-f3c0ec98-90c3-4bf4-a0d3-d3a435fd61ac tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:42:16.189945 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-f3c0ec98-90c3-4bf4-a0d3-d3a435fd61ac tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] [instance: f69fd00d-cf45-4c17-aee5-701e87ebab82] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:42:16.196420 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-f3c0ec98-90c3-4bf4-a0d3-d3a435fd61ac tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:42:16.196868 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-f3c0ec98-90c3-4bf4-a0d3-d3a435fd61ac tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:42:16.197686 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-f3c0ec98-90c3-4bf4-a0d3-d3a435fd61ac tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:42:16.198126 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-f3c0ec98-90c3-4bf4-a0d3-d3a435fd61ac tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:42:16.352026 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-f3c0ec98-90c3-4bf4-a0d3-d3a435fd61ac tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec8d131a9764028a096314a4ecd58f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9ff6952b014d0a9abb28dcf0b818b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:42:16.357980 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-a967014a-a0e3-4d5d-b05e-635a5a2dfc25 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:42:16.359338 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-a967014a-a0e3-4d5d-b05e-635a5a2dfc25 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] [instance: 3bf41d49-2b84-4f59-a019-a8b1e45891d1] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:42:16.367047 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-f3c0ec98-90c3-4bf4-a0d3-d3a435fd61ac tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] 10.222.0.66 "GET /compute/v2.1/servers/f69fd00d-cf45-4c17-aee5-701e87ebab82" status: 200 len: 1372 microversion: 2.1 time: 0.182136 Aug 04 03:42:16.368643 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 212/424] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:42:16 2022] GET /compute/v2.1/servers/f69fd00d-cf45-4c17-aee5-701e87ebab82 => generated 1372 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:42:16.373541 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-a967014a-a0e3-4d5d-b05e-635a5a2dfc25 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:42:16.374428 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-a967014a-a0e3-4d5d-b05e-635a5a2dfc25 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:42:16.380760 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-a967014a-a0e3-4d5d-b05e-635a5a2dfc25 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:42:16.380760 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-a967014a-a0e3-4d5d-b05e-635a5a2dfc25 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:42:16.577429 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-a967014a-a0e3-4d5d-b05e-635a5a2dfc25 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:42:16.585618 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-a967014a-a0e3-4d5d-b05e-635a5a2dfc25 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:42:16.587658 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-a967014a-a0e3-4d5d-b05e-635a5a2dfc25 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:42:16.588774 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-a967014a-a0e3-4d5d-b05e-635a5a2dfc25 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] 10.222.0.66 "GET /compute/v2.1/servers/3bf41d49-2b84-4f59-a019-a8b1e45891d1" status: 200 len: 1407 microversion: 2.20 time: 0.238747 Aug 04 03:42:16.589360 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 213/425] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 03:42:16 2022] GET /compute/v2.1/servers/3bf41d49-2b84-4f59-a019-a8b1e45891d1 => generated 1407 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 03:42:17.402306 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-3220a721-82ba-4ca2-88c2-f5fed765a527 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:42:17.403845 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-3220a721-82ba-4ca2-88c2-f5fed765a527 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] [instance: f69fd00d-cf45-4c17-aee5-701e87ebab82] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:42:17.411106 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-3220a721-82ba-4ca2-88c2-f5fed765a527 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:42:17.411630 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-3220a721-82ba-4ca2-88c2-f5fed765a527 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:42:17.412493 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-3220a721-82ba-4ca2-88c2-f5fed765a527 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:42:17.413053 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-3220a721-82ba-4ca2-88c2-f5fed765a527 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:42:17.566799 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-3220a721-82ba-4ca2-88c2-f5fed765a527 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec8d131a9764028a096314a4ecd58f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9ff6952b014d0a9abb28dcf0b818b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:42:17.575370 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-3220a721-82ba-4ca2-88c2-f5fed765a527 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] 10.222.0.66 "GET /compute/v2.1/servers/f69fd00d-cf45-4c17-aee5-701e87ebab82" status: 200 len: 1372 microversion: 2.1 time: 0.177215 Aug 04 03:42:17.575943 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 213/426] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:42:17 2022] GET /compute/v2.1/servers/f69fd00d-cf45-4c17-aee5-701e87ebab82 => generated 1372 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:42:17.612103 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-4fe645a6-594e-4177-8037-c07a0a3b39c3 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:42:17.612926 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-4fe645a6-594e-4177-8037-c07a0a3b39c3 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] [instance: 3bf41d49-2b84-4f59-a019-a8b1e45891d1] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:42:17.620079 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-4fe645a6-594e-4177-8037-c07a0a3b39c3 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:42:17.620813 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-4fe645a6-594e-4177-8037-c07a0a3b39c3 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:42:17.621669 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-4fe645a6-594e-4177-8037-c07a0a3b39c3 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:42:17.622173 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-4fe645a6-594e-4177-8037-c07a0a3b39c3 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:42:17.843091 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-4fe645a6-594e-4177-8037-c07a0a3b39c3 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:42:17.856328 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-4fe645a6-594e-4177-8037-c07a0a3b39c3 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:42:17.856328 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-4fe645a6-594e-4177-8037-c07a0a3b39c3 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:42:17.856738 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-4fe645a6-594e-4177-8037-c07a0a3b39c3 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] 10.222.0.66 "GET /compute/v2.1/servers/3bf41d49-2b84-4f59-a019-a8b1e45891d1" status: 200 len: 1599 microversion: 2.20 time: 0.248501 Aug 04 03:42:17.869227 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 214/427] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 03:42:17 2022] GET /compute/v2.1/servers/3bf41d49-2b84-4f59-a019-a8b1e45891d1 => generated 1599 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 03:42:17.879852 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-312a89cb-b876-4869-a68b-108b2fa105ae tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:42:17.885054 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-312a89cb-b876-4869-a68b-108b2fa105ae tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] [instance: 3bf41d49-2b84-4f59-a019-a8b1e45891d1] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:42:17.888148 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-312a89cb-b876-4869-a68b-108b2fa105ae tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:42:17.888595 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-312a89cb-b876-4869-a68b-108b2fa105ae tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:42:17.889435 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-312a89cb-b876-4869-a68b-108b2fa105ae tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:42:17.889932 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-312a89cb-b876-4869-a68b-108b2fa105ae tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:42:17.981447 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-312a89cb-b876-4869-a68b-108b2fa105ae tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] 10.222.0.66 "GET /compute/v2.1/servers/3bf41d49-2b84-4f59-a019-a8b1e45891d1/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.105958 Aug 04 03:42:17.989342 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 214/428] 10.222.0.66 () {60 vars in 1316 bytes} [Thu Aug 4 03:42:17 2022] GET /compute/v2.1/servers/3bf41d49-2b84-4f59-a019-a8b1e45891d1/os-interface => generated 284 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 03:42:18.063184 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [req-b85f0732-7555-4b55-afee-0af167528699 req-a8b07a12-ce9b-4854-a4e2-d88d794eb3ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f69fd00d-cf45-4c17-aee5-701e87ebab82", "name": "network-vif-plugged", "status": "completed", "tag": "792bb385-f4d3-479d-9f3d-2a0bf239cd0d"}]} {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 03:42:18.073566 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG dbcounter [-] [130263] Writing DB stats nova_cell0:SELECT=4 {{(pid=130263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:42:18.076063 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [req-b85f0732-7555-4b55-afee-0af167528699 req-a8b07a12-ce9b-4854-a4e2-d88d794eb3ab service nova] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:42:18.076809 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [req-b85f0732-7555-4b55-afee-0af167528699 req-a8b07a12-ce9b-4854-a4e2-d88d794eb3ab service nova] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:42:18.094907 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.compute.server_external_events [req-b85f0732-7555-4b55-afee-0af167528699 req-a8b07a12-ce9b-4854-a4e2-d88d794eb3ab service nova] Creating event network-vif-plugged:792bb385-f4d3-479d-9f3d-2a0bf239cd0d for instance f69fd00d-cf45-4c17-aee5-701e87ebab82 on hv-cinder-73306 Aug 04 03:42:18.100284 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [req-b85f0732-7555-4b55-afee-0af167528699 req-a8b07a12-ce9b-4854-a4e2-d88d794eb3ab service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044915 Aug 04 03:42:18.100964 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 215/429] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 03:42:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 03:42:18.599815 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-ab563b77-9db1-4ad2-b333-8421d90b110d tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:42:18.601072 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-ab563b77-9db1-4ad2-b333-8421d90b110d tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] [instance: f69fd00d-cf45-4c17-aee5-701e87ebab82] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:42:18.603883 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG dbcounter [-] [130262] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=4 {{(pid=130262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:42:18.616078 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-ab563b77-9db1-4ad2-b333-8421d90b110d tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:42:18.620392 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-ab563b77-9db1-4ad2-b333-8421d90b110d tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:42:18.621289 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-ab563b77-9db1-4ad2-b333-8421d90b110d tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:42:18.621703 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-ab563b77-9db1-4ad2-b333-8421d90b110d tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:42:18.896499 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-ab563b77-9db1-4ad2-b333-8421d90b110d tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec8d131a9764028a096314a4ecd58f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9ff6952b014d0a9abb28dcf0b818b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:42:18.907548 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-ab563b77-9db1-4ad2-b333-8421d90b110d tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] 10.222.0.66 "GET /compute/v2.1/servers/f69fd00d-cf45-4c17-aee5-701e87ebab82" status: 200 len: 1372 microversion: 2.1 time: 0.312027 Aug 04 03:42:18.910375 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 215/430] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:42:18 2022] GET /compute/v2.1/servers/f69fd00d-cf45-4c17-aee5-701e87ebab82 => generated 1372 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:42:19.659097 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [req-32157bb7-4fb3-42f9-83b0-73318022803e req-17146251-7742-4ebd-acb8-c7a305462f9c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3bf41d49-2b84-4f59-a019-a8b1e45891d1", "tag": "8144b5cf-3a6c-452a-a3bb-81896a2ba4e0"}]} {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 03:42:19.679796 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [req-32157bb7-4fb3-42f9-83b0-73318022803e req-17146251-7742-4ebd-acb8-c7a305462f9c service nova] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:42:19.680431 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [req-32157bb7-4fb3-42f9-83b0-73318022803e req-17146251-7742-4ebd-acb8-c7a305462f9c service nova] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:42:19.697686 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.compute.server_external_events [req-32157bb7-4fb3-42f9-83b0-73318022803e req-17146251-7742-4ebd-acb8-c7a305462f9c service nova] Creating event network-changed:8144b5cf-3a6c-452a-a3bb-81896a2ba4e0 for instance 3bf41d49-2b84-4f59-a019-a8b1e45891d1 on hv-cinder-73306 Aug 04 03:42:19.703601 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [req-32157bb7-4fb3-42f9-83b0-73318022803e req-17146251-7742-4ebd-acb8-c7a305462f9c service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049744 Aug 04 03:42:19.704436 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 216/431] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 03:42:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 03:42:19.944046 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-01958a88-494f-4da7-8eee-adcbabd30bc6 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:42:19.944046 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-01958a88-494f-4da7-8eee-adcbabd30bc6 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] [instance: f69fd00d-cf45-4c17-aee5-701e87ebab82] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:42:19.949579 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-01958a88-494f-4da7-8eee-adcbabd30bc6 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:42:19.955013 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-01958a88-494f-4da7-8eee-adcbabd30bc6 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:42:19.957748 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-01958a88-494f-4da7-8eee-adcbabd30bc6 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:42:19.958336 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-01958a88-494f-4da7-8eee-adcbabd30bc6 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:42:20.264095 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-01958a88-494f-4da7-8eee-adcbabd30bc6 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec8d131a9764028a096314a4ecd58f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9ff6952b014d0a9abb28dcf0b818b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:42:20.275000 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-01958a88-494f-4da7-8eee-adcbabd30bc6 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] 10.222.0.66 "GET /compute/v2.1/servers/f69fd00d-cf45-4c17-aee5-701e87ebab82" status: 200 len: 1372 microversion: 2.1 time: 0.344601 Aug 04 03:42:20.275962 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 216/432] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:42:19 2022] GET /compute/v2.1/servers/f69fd00d-cf45-4c17-aee5-701e87ebab82 => generated 1372 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:42:21.299120 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-6a3653ad-bb75-42cd-a620-3db0ea9f4cfa tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:42:21.299821 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-6a3653ad-bb75-42cd-a620-3db0ea9f4cfa tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] [instance: f69fd00d-cf45-4c17-aee5-701e87ebab82] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:42:21.315223 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-6a3653ad-bb75-42cd-a620-3db0ea9f4cfa tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:42:21.316757 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-6a3653ad-bb75-42cd-a620-3db0ea9f4cfa tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:42:21.317758 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-6a3653ad-bb75-42cd-a620-3db0ea9f4cfa tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:42:21.319197 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-6a3653ad-bb75-42cd-a620-3db0ea9f4cfa tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:42:21.525258 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-6a3653ad-bb75-42cd-a620-3db0ea9f4cfa tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec8d131a9764028a096314a4ecd58f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9ff6952b014d0a9abb28dcf0b818b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:42:21.538194 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-6a3653ad-bb75-42cd-a620-3db0ea9f4cfa tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] 10.222.0.66 "GET /compute/v2.1/servers/f69fd00d-cf45-4c17-aee5-701e87ebab82" status: 200 len: 1566 microversion: 2.1 time: 0.239166 Aug 04 03:42:21.538194 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 217/433] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:42:21 2022] GET /compute/v2.1/servers/f69fd00d-cf45-4c17-aee5-701e87ebab82 => generated 1566 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:42:21.562459 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-fd3d106a-9d6a-4f9a-afeb-b7113ba16ec4 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:42:21.568344 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-fd3d106a-9d6a-4f9a-afeb-b7113ba16ec4 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] [instance: f69fd00d-cf45-4c17-aee5-701e87ebab82] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:42:21.570498 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-fd3d106a-9d6a-4f9a-afeb-b7113ba16ec4 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:42:21.571297 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-fd3d106a-9d6a-4f9a-afeb-b7113ba16ec4 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:42:21.572368 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-fd3d106a-9d6a-4f9a-afeb-b7113ba16ec4 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:42:21.573088 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-fd3d106a-9d6a-4f9a-afeb-b7113ba16ec4 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:42:21.688719 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-fd3d106a-9d6a-4f9a-afeb-b7113ba16ec4 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] 10.222.0.66 "GET /compute/v2.1/servers/f69fd00d-cf45-4c17-aee5-701e87ebab82/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.130281 Aug 04 03:42:21.689371 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 217/434] 10.222.0.66 () {58 vars in 1275 bytes} [Thu Aug 4 03:42:21 2022] GET /compute/v2.1/servers/f69fd00d-cf45-4c17-aee5-701e87ebab82/os-interface => generated 285 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 03:42:22.988445 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [req-cbc4521b-560f-446b-87b0-cb0e375d7d24 req-5af4727d-899a-4c59-9123-2fe444daf9f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f69fd00d-cf45-4c17-aee5-701e87ebab82", "tag": "792bb385-f4d3-479d-9f3d-2a0bf239cd0d"}]} {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 03:42:23.023134 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [req-cbc4521b-560f-446b-87b0-cb0e375d7d24 req-5af4727d-899a-4c59-9123-2fe444daf9f7 service nova] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:42:23.024551 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [req-cbc4521b-560f-446b-87b0-cb0e375d7d24 req-5af4727d-899a-4c59-9123-2fe444daf9f7 service nova] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:42:23.039229 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.compute.server_external_events [req-cbc4521b-560f-446b-87b0-cb0e375d7d24 req-5af4727d-899a-4c59-9123-2fe444daf9f7 service nova] Creating event network-changed:792bb385-f4d3-479d-9f3d-2a0bf239cd0d for instance f69fd00d-cf45-4c17-aee5-701e87ebab82 on hv-cinder-73306 Aug 04 03:42:23.047735 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [req-cbc4521b-560f-446b-87b0-cb0e375d7d24 req-5af4727d-899a-4c59-9123-2fe444daf9f7 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067086 Aug 04 03:42:23.049830 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 218/435] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 03:42:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 03:42:33.451819 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG dbcounter [-] [130262] Writing DB stats nova_api:SELECT=5 {{(pid=130262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:42:33.452557 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG dbcounter [-] [130262] Writing DB stats nova_cell1:SELECT=70 {{(pid=130262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:42:33.456515 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-46024bf4-b301-4b4b-ad6d-f3489ed940ef tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-90600689", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1601506750", "security_groups": [{"name": "tempest-secgroup-smoke-1970759830"}], "networks": [{"uuid": "27828057-a308-490a-9bc8-2699d9222bb7"}], "block_device_mapping_v2": [{"uuid": "669f82f8-030c-48f4-8582-e3e245a0a7f8", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 03:42:33.583494 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.network.neutron [None req-46024bf4-b301-4b4b-ad6d-f3489ed940ef tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] validate_networks() for [('27828057-a308-490a-9bc8-2699d9222bb7', None, None, None, None, None)] {{(pid=130262) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 03:42:33.977870 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.virt.hardware [None req-46024bf4-b301-4b4b-ad6d-f3489ed940ef tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Flavor limits 0:0:0 {{(pid=130262) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 03:42:33.978284 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.virt.hardware [None req-46024bf4-b301-4b4b-ad6d-f3489ed940ef tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Image limits 0:0:0 {{(pid=130262) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 03:42:33.978750 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.virt.hardware [None req-46024bf4-b301-4b4b-ad6d-f3489ed940ef tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Flavor pref 0:0:0 {{(pid=130262) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 03:42:33.979147 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.virt.hardware [None req-46024bf4-b301-4b4b-ad6d-f3489ed940ef tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Image pref 0:0:0 {{(pid=130262) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 03:42:33.979576 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.virt.hardware [None req-46024bf4-b301-4b4b-ad6d-f3489ed940ef tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130262) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 03:42:33.988438 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-46024bf4-b301-4b4b-ad6d-f3489ed940ef tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:42:33.988873 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-46024bf4-b301-4b4b-ad6d-f3489ed940ef tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:42:33.989687 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-46024bf4-b301-4b4b-ad6d-f3489ed940ef tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:42:33.990117 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-46024bf4-b301-4b4b-ad6d-f3489ed940ef tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:42:34.007117 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.quota [None req-46024bf4-b301-4b4b-ad6d-f3489ed940ef tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Getting quotas for project cf95e3e43d0e482ba4d27b769fb48628. Resources: {'instances', 'ram', 'cores'} {{(pid=130262) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 03:42:34.012375 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.quota [None req-46024bf4-b301-4b4b-ad6d-f3489ed940ef tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Getting quotas for user dcc12077b11448a3b1ec2e7dbf2707ef and project cf95e3e43d0e482ba4d27b769fb48628. Resources: {'instances', 'ram', 'cores'} {{(pid=130262) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 03:42:34.070540 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-46024bf4-b301-4b4b-ad6d-f3489ed940ef tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Going to run 1 instances... {{(pid=130262) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 03:42:34.073299 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-46024bf4-b301-4b4b-ad6d-f3489ed940ef tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] [instance: d097d81a-1bae-45f2-a34f-444776c8e1cb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='669f82f8-030c-48f4-8582-e3e245a0a7f8',volume_size=None,volume_type=None)] {{(pid=130262) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 03:42:34.448126 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-46024bf4-b301-4b4b-ad6d-f3489ed940ef tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.997140 Aug 04 03:42:34.448784 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 218/436] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 03:42:33 2022] POST /compute/v2.1/servers => generated 406 bytes in 998 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 03:42:34.460207 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-2d15fefc-548c-46f4-8ce7-d093733c3ea7 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:42:34.460896 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-2d15fefc-548c-46f4-8ce7-d093733c3ea7 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] [instance: d097d81a-1bae-45f2-a34f-444776c8e1cb] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:42:34.464175 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG dbcounter [-] [130263] Writing DB stats nova_api:SELECT=21 {{(pid=130263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:42:34.464836 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG dbcounter [-] [130263] Writing DB stats nova_cell1:SELECT=58 {{(pid=130263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:42:34.520526 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-2d15fefc-548c-46f4-8ce7-d093733c3ea7 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc12077b11448a3b1ec2e7dbf2707ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf95e3e43d0e482ba4d27b769fb48628', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:42:34.528621 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-2d15fefc-548c-46f4-8ce7-d093733c3ea7 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] 10.222.0.66 "GET /compute/v2.1/servers/d097d81a-1bae-45f2-a34f-444776c8e1cb" status: 200 len: 1087 microversion: 2.1 time: 0.072611 Aug 04 03:42:34.529220 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 219/437] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:42:34 2022] GET /compute/v2.1/servers/d097d81a-1bae-45f2-a34f-444776c8e1cb => generated 1087 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:42:35.550027 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-fe49346d-bab7-45df-941b-04ff157e01d7 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:42:35.550633 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-fe49346d-bab7-45df-941b-04ff157e01d7 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] [instance: d097d81a-1bae-45f2-a34f-444776c8e1cb] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:42:35.557665 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-fe49346d-bab7-45df-941b-04ff157e01d7 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:42:35.561983 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-fe49346d-bab7-45df-941b-04ff157e01d7 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:42:35.561983 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-fe49346d-bab7-45df-941b-04ff157e01d7 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:42:35.561983 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-fe49346d-bab7-45df-941b-04ff157e01d7 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:42:35.624686 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-fe49346d-bab7-45df-941b-04ff157e01d7 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc12077b11448a3b1ec2e7dbf2707ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf95e3e43d0e482ba4d27b769fb48628', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:42:35.633108 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-fe49346d-bab7-45df-941b-04ff157e01d7 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] 10.222.0.66 "GET /compute/v2.1/servers/d097d81a-1bae-45f2-a34f-444776c8e1cb" status: 200 len: 1137 microversion: 2.1 time: 0.086666 Aug 04 03:42:35.645262 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 219/438] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:42:35 2022] GET /compute/v2.1/servers/d097d81a-1bae-45f2-a34f-444776c8e1cb => generated 1137 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:42:36.655325 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-fe073205-a4a2-482f-bb6a-b19e8b2ab668 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:42:36.656160 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-fe073205-a4a2-482f-bb6a-b19e8b2ab668 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] [instance: d097d81a-1bae-45f2-a34f-444776c8e1cb] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:42:36.666085 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-fe073205-a4a2-482f-bb6a-b19e8b2ab668 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:42:36.666598 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-fe073205-a4a2-482f-bb6a-b19e8b2ab668 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:42:36.667368 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-fe073205-a4a2-482f-bb6a-b19e8b2ab668 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:42:36.667798 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-fe073205-a4a2-482f-bb6a-b19e8b2ab668 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:42:36.734176 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-fe073205-a4a2-482f-bb6a-b19e8b2ab668 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc12077b11448a3b1ec2e7dbf2707ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf95e3e43d0e482ba4d27b769fb48628', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:42:36.742156 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-fe073205-a4a2-482f-bb6a-b19e8b2ab668 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] 10.222.0.66 "GET /compute/v2.1/servers/d097d81a-1bae-45f2-a34f-444776c8e1cb" status: 200 len: 1185 microversion: 2.1 time: 0.091777 Aug 04 03:42:36.742734 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 220/439] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:42:36 2022] GET /compute/v2.1/servers/d097d81a-1bae-45f2-a34f-444776c8e1cb => generated 1185 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:42:37.764897 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-2c1c131b-96f4-44b6-86df-c67c4007e722 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:42:37.765769 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-2c1c131b-96f4-44b6-86df-c67c4007e722 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] [instance: d097d81a-1bae-45f2-a34f-444776c8e1cb] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:42:37.772149 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-2c1c131b-96f4-44b6-86df-c67c4007e722 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:42:37.772779 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-2c1c131b-96f4-44b6-86df-c67c4007e722 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:42:37.775007 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-2c1c131b-96f4-44b6-86df-c67c4007e722 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:42:37.775007 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-2c1c131b-96f4-44b6-86df-c67c4007e722 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:42:37.951438 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-2c1c131b-96f4-44b6-86df-c67c4007e722 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc12077b11448a3b1ec2e7dbf2707ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf95e3e43d0e482ba4d27b769fb48628', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:42:37.959697 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-2c1c131b-96f4-44b6-86df-c67c4007e722 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] 10.222.0.66 "GET /compute/v2.1/servers/d097d81a-1bae-45f2-a34f-444776c8e1cb" status: 200 len: 1271 microversion: 2.1 time: 0.199945 Aug 04 03:42:37.968616 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 220/440] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:42:37 2022] GET /compute/v2.1/servers/d097d81a-1bae-45f2-a34f-444776c8e1cb => generated 1271 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:42:38.570536 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [req-691e5132-f1fc-4dd5-b12f-d30e184059d3 req-edd17116-ab67-4014-980d-16256fdb8721 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d097d81a-1bae-45f2-a34f-444776c8e1cb", "tag": "118548b5-15c3-4cd8-ab62-4c3490efe26d"}]} {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 03:42:38.581226 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [req-691e5132-f1fc-4dd5-b12f-d30e184059d3 req-edd17116-ab67-4014-980d-16256fdb8721 service nova] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:42:38.581693 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [req-691e5132-f1fc-4dd5-b12f-d30e184059d3 req-edd17116-ab67-4014-980d-16256fdb8721 service nova] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:42:38.592895 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.compute.server_external_events [req-691e5132-f1fc-4dd5-b12f-d30e184059d3 req-edd17116-ab67-4014-980d-16256fdb8721 service nova] Creating event network-changed:118548b5-15c3-4cd8-ab62-4c3490efe26d for instance d097d81a-1bae-45f2-a34f-444776c8e1cb on hv-cinder-73306 Aug 04 03:42:38.597701 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [req-691e5132-f1fc-4dd5-b12f-d30e184059d3 req-edd17116-ab67-4014-980d-16256fdb8721 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030785 Aug 04 03:42:38.598291 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 221/441] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 03:42:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 03:42:38.983041 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-9cfbbbdb-ec3d-4649-ab9f-40f698abad48 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:42:38.983584 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-9cfbbbdb-ec3d-4649-ab9f-40f698abad48 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] [instance: d097d81a-1bae-45f2-a34f-444776c8e1cb] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:42:38.991010 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-9cfbbbdb-ec3d-4649-ab9f-40f698abad48 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:42:38.991496 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-9cfbbbdb-ec3d-4649-ab9f-40f698abad48 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:42:38.992284 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-9cfbbbdb-ec3d-4649-ab9f-40f698abad48 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:42:38.992720 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-9cfbbbdb-ec3d-4649-ab9f-40f698abad48 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:42:39.129473 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-9cfbbbdb-ec3d-4649-ab9f-40f698abad48 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc12077b11448a3b1ec2e7dbf2707ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf95e3e43d0e482ba4d27b769fb48628', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:42:39.137546 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-9cfbbbdb-ec3d-4649-ab9f-40f698abad48 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] 10.222.0.66 "GET /compute/v2.1/servers/d097d81a-1bae-45f2-a34f-444776c8e1cb" status: 200 len: 1259 microversion: 2.1 time: 0.159168 Aug 04 03:42:39.138130 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 221/442] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:42:38 2022] GET /compute/v2.1/servers/d097d81a-1bae-45f2-a34f-444776c8e1cb => generated 1259 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:42:40.160046 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-913837be-61eb-41f9-863d-26fc0e04c80b tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:42:40.160858 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-913837be-61eb-41f9-863d-26fc0e04c80b tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] [instance: d097d81a-1bae-45f2-a34f-444776c8e1cb] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:42:40.169095 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-913837be-61eb-41f9-863d-26fc0e04c80b tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:42:40.169656 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-913837be-61eb-41f9-863d-26fc0e04c80b tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:42:40.170440 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-913837be-61eb-41f9-863d-26fc0e04c80b tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:42:40.170967 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-913837be-61eb-41f9-863d-26fc0e04c80b tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:42:40.311293 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-913837be-61eb-41f9-863d-26fc0e04c80b tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc12077b11448a3b1ec2e7dbf2707ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf95e3e43d0e482ba4d27b769fb48628', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:42:40.318825 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-913837be-61eb-41f9-863d-26fc0e04c80b tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] 10.222.0.66 "GET /compute/v2.1/servers/d097d81a-1bae-45f2-a34f-444776c8e1cb" status: 200 len: 1259 microversion: 2.1 time: 0.163649 Aug 04 03:42:40.319389 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 222/443] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:42:40 2022] GET /compute/v2.1/servers/d097d81a-1bae-45f2-a34f-444776c8e1cb => generated 1259 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:42:41.340767 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-a6e1e0ea-edfc-4ca7-9d94-66a5d3f5d925 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:42:41.341632 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-a6e1e0ea-edfc-4ca7-9d94-66a5d3f5d925 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] [instance: d097d81a-1bae-45f2-a34f-444776c8e1cb] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:42:41.347749 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-a6e1e0ea-edfc-4ca7-9d94-66a5d3f5d925 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:42:41.348189 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-a6e1e0ea-edfc-4ca7-9d94-66a5d3f5d925 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:42:41.348952 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-a6e1e0ea-edfc-4ca7-9d94-66a5d3f5d925 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:42:41.349412 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-a6e1e0ea-edfc-4ca7-9d94-66a5d3f5d925 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:42:41.483314 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-a6e1e0ea-edfc-4ca7-9d94-66a5d3f5d925 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc12077b11448a3b1ec2e7dbf2707ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf95e3e43d0e482ba4d27b769fb48628', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:42:41.491229 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-a6e1e0ea-edfc-4ca7-9d94-66a5d3f5d925 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] 10.222.0.66 "GET /compute/v2.1/servers/d097d81a-1bae-45f2-a34f-444776c8e1cb" status: 200 len: 1259 microversion: 2.1 time: 0.154972 Aug 04 03:42:41.491791 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 222/444] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:42:41 2022] GET /compute/v2.1/servers/d097d81a-1bae-45f2-a34f-444776c8e1cb => generated 1259 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 03:42:42.512108 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-d0ad7d2c-560b-454b-a194-e915d7dce800 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:42:42.512715 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-d0ad7d2c-560b-454b-a194-e915d7dce800 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] [instance: d097d81a-1bae-45f2-a34f-444776c8e1cb] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:42:42.519484 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-d0ad7d2c-560b-454b-a194-e915d7dce800 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:42:42.519932 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-d0ad7d2c-560b-454b-a194-e915d7dce800 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:42:42.520708 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-d0ad7d2c-560b-454b-a194-e915d7dce800 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:42:42.521140 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-d0ad7d2c-560b-454b-a194-e915d7dce800 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:42:42.660354 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-d0ad7d2c-560b-454b-a194-e915d7dce800 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc12077b11448a3b1ec2e7dbf2707ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf95e3e43d0e482ba4d27b769fb48628', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:42:42.668891 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-d0ad7d2c-560b-454b-a194-e915d7dce800 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] 10.222.0.66 "GET /compute/v2.1/servers/d097d81a-1bae-45f2-a34f-444776c8e1cb" status: 200 len: 1259 microversion: 2.1 time: 0.160802 Aug 04 03:42:42.669592 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 223/445] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:42:42 2022] GET /compute/v2.1/servers/d097d81a-1bae-45f2-a34f-444776c8e1cb => generated 1259 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:42:43.690083 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-a6d083c9-0515-4be9-8cfb-3b8467bbf6bc tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:42:43.690684 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-a6d083c9-0515-4be9-8cfb-3b8467bbf6bc tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] [instance: d097d81a-1bae-45f2-a34f-444776c8e1cb] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:42:43.696852 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-a6d083c9-0515-4be9-8cfb-3b8467bbf6bc tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:42:43.697380 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-a6d083c9-0515-4be9-8cfb-3b8467bbf6bc tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:42:43.698326 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-a6d083c9-0515-4be9-8cfb-3b8467bbf6bc tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:42:43.698757 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-a6d083c9-0515-4be9-8cfb-3b8467bbf6bc tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:42:43.838683 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-a6d083c9-0515-4be9-8cfb-3b8467bbf6bc tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc12077b11448a3b1ec2e7dbf2707ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf95e3e43d0e482ba4d27b769fb48628', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:42:43.846455 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-a6d083c9-0515-4be9-8cfb-3b8467bbf6bc tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] 10.222.0.66 "GET /compute/v2.1/servers/d097d81a-1bae-45f2-a34f-444776c8e1cb" status: 200 len: 1259 microversion: 2.1 time: 0.160252 Aug 04 03:42:43.847019 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 223/446] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:42:43 2022] GET /compute/v2.1/servers/d097d81a-1bae-45f2-a34f-444776c8e1cb => generated 1259 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:42:44.864941 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG dbcounter [-] [130263] Writing DB stats nova_cell0:SELECT=2 {{(pid=130263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:42:44.871471 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-c24c203b-1aff-43b7-9a1e-a5763550bc0f tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:42:44.872102 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-c24c203b-1aff-43b7-9a1e-a5763550bc0f tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] [instance: d097d81a-1bae-45f2-a34f-444776c8e1cb] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:42:44.878131 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-c24c203b-1aff-43b7-9a1e-a5763550bc0f tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:42:44.878585 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-c24c203b-1aff-43b7-9a1e-a5763550bc0f tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:42:44.881839 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-c24c203b-1aff-43b7-9a1e-a5763550bc0f tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:42:44.881839 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-c24c203b-1aff-43b7-9a1e-a5763550bc0f tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:42:45.082079 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-c24c203b-1aff-43b7-9a1e-a5763550bc0f tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc12077b11448a3b1ec2e7dbf2707ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf95e3e43d0e482ba4d27b769fb48628', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:42:45.091561 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-c24c203b-1aff-43b7-9a1e-a5763550bc0f tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] 10.222.0.66 "GET /compute/v2.1/servers/d097d81a-1bae-45f2-a34f-444776c8e1cb" status: 200 len: 1259 microversion: 2.1 time: 0.227863 Aug 04 03:42:45.092143 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 224/447] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:42:44 2022] GET /compute/v2.1/servers/d097d81a-1bae-45f2-a34f-444776c8e1cb => generated 1259 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:42:46.113329 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-5d807bba-8a54-4157-9dda-bb1967add023 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:42:46.113945 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-5d807bba-8a54-4157-9dda-bb1967add023 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] [instance: d097d81a-1bae-45f2-a34f-444776c8e1cb] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:42:46.119222 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG dbcounter [-] [130262] Writing DB stats nova_cell0:SELECT=2 {{(pid=130262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:42:46.119222 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG dbcounter [-] [130262] Writing DB stats nova_cell0:SELECT=6 {{(pid=130262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:42:46.130907 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-5d807bba-8a54-4157-9dda-bb1967add023 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:42:46.131645 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-5d807bba-8a54-4157-9dda-bb1967add023 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:42:46.132740 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-5d807bba-8a54-4157-9dda-bb1967add023 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:42:46.133418 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-5d807bba-8a54-4157-9dda-bb1967add023 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:42:46.418558 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-5d807bba-8a54-4157-9dda-bb1967add023 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc12077b11448a3b1ec2e7dbf2707ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf95e3e43d0e482ba4d27b769fb48628', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:42:46.427750 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-5d807bba-8a54-4157-9dda-bb1967add023 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] 10.222.0.66 "GET /compute/v2.1/servers/d097d81a-1bae-45f2-a34f-444776c8e1cb" status: 200 len: 1259 microversion: 2.1 time: 0.318319 Aug 04 03:42:46.428331 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 224/448] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:42:46 2022] GET /compute/v2.1/servers/d097d81a-1bae-45f2-a34f-444776c8e1cb => generated 1259 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:42:46.645730 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-3908e5a5-3d16-4f00-aa12-0147ab964b60 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:42:46.646282 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-3908e5a5-3d16-4f00-aa12-0147ab964b60 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] [instance: 9307fdad-ca63-449d-bc5c-7e9e167c59f3] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:42:46.653766 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-3908e5a5-3d16-4f00-aa12-0147ab964b60 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:42:46.655105 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-3908e5a5-3d16-4f00-aa12-0147ab964b60 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:42:46.655226 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-3908e5a5-3d16-4f00-aa12-0147ab964b60 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:42:46.655712 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-3908e5a5-3d16-4f00-aa12-0147ab964b60 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:42:46.685930 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-3908e5a5-3d16-4f00-aa12-0147ab964b60 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] 10.222.0.66 "GET /compute/v2.1/servers/9307fdad-ca63-449d-bc5c-7e9e167c59f3/ips" status: 200 len: 145 microversion: 2.1 time: 0.044250 Aug 04 03:42:46.686503 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 225/449] 10.222.0.66 () {58 vars in 1248 bytes} [Thu Aug 4 03:42:46 2022] GET /compute/v2.1/servers/9307fdad-ca63-449d-bc5c-7e9e167c59f3/ips => generated 145 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 03:42:47.450819 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-ae604a78-22db-4360-8643-a988b2a913a2 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:42:47.451421 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-ae604a78-22db-4360-8643-a988b2a913a2 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] [instance: d097d81a-1bae-45f2-a34f-444776c8e1cb] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:42:47.459589 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-ae604a78-22db-4360-8643-a988b2a913a2 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:42:47.467451 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-ae604a78-22db-4360-8643-a988b2a913a2 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:42:47.467451 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-ae604a78-22db-4360-8643-a988b2a913a2 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:42:47.467451 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-ae604a78-22db-4360-8643-a988b2a913a2 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:42:47.696852 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-ae604a78-22db-4360-8643-a988b2a913a2 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc12077b11448a3b1ec2e7dbf2707ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf95e3e43d0e482ba4d27b769fb48628', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:42:47.704873 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-ae604a78-22db-4360-8643-a988b2a913a2 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] 10.222.0.66 "GET /compute/v2.1/servers/d097d81a-1bae-45f2-a34f-444776c8e1cb" status: 200 len: 1259 microversion: 2.1 time: 0.258972 Aug 04 03:42:47.705941 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 225/450] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:42:47 2022] GET /compute/v2.1/servers/d097d81a-1bae-45f2-a34f-444776c8e1cb => generated 1259 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:42:48.726586 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-c8f6eb52-31c8-42c8-83c1-63b9add7255e tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:42:48.727212 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-c8f6eb52-31c8-42c8-83c1-63b9add7255e tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] [instance: d097d81a-1bae-45f2-a34f-444776c8e1cb] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:42:48.736145 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-c8f6eb52-31c8-42c8-83c1-63b9add7255e tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:42:48.741076 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-c8f6eb52-31c8-42c8-83c1-63b9add7255e tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:42:48.741076 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-c8f6eb52-31c8-42c8-83c1-63b9add7255e tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:42:48.741076 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-c8f6eb52-31c8-42c8-83c1-63b9add7255e tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:42:48.963914 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-c8f6eb52-31c8-42c8-83c1-63b9add7255e tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc12077b11448a3b1ec2e7dbf2707ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf95e3e43d0e482ba4d27b769fb48628', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:42:48.971472 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-c8f6eb52-31c8-42c8-83c1-63b9add7255e tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] 10.222.0.66 "GET /compute/v2.1/servers/d097d81a-1bae-45f2-a34f-444776c8e1cb" status: 200 len: 1259 microversion: 2.1 time: 0.249290 Aug 04 03:42:48.972572 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 226/451] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:42:48 2022] GET /compute/v2.1/servers/d097d81a-1bae-45f2-a34f-444776c8e1cb => generated 1259 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:42:49.995909 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-c12862c7-76ea-4e48-bc40-7da3676637e9 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:42:49.997165 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-c12862c7-76ea-4e48-bc40-7da3676637e9 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] [instance: d097d81a-1bae-45f2-a34f-444776c8e1cb] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:42:50.003933 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-c12862c7-76ea-4e48-bc40-7da3676637e9 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:42:50.006149 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-c12862c7-76ea-4e48-bc40-7da3676637e9 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:42:50.006149 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-c12862c7-76ea-4e48-bc40-7da3676637e9 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:42:50.006149 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-c12862c7-76ea-4e48-bc40-7da3676637e9 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:42:50.191942 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-c12862c7-76ea-4e48-bc40-7da3676637e9 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc12077b11448a3b1ec2e7dbf2707ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf95e3e43d0e482ba4d27b769fb48628', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:42:50.200656 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-c12862c7-76ea-4e48-bc40-7da3676637e9 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] 10.222.0.66 "GET /compute/v2.1/servers/d097d81a-1bae-45f2-a34f-444776c8e1cb" status: 200 len: 1259 microversion: 2.1 time: 0.211262 Aug 04 03:42:50.201262 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 226/452] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:42:49 2022] GET /compute/v2.1/servers/d097d81a-1bae-45f2-a34f-444776c8e1cb => generated 1259 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:42:51.100335 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [req-122d5b1b-d93d-4bf5-ab63-4b02f0a20f29 req-cf9f6631-a9ff-425a-a49c-83f92952fcc0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d097d81a-1bae-45f2-a34f-444776c8e1cb", "name": "network-vif-plugged", "status": "completed", "tag": "118548b5-15c3-4cd8-ab62-4c3490efe26d"}]} {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 03:42:51.112590 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [req-122d5b1b-d93d-4bf5-ab63-4b02f0a20f29 req-cf9f6631-a9ff-425a-a49c-83f92952fcc0 service nova] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:42:51.113041 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [req-122d5b1b-d93d-4bf5-ab63-4b02f0a20f29 req-cf9f6631-a9ff-425a-a49c-83f92952fcc0 service nova] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:42:51.125441 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.compute.server_external_events [req-122d5b1b-d93d-4bf5-ab63-4b02f0a20f29 req-cf9f6631-a9ff-425a-a49c-83f92952fcc0 service nova] Creating event network-vif-plugged:118548b5-15c3-4cd8-ab62-4c3490efe26d for instance d097d81a-1bae-45f2-a34f-444776c8e1cb on hv-cinder-73306 Aug 04 03:42:51.130622 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [req-122d5b1b-d93d-4bf5-ab63-4b02f0a20f29 req-cf9f6631-a9ff-425a-a49c-83f92952fcc0 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034409 Aug 04 03:42:51.131224 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 227/453] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 03:42:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 03:42:51.222374 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-593165e4-a704-476c-8806-e1b14bb9cfef tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:42:51.223203 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-593165e4-a704-476c-8806-e1b14bb9cfef tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] [instance: d097d81a-1bae-45f2-a34f-444776c8e1cb] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:42:51.230044 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-593165e4-a704-476c-8806-e1b14bb9cfef tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:42:51.230792 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-593165e4-a704-476c-8806-e1b14bb9cfef tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:42:51.231243 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-593165e4-a704-476c-8806-e1b14bb9cfef tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:42:51.231677 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-593165e4-a704-476c-8806-e1b14bb9cfef tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:42:51.376603 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-593165e4-a704-476c-8806-e1b14bb9cfef tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc12077b11448a3b1ec2e7dbf2707ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf95e3e43d0e482ba4d27b769fb48628', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:42:51.391003 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-593165e4-a704-476c-8806-e1b14bb9cfef tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] 10.222.0.66 "GET /compute/v2.1/servers/d097d81a-1bae-45f2-a34f-444776c8e1cb" status: 200 len: 1259 microversion: 2.1 time: 0.173187 Aug 04 03:42:51.391609 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 227/454] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:42:51 2022] GET /compute/v2.1/servers/d097d81a-1bae-45f2-a34f-444776c8e1cb => generated 1259 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:42:52.419132 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-e01e7a7f-ec19-448f-a066-6bef2f077d4d tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:42:52.422468 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-e01e7a7f-ec19-448f-a066-6bef2f077d4d tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] [instance: d097d81a-1bae-45f2-a34f-444776c8e1cb] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:42:52.433700 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-e01e7a7f-ec19-448f-a066-6bef2f077d4d tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:42:52.435873 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-e01e7a7f-ec19-448f-a066-6bef2f077d4d tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:42:52.437737 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-e01e7a7f-ec19-448f-a066-6bef2f077d4d tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:42:52.438687 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-e01e7a7f-ec19-448f-a066-6bef2f077d4d tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:42:52.658387 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-e01e7a7f-ec19-448f-a066-6bef2f077d4d tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc12077b11448a3b1ec2e7dbf2707ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf95e3e43d0e482ba4d27b769fb48628', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:42:52.665512 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-e01e7a7f-ec19-448f-a066-6bef2f077d4d tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] 10.222.0.66 "GET /compute/v2.1/servers/d097d81a-1bae-45f2-a34f-444776c8e1cb" status: 200 len: 1259 microversion: 2.1 time: 0.257139 Aug 04 03:42:52.667573 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 228/455] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:42:52 2022] GET /compute/v2.1/servers/d097d81a-1bae-45f2-a34f-444776c8e1cb => generated 1259 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:42:52.732415 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-b9f5ddc2-bf36-474e-98b6-f82c893aa1e9 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ff8d3adf-354f-45f6-a2ff-b14f5d78662f"}} {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 03:42:52.735333 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-b9f5ddc2-bf36-474e-98b6-f82c893aa1e9 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] [instance: 9307fdad-ca63-449d-bc5c-7e9e167c59f3] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:42:52.752934 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-b9f5ddc2-bf36-474e-98b6-f82c893aa1e9 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:42:52.761328 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-b9f5ddc2-bf36-474e-98b6-f82c893aa1e9 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:42:52.765399 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-b9f5ddc2-bf36-474e-98b6-f82c893aa1e9 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:42:52.765399 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-b9f5ddc2-bf36-474e-98b6-f82c893aa1e9 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:42:53.677929 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-b9f5ddc2-bf36-474e-98b6-f82c893aa1e9 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] 10.222.0.66 "POST /compute/v2.1/servers/9307fdad-ca63-449d-bc5c-7e9e167c59f3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.949462 Aug 04 03:42:53.683759 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 228/456] 10.222.0.66 () {60 vars in 1323 bytes} [Thu Aug 4 03:42:52 2022] POST /compute/v2.1/servers/9307fdad-ca63-449d-bc5c-7e9e167c59f3/os-volume_attachments => generated 194 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 03:42:53.690815 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-0e93c64e-1873-4910-96bf-7724d024c47b tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:42:53.691634 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-0e93c64e-1873-4910-96bf-7724d024c47b tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] [instance: d097d81a-1bae-45f2-a34f-444776c8e1cb] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:42:53.700365 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-0e93c64e-1873-4910-96bf-7724d024c47b tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:42:53.701730 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-0e93c64e-1873-4910-96bf-7724d024c47b tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:42:53.702882 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-0e93c64e-1873-4910-96bf-7724d024c47b tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:42:53.703537 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-0e93c64e-1873-4910-96bf-7724d024c47b tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:42:53.919085 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-0e93c64e-1873-4910-96bf-7724d024c47b tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc12077b11448a3b1ec2e7dbf2707ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf95e3e43d0e482ba4d27b769fb48628', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:42:53.930457 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-0e93c64e-1873-4910-96bf-7724d024c47b tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] 10.222.0.66 "GET /compute/v2.1/servers/d097d81a-1bae-45f2-a34f-444776c8e1cb" status: 200 len: 1259 microversion: 2.1 time: 0.243954 Aug 04 03:42:53.945567 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 229/457] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:42:53 2022] GET /compute/v2.1/servers/d097d81a-1bae-45f2-a34f-444776c8e1cb => generated 1259 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:42:54.965434 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-e20e9324-ed74-4723-bee1-7ed94a87980c tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:42:54.966490 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-e20e9324-ed74-4723-bee1-7ed94a87980c tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] [instance: d097d81a-1bae-45f2-a34f-444776c8e1cb] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:42:54.973896 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-e20e9324-ed74-4723-bee1-7ed94a87980c tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:42:54.974494 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-e20e9324-ed74-4723-bee1-7ed94a87980c tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:42:54.975333 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-e20e9324-ed74-4723-bee1-7ed94a87980c tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:42:54.975879 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-e20e9324-ed74-4723-bee1-7ed94a87980c tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:42:55.129282 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-e20e9324-ed74-4723-bee1-7ed94a87980c tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc12077b11448a3b1ec2e7dbf2707ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf95e3e43d0e482ba4d27b769fb48628', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:42:55.139823 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-e20e9324-ed74-4723-bee1-7ed94a87980c tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] 10.222.0.66 "GET /compute/v2.1/servers/d097d81a-1bae-45f2-a34f-444776c8e1cb" status: 200 len: 1442 microversion: 2.1 time: 0.180965 Aug 04 03:42:55.141858 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 229/458] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:42:54 2022] GET /compute/v2.1/servers/d097d81a-1bae-45f2-a34f-444776c8e1cb => generated 1442 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:42:55.161813 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-37d25439-f8f4-4ddd-8e45-bdc852e6e106 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:42:55.163016 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-37d25439-f8f4-4ddd-8e45-bdc852e6e106 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] [instance: d097d81a-1bae-45f2-a34f-444776c8e1cb] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:42:55.170448 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-37d25439-f8f4-4ddd-8e45-bdc852e6e106 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:42:55.170967 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-37d25439-f8f4-4ddd-8e45-bdc852e6e106 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:42:55.171742 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-37d25439-f8f4-4ddd-8e45-bdc852e6e106 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:42:55.172233 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-37d25439-f8f4-4ddd-8e45-bdc852e6e106 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:42:55.325318 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-37d25439-f8f4-4ddd-8e45-bdc852e6e106 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc12077b11448a3b1ec2e7dbf2707ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf95e3e43d0e482ba4d27b769fb48628', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:42:55.333355 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-37d25439-f8f4-4ddd-8e45-bdc852e6e106 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] 10.222.0.66 "GET /compute/v2.1/servers/d097d81a-1bae-45f2-a34f-444776c8e1cb" status: 200 len: 1442 microversion: 2.1 time: 0.175432 Aug 04 03:42:55.334535 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 230/459] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:42:55 2022] GET /compute/v2.1/servers/d097d81a-1bae-45f2-a34f-444776c8e1cb => generated 1442 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:42:57.966775 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [req-99a23bed-b443-44bd-942f-92c55a210aa5 req-a788e54f-0992-437e-a810-2ea8e34d767f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d097d81a-1bae-45f2-a34f-444776c8e1cb", "tag": "118548b5-15c3-4cd8-ab62-4c3490efe26d"}]} {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 03:42:57.988019 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [req-99a23bed-b443-44bd-942f-92c55a210aa5 req-a788e54f-0992-437e-a810-2ea8e34d767f service nova] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:42:57.988019 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [req-99a23bed-b443-44bd-942f-92c55a210aa5 req-a788e54f-0992-437e-a810-2ea8e34d767f service nova] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:42:57.997847 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.compute.server_external_events [req-99a23bed-b443-44bd-942f-92c55a210aa5 req-a788e54f-0992-437e-a810-2ea8e34d767f service nova] Creating event network-changed:118548b5-15c3-4cd8-ab62-4c3490efe26d for instance d097d81a-1bae-45f2-a34f-444776c8e1cb on hv-cinder-73306 Aug 04 03:42:58.003391 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [req-99a23bed-b443-44bd-942f-92c55a210aa5 req-a788e54f-0992-437e-a810-2ea8e34d767f service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042349 Aug 04 03:42:58.004632 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 230/460] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 03:42:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 03:43:08.261060 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-334512c5-367f-43b1-a079-39e0d37b0fbb tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Action: 'create', calling method: .version_select at 0x7f72e810e310>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-620712029", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBiPjvyAvxjh0P5n1I0MjhEk8DirKQBXdF1TRwNbILyi4r7LrVWRPabRkOGIQnY6YiZ6qc0FGw44eGu4uDR6XuZkNaAWF18bQ6U8bLy27t1ZGTxDMz9gpBJqa2X9NqEHeQ=="}} {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 03:43:08.267020 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG dbcounter [-] [130263] Writing DB stats nova_api:SELECT=26 {{(pid=130263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:43:08.267698 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG dbcounter [-] [130263] Writing DB stats nova_cell1:SELECT=56 {{(pid=130263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:43:08.278199 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.quota [None req-334512c5-367f-43b1-a079-39e0d37b0fbb tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Getting quotas for project 2049d7705d5c4afe94c22a6f1284327b. Resources: {'key_pairs'} {{(pid=130263) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 03:43:08.283341 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.quota [None req-334512c5-367f-43b1-a079-39e0d37b0fbb tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Getting quotas for user d245c731eb58483bb635a7e70542b892 and project 2049d7705d5c4afe94c22a6f1284327b. Resources: {'key_pairs'} {{(pid=130263) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 03:43:08.360008 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-334512c5-367f-43b1-a079-39e0d37b0fbb tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.103719 Aug 04 03:43:08.360595 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 231/461] 10.222.0.66 () {60 vars in 1159 bytes} [Thu Aug 4 03:43:08 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 03:43:08.409416 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG dbcounter [-] [130262] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=130262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:43:08.410169 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG dbcounter [-] [130262] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=130262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:43:08.414192 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-b683d1ef-cf17-4870-8b33-18e8c5be24d0 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1469293365", "imageRef": "c1385bcc-4317-43db-a301-27e5cd6133f1", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-620712029", "networks": [{"uuid": "8266f332-0367-44c7-ac28-a2432d228833"}]}} {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 03:43:08.467543 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.network.neutron [None req-b683d1ef-cf17-4870-8b33-18e8c5be24d0 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] validate_networks() for [('8266f332-0367-44c7-ac28-a2432d228833', None, None, None, None, None)] {{(pid=130262) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 03:43:08.837925 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.virt.hardware [None req-b683d1ef-cf17-4870-8b33-18e8c5be24d0 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Flavor limits 0:0:0 {{(pid=130262) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 03:43:08.838503 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.virt.hardware [None req-b683d1ef-cf17-4870-8b33-18e8c5be24d0 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Image limits 0:0:0 {{(pid=130262) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 03:43:08.839046 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.virt.hardware [None req-b683d1ef-cf17-4870-8b33-18e8c5be24d0 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Flavor pref 0:0:0 {{(pid=130262) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 03:43:08.839528 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.virt.hardware [None req-b683d1ef-cf17-4870-8b33-18e8c5be24d0 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Image pref 0:0:0 {{(pid=130262) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 03:43:08.839937 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.virt.hardware [None req-b683d1ef-cf17-4870-8b33-18e8c5be24d0 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130262) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 03:43:08.848793 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-b683d1ef-cf17-4870-8b33-18e8c5be24d0 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:43:08.849272 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-b683d1ef-cf17-4870-8b33-18e8c5be24d0 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:43:08.850076 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-b683d1ef-cf17-4870-8b33-18e8c5be24d0 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:43:08.855600 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-b683d1ef-cf17-4870-8b33-18e8c5be24d0 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:43:08.869090 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.quota [None req-b683d1ef-cf17-4870-8b33-18e8c5be24d0 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Getting quotas for project 2049d7705d5c4afe94c22a6f1284327b. Resources: {'instances', 'ram', 'cores'} {{(pid=130262) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 03:43:08.873222 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.quota [None req-b683d1ef-cf17-4870-8b33-18e8c5be24d0 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Getting quotas for user d245c731eb58483bb635a7e70542b892 and project 2049d7705d5c4afe94c22a6f1284327b. Resources: {'instances', 'ram', 'cores'} {{(pid=130262) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 03:43:08.884147 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-b683d1ef-cf17-4870-8b33-18e8c5be24d0 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Going to run 1 instances... {{(pid=130262) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 03:43:08.886478 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-b683d1ef-cf17-4870-8b33-18e8c5be24d0 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] [instance: bd510bcc-33c6-4299-8a14-018dce8ee011] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c1385bcc-4317-43db-a301-27e5cd6133f1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130262) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 03:43:08.995299 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-b683d1ef-cf17-4870-8b33-18e8c5be24d0 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.587322 Aug 04 03:43:08.995933 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 231/462] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 03:43:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 589 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 03:43:09.006859 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-32203121-9471-46cf-9427-d5d7fb1a4ee7 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:43:09.007577 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-32203121-9471-46cf-9427-d5d7fb1a4ee7 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] [instance: bd510bcc-33c6-4299-8a14-018dce8ee011] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:43:09.061679 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-32203121-9471-46cf-9427-d5d7fb1a4ee7 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd245c731eb58483bb635a7e70542b892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2049d7705d5c4afe94c22a6f1284327b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:43:09.068942 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-32203121-9471-46cf-9427-d5d7fb1a4ee7 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] 10.222.0.66 "GET /compute/v2.1/servers/bd510bcc-33c6-4299-8a14-018dce8ee011" status: 200 len: 1258 microversion: 2.1 time: 0.065953 Aug 04 03:43:09.069549 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 232/463] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:43:09 2022] GET /compute/v2.1/servers/bd510bcc-33c6-4299-8a14-018dce8ee011 => generated 1258 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:43:10.090528 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-2a0457b2-6527-43da-b1b8-77c974d6d094 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:43:10.091157 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-2a0457b2-6527-43da-b1b8-77c974d6d094 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] [instance: bd510bcc-33c6-4299-8a14-018dce8ee011] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:43:10.098224 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-2a0457b2-6527-43da-b1b8-77c974d6d094 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:43:10.098679 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-2a0457b2-6527-43da-b1b8-77c974d6d094 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:43:10.099489 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-2a0457b2-6527-43da-b1b8-77c974d6d094 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:43:10.099933 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-2a0457b2-6527-43da-b1b8-77c974d6d094 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:43:10.163328 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-2a0457b2-6527-43da-b1b8-77c974d6d094 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd245c731eb58483bb635a7e70542b892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2049d7705d5c4afe94c22a6f1284327b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:43:10.171513 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-2a0457b2-6527-43da-b1b8-77c974d6d094 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] 10.222.0.66 "GET /compute/v2.1/servers/bd510bcc-33c6-4299-8a14-018dce8ee011" status: 200 len: 1262 microversion: 2.1 time: 0.085415 Aug 04 03:43:10.172085 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 232/464] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:43:10 2022] GET /compute/v2.1/servers/bd510bcc-33c6-4299-8a14-018dce8ee011 => generated 1262 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:43:11.192667 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-a7e9b447-233e-4218-bb76-09cd94b309f6 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:43:11.193309 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-a7e9b447-233e-4218-bb76-09cd94b309f6 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] [instance: bd510bcc-33c6-4299-8a14-018dce8ee011] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:43:11.200211 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-a7e9b447-233e-4218-bb76-09cd94b309f6 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:43:11.200662 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-a7e9b447-233e-4218-bb76-09cd94b309f6 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:43:11.201452 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-a7e9b447-233e-4218-bb76-09cd94b309f6 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:43:11.201889 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-a7e9b447-233e-4218-bb76-09cd94b309f6 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:43:11.469349 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-a7e9b447-233e-4218-bb76-09cd94b309f6 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd245c731eb58483bb635a7e70542b892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2049d7705d5c4afe94c22a6f1284327b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:43:11.477095 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-a7e9b447-233e-4218-bb76-09cd94b309f6 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] 10.222.0.66 "GET /compute/v2.1/servers/bd510bcc-33c6-4299-8a14-018dce8ee011" status: 200 len: 1262 microversion: 2.1 time: 0.288215 Aug 04 03:43:11.477702 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 233/465] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:43:11 2022] GET /compute/v2.1/servers/bd510bcc-33c6-4299-8a14-018dce8ee011 => generated 1262 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:43:12.497719 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-3ec0e3fa-9457-4e79-9f9a-34724481caa5 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:43:12.498257 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-3ec0e3fa-9457-4e79-9f9a-34724481caa5 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] [instance: bd510bcc-33c6-4299-8a14-018dce8ee011] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:43:12.504680 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-3ec0e3fa-9457-4e79-9f9a-34724481caa5 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:43:12.505131 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-3ec0e3fa-9457-4e79-9f9a-34724481caa5 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:43:12.505926 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-3ec0e3fa-9457-4e79-9f9a-34724481caa5 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:43:12.506364 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-3ec0e3fa-9457-4e79-9f9a-34724481caa5 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:43:12.568114 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-3ec0e3fa-9457-4e79-9f9a-34724481caa5 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd245c731eb58483bb635a7e70542b892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2049d7705d5c4afe94c22a6f1284327b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:43:12.576330 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-3ec0e3fa-9457-4e79-9f9a-34724481caa5 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] 10.222.0.66 "GET /compute/v2.1/servers/bd510bcc-33c6-4299-8a14-018dce8ee011" status: 200 len: 1262 microversion: 2.1 time: 0.083099 Aug 04 03:43:12.576878 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 233/466] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:43:12 2022] GET /compute/v2.1/servers/bd510bcc-33c6-4299-8a14-018dce8ee011 => generated 1262 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:43:13.595885 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-c1e93b2b-15f2-4673-a030-ead10907889e tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:43:13.596541 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-c1e93b2b-15f2-4673-a030-ead10907889e tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] [instance: bd510bcc-33c6-4299-8a14-018dce8ee011] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:43:13.603341 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-c1e93b2b-15f2-4673-a030-ead10907889e tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:43:13.603800 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-c1e93b2b-15f2-4673-a030-ead10907889e tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:43:13.605257 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-c1e93b2b-15f2-4673-a030-ead10907889e tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:43:13.605732 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-c1e93b2b-15f2-4673-a030-ead10907889e tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:43:13.665554 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-c1e93b2b-15f2-4673-a030-ead10907889e tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd245c731eb58483bb635a7e70542b892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2049d7705d5c4afe94c22a6f1284327b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:43:13.673704 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-c1e93b2b-15f2-4673-a030-ead10907889e tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] 10.222.0.66 "GET /compute/v2.1/servers/bd510bcc-33c6-4299-8a14-018dce8ee011" status: 200 len: 1262 microversion: 2.1 time: 0.081650 Aug 04 03:43:13.674267 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 234/467] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:43:13 2022] GET /compute/v2.1/servers/bd510bcc-33c6-4299-8a14-018dce8ee011 => generated 1262 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:43:14.694889 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-f6a67a77-66c4-42f5-a1f9-741b52815ffc tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:43:14.695488 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-f6a67a77-66c4-42f5-a1f9-741b52815ffc tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] [instance: bd510bcc-33c6-4299-8a14-018dce8ee011] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:43:14.702362 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-f6a67a77-66c4-42f5-a1f9-741b52815ffc tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:43:14.702803 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-f6a67a77-66c4-42f5-a1f9-741b52815ffc tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:43:14.703548 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-f6a67a77-66c4-42f5-a1f9-741b52815ffc tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:43:14.703983 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-f6a67a77-66c4-42f5-a1f9-741b52815ffc tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:43:14.767145 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-f6a67a77-66c4-42f5-a1f9-741b52815ffc tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd245c731eb58483bb635a7e70542b892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2049d7705d5c4afe94c22a6f1284327b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:43:14.774451 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-f6a67a77-66c4-42f5-a1f9-741b52815ffc tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] 10.222.0.66 "GET /compute/v2.1/servers/bd510bcc-33c6-4299-8a14-018dce8ee011" status: 200 len: 1262 microversion: 2.1 time: 0.083418 Aug 04 03:43:14.779461 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 234/468] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:43:14 2022] GET /compute/v2.1/servers/bd510bcc-33c6-4299-8a14-018dce8ee011 => generated 1262 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:43:15.798441 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-2e8b1133-36ae-41c9-979b-7abbc829d095 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:43:15.799041 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-2e8b1133-36ae-41c9-979b-7abbc829d095 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] [instance: bd510bcc-33c6-4299-8a14-018dce8ee011] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:43:15.805511 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-2e8b1133-36ae-41c9-979b-7abbc829d095 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:43:15.805964 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-2e8b1133-36ae-41c9-979b-7abbc829d095 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:43:15.806726 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-2e8b1133-36ae-41c9-979b-7abbc829d095 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:43:15.807163 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-2e8b1133-36ae-41c9-979b-7abbc829d095 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:43:15.870815 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-2e8b1133-36ae-41c9-979b-7abbc829d095 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd245c731eb58483bb635a7e70542b892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2049d7705d5c4afe94c22a6f1284327b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:43:15.878232 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-2e8b1133-36ae-41c9-979b-7abbc829d095 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] 10.222.0.66 "GET /compute/v2.1/servers/bd510bcc-33c6-4299-8a14-018dce8ee011" status: 200 len: 1310 microversion: 2.1 time: 0.083671 Aug 04 03:43:15.878794 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 235/469] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:43:15 2022] GET /compute/v2.1/servers/bd510bcc-33c6-4299-8a14-018dce8ee011 => generated 1310 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:43:16.252979 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-c1df51c5-2821-4b92-97cf-2e54c7c21304 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 03:43:16.259867 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-c1df51c5-2821-4b92-97cf-2e54c7c21304 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:43:16.261034 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-c1df51c5-2821-4b92-97cf-2e54c7c21304 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:43:16.321619 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-c1df51c5-2821-4b92-97cf-2e54c7c21304 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] [instance: 9307fdad-ca63-449d-bc5c-7e9e167c59f3] Going to try to stop instance {{(pid=130262) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 04 03:43:16.418898 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-868482b3-af1a-472b-afe4-2219c74fb083 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2100655696", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-908000990", "security_groups": [{"name": "tempest-secgroup-smoke-212095973"}], "block_device_mapping_v2": [{"uuid": "4b2076da-eecf-4cb2-9b7d-abf74d836ed5", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "8d050520-b725-42ec-a591-c1de472eb260"}]}} {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 03:43:16.544145 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.network.neutron [None req-868482b3-af1a-472b-afe4-2219c74fb083 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] validate_networks() for [('8d050520-b725-42ec-a591-c1de472eb260', None, None, None, None, None)] {{(pid=130263) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 03:43:16.596468 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-c1df51c5-2821-4b92-97cf-2e54c7c21304 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] 10.222.0.66 "POST /compute/v2.1/servers/9307fdad-ca63-449d-bc5c-7e9e167c59f3/action" status: 202 len: 0 microversion: 2.1 time: 0.347183 Aug 04 03:43:16.597079 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 235/470] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 03:43:16 2022] POST /compute/v2.1/servers/9307fdad-ca63-449d-bc5c-7e9e167c59f3/action => generated 0 bytes in 349 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 03:43:16.607286 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-006e8ca1-b01d-4a62-bdf6-f29aa1edc7e2 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:43:16.608923 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-006e8ca1-b01d-4a62-bdf6-f29aa1edc7e2 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] [instance: 9307fdad-ca63-449d-bc5c-7e9e167c59f3] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:43:16.615184 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-006e8ca1-b01d-4a62-bdf6-f29aa1edc7e2 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:43:16.616021 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-006e8ca1-b01d-4a62-bdf6-f29aa1edc7e2 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:43:16.616423 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-006e8ca1-b01d-4a62-bdf6-f29aa1edc7e2 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:43:16.616862 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-006e8ca1-b01d-4a62-bdf6-f29aa1edc7e2 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:43:16.852159 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-006e8ca1-b01d-4a62-bdf6-f29aa1edc7e2 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dba436d0a67433f8c8ae7cd40d3f795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46b8dc64007429b805971d4c6f5b471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:43:16.887054 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-006e8ca1-b01d-4a62-bdf6-f29aa1edc7e2 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] 10.222.0.66 "GET /compute/v2.1/servers/9307fdad-ca63-449d-bc5c-7e9e167c59f3" status: 200 len: 1721 microversion: 2.1 time: 0.278023 Aug 04 03:43:16.887054 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 236/471] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:43:16 2022] GET /compute/v2.1/servers/9307fdad-ca63-449d-bc5c-7e9e167c59f3 => generated 1721 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 03:43:16.901633 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-6f6bcca2-a25b-4e45-b273-267f248753ab tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:43:16.902836 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-6f6bcca2-a25b-4e45-b273-267f248753ab tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] [instance: bd510bcc-33c6-4299-8a14-018dce8ee011] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:43:16.909330 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-6f6bcca2-a25b-4e45-b273-267f248753ab tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:43:16.909777 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-6f6bcca2-a25b-4e45-b273-267f248753ab tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:43:16.910970 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-6f6bcca2-a25b-4e45-b273-267f248753ab tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:43:16.911411 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-6f6bcca2-a25b-4e45-b273-267f248753ab tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:43:16.984200 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-6f6bcca2-a25b-4e45-b273-267f248753ab tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd245c731eb58483bb635a7e70542b892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2049d7705d5c4afe94c22a6f1284327b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:43:16.992796 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-6f6bcca2-a25b-4e45-b273-267f248753ab tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] 10.222.0.66 "GET /compute/v2.1/servers/bd510bcc-33c6-4299-8a14-018dce8ee011" status: 200 len: 1316 microversion: 2.1 time: 0.097108 Aug 04 03:43:16.993705 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 237/472] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:43:16 2022] GET /compute/v2.1/servers/bd510bcc-33c6-4299-8a14-018dce8ee011 => generated 1316 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:43:17.127394 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.virt.hardware [None req-868482b3-af1a-472b-afe4-2219c74fb083 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Flavor limits 0:0:0 {{(pid=130263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 03:43:17.127888 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.virt.hardware [None req-868482b3-af1a-472b-afe4-2219c74fb083 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Image limits 0:0:0 {{(pid=130263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 03:43:17.128549 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.virt.hardware [None req-868482b3-af1a-472b-afe4-2219c74fb083 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Flavor pref 0:0:0 {{(pid=130263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 03:43:17.128961 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.virt.hardware [None req-868482b3-af1a-472b-afe4-2219c74fb083 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Image pref 0:0:0 {{(pid=130263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 03:43:17.129413 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.virt.hardware [None req-868482b3-af1a-472b-afe4-2219c74fb083 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 03:43:17.139970 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-868482b3-af1a-472b-afe4-2219c74fb083 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:43:17.140419 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-868482b3-af1a-472b-afe4-2219c74fb083 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:43:17.141833 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-868482b3-af1a-472b-afe4-2219c74fb083 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:43:17.142181 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-868482b3-af1a-472b-afe4-2219c74fb083 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:43:17.163465 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.quota [None req-868482b3-af1a-472b-afe4-2219c74fb083 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Getting quotas for project 32813adc26c64016b99c9c5fd838d391. Resources: {'instances', 'ram', 'cores'} {{(pid=130263) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 03:43:17.169998 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.quota [None req-868482b3-af1a-472b-afe4-2219c74fb083 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Getting quotas for user ac48e585c133487dadbe0a1e095bfde0 and project 32813adc26c64016b99c9c5fd838d391. Resources: {'instances', 'ram', 'cores'} {{(pid=130263) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 03:43:17.261517 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-868482b3-af1a-472b-afe4-2219c74fb083 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Going to run 1 instances... {{(pid=130263) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 03:43:17.263684 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-868482b3-af1a-472b-afe4-2219c74fb083 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] [instance: eb7f2df0-7ac0-4253-a847-e0f797fa845c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='4b2076da-eecf-4cb2-9b7d-abf74d836ed5',volume_size=None,volume_type=None)] {{(pid=130263) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 03:43:17.719358 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-868482b3-af1a-472b-afe4-2219c74fb083 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.305276 Aug 04 03:43:17.726867 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 236/473] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 03:43:16 2022] POST /compute/v2.1/servers => generated 405 bytes in 1314 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 03:43:17.732809 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-d2cdb332-9799-4097-b5bc-62359e6dc2b2 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:43:17.733451 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-d2cdb332-9799-4097-b5bc-62359e6dc2b2 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] [instance: eb7f2df0-7ac0-4253-a847-e0f797fa845c] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:43:17.806407 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-d2cdb332-9799-4097-b5bc-62359e6dc2b2 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac48e585c133487dadbe0a1e095bfde0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32813adc26c64016b99c9c5fd838d391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:43:17.813633 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-d2cdb332-9799-4097-b5bc-62359e6dc2b2 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] 10.222.0.66 "GET /compute/v2.1/servers/eb7f2df0-7ac0-4253-a847-e0f797fa845c" status: 200 len: 1094 microversion: 2.1 time: 0.085423 Aug 04 03:43:17.814929 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 238/474] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:43:17 2022] GET /compute/v2.1/servers/eb7f2df0-7ac0-4253-a847-e0f797fa845c => generated 1094 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:43:17.908481 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-2312c2a1-815c-44b4-9d38-42bacaf54549 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:43:17.909284 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-2312c2a1-815c-44b4-9d38-42bacaf54549 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] [instance: 9307fdad-ca63-449d-bc5c-7e9e167c59f3] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:43:17.915855 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-2312c2a1-815c-44b4-9d38-42bacaf54549 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:43:17.916369 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-2312c2a1-815c-44b4-9d38-42bacaf54549 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:43:17.917551 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-2312c2a1-815c-44b4-9d38-42bacaf54549 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:43:17.917906 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-2312c2a1-815c-44b4-9d38-42bacaf54549 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:43:18.017416 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-bde6dfb7-961f-4000-9898-8d011c523dfd tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:43:18.018548 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-bde6dfb7-961f-4000-9898-8d011c523dfd tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] [instance: bd510bcc-33c6-4299-8a14-018dce8ee011] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:43:18.032711 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-bde6dfb7-961f-4000-9898-8d011c523dfd tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:43:18.033251 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-bde6dfb7-961f-4000-9898-8d011c523dfd tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:43:18.034044 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-bde6dfb7-961f-4000-9898-8d011c523dfd tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:43:18.034481 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-bde6dfb7-961f-4000-9898-8d011c523dfd tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:43:18.157326 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-2312c2a1-815c-44b4-9d38-42bacaf54549 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dba436d0a67433f8c8ae7cd40d3f795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46b8dc64007429b805971d4c6f5b471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:43:18.178634 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-2312c2a1-815c-44b4-9d38-42bacaf54549 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] 10.222.0.66 "GET /compute/v2.1/servers/9307fdad-ca63-449d-bc5c-7e9e167c59f3" status: 200 len: 1721 microversion: 2.1 time: 0.274734 Aug 04 03:43:18.180956 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 237/475] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:43:17 2022] GET /compute/v2.1/servers/9307fdad-ca63-449d-bc5c-7e9e167c59f3 => generated 1721 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:43:18.279139 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-bde6dfb7-961f-4000-9898-8d011c523dfd tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd245c731eb58483bb635a7e70542b892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2049d7705d5c4afe94c22a6f1284327b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:43:18.287880 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-bde6dfb7-961f-4000-9898-8d011c523dfd tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] 10.222.0.66 "GET /compute/v2.1/servers/bd510bcc-33c6-4299-8a14-018dce8ee011" status: 200 len: 1358 microversion: 2.1 time: 0.273607 Aug 04 03:43:18.288814 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 239/476] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:43:18 2022] GET /compute/v2.1/servers/bd510bcc-33c6-4299-8a14-018dce8ee011 => generated 1358 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 03:43:18.435001 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [req-618ad2ea-efd2-4f4d-a4f7-b48eafe7a6b7 req-80ad9ef8-e48c-455b-8ca2-59157439bff4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd510bcc-33c6-4299-8a14-018dce8ee011", "tag": "c6499e78-e527-405f-ab7c-374a6cec81fb"}]} {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 03:43:18.447518 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [req-618ad2ea-efd2-4f4d-a4f7-b48eafe7a6b7 req-80ad9ef8-e48c-455b-8ca2-59157439bff4 service nova] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:43:18.448002 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [req-618ad2ea-efd2-4f4d-a4f7-b48eafe7a6b7 req-80ad9ef8-e48c-455b-8ca2-59157439bff4 service nova] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:43:18.467865 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.compute.server_external_events [req-618ad2ea-efd2-4f4d-a4f7-b48eafe7a6b7 req-80ad9ef8-e48c-455b-8ca2-59157439bff4 service nova] Creating event network-changed:c6499e78-e527-405f-ab7c-374a6cec81fb for instance bd510bcc-33c6-4299-8a14-018dce8ee011 on hv-cinder-73306 Aug 04 03:43:18.486414 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [req-618ad2ea-efd2-4f4d-a4f7-b48eafe7a6b7 req-80ad9ef8-e48c-455b-8ca2-59157439bff4 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055816 Aug 04 03:43:18.491220 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 238/477] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 03:43:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 03:43:18.834596 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-70770bde-2f00-44c0-bebf-6eaaadae11b9 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:43:18.835186 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-70770bde-2f00-44c0-bebf-6eaaadae11b9 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] [instance: eb7f2df0-7ac0-4253-a847-e0f797fa845c] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:43:18.842627 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-70770bde-2f00-44c0-bebf-6eaaadae11b9 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:43:18.846784 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-70770bde-2f00-44c0-bebf-6eaaadae11b9 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:43:18.846784 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-70770bde-2f00-44c0-bebf-6eaaadae11b9 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:43:18.846784 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-70770bde-2f00-44c0-bebf-6eaaadae11b9 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:43:18.861238 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG dbcounter [-] [130262] Writing DB stats nova_cell0:SELECT=2 {{(pid=130262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:43:18.915822 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-70770bde-2f00-44c0-bebf-6eaaadae11b9 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac48e585c133487dadbe0a1e095bfde0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32813adc26c64016b99c9c5fd838d391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:43:18.923543 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-70770bde-2f00-44c0-bebf-6eaaadae11b9 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] 10.222.0.66 "GET /compute/v2.1/servers/eb7f2df0-7ac0-4253-a847-e0f797fa845c" status: 200 len: 1144 microversion: 2.1 time: 0.092953 Aug 04 03:43:18.924103 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 240/478] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:43:18 2022] GET /compute/v2.1/servers/eb7f2df0-7ac0-4253-a847-e0f797fa845c => generated 1144 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:43:19.201898 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-57fa9dda-1cc7-4eef-bea4-a4e020d122fa tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:43:19.202938 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-57fa9dda-1cc7-4eef-bea4-a4e020d122fa tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] [instance: 9307fdad-ca63-449d-bc5c-7e9e167c59f3] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:43:19.210520 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-57fa9dda-1cc7-4eef-bea4-a4e020d122fa tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:43:19.211000 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-57fa9dda-1cc7-4eef-bea4-a4e020d122fa tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:43:19.211777 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-57fa9dda-1cc7-4eef-bea4-a4e020d122fa tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:43:19.212219 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-57fa9dda-1cc7-4eef-bea4-a4e020d122fa tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:43:19.310571 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-f3cf3c50-68f8-4cc8-bce8-7f7c5728839e tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:43:19.311555 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-f3cf3c50-68f8-4cc8-bce8-7f7c5728839e tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] [instance: bd510bcc-33c6-4299-8a14-018dce8ee011] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:43:19.318495 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-f3cf3c50-68f8-4cc8-bce8-7f7c5728839e tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:43:19.319256 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-f3cf3c50-68f8-4cc8-bce8-7f7c5728839e tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:43:19.320552 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-f3cf3c50-68f8-4cc8-bce8-7f7c5728839e tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:43:19.321233 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-f3cf3c50-68f8-4cc8-bce8-7f7c5728839e tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:43:19.373732 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-57fa9dda-1cc7-4eef-bea4-a4e020d122fa tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dba436d0a67433f8c8ae7cd40d3f795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46b8dc64007429b805971d4c6f5b471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:43:19.382585 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-57fa9dda-1cc7-4eef-bea4-a4e020d122fa tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] 10.222.0.66 "GET /compute/v2.1/servers/9307fdad-ca63-449d-bc5c-7e9e167c59f3" status: 200 len: 1721 microversion: 2.1 time: 0.186750 Aug 04 03:43:19.383164 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 239/479] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:43:19 2022] GET /compute/v2.1/servers/9307fdad-ca63-449d-bc5c-7e9e167c59f3 => generated 1721 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:43:19.464403 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-f3cf3c50-68f8-4cc8-bce8-7f7c5728839e tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd245c731eb58483bb635a7e70542b892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2049d7705d5c4afe94c22a6f1284327b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:43:19.471932 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-f3cf3c50-68f8-4cc8-bce8-7f7c5728839e tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] 10.222.0.66 "GET /compute/v2.1/servers/bd510bcc-33c6-4299-8a14-018dce8ee011" status: 200 len: 1358 microversion: 2.1 time: 0.166696 Aug 04 03:43:19.472505 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 241/480] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:43:19 2022] GET /compute/v2.1/servers/bd510bcc-33c6-4299-8a14-018dce8ee011 => generated 1358 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 03:43:19.945523 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-aa613539-55b6-4534-9634-2859113cf18b tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:43:19.946176 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-aa613539-55b6-4534-9634-2859113cf18b tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] [instance: eb7f2df0-7ac0-4253-a847-e0f797fa845c] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:43:19.953251 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-aa613539-55b6-4534-9634-2859113cf18b tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:43:19.953708 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-aa613539-55b6-4534-9634-2859113cf18b tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:43:19.954480 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-aa613539-55b6-4534-9634-2859113cf18b tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:43:19.954918 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-aa613539-55b6-4534-9634-2859113cf18b tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:43:20.017937 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-aa613539-55b6-4534-9634-2859113cf18b tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac48e585c133487dadbe0a1e095bfde0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32813adc26c64016b99c9c5fd838d391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:43:20.026408 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-aa613539-55b6-4534-9634-2859113cf18b tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] 10.222.0.66 "GET /compute/v2.1/servers/eb7f2df0-7ac0-4253-a847-e0f797fa845c" status: 200 len: 1144 microversion: 2.1 time: 0.084985 Aug 04 03:43:20.027076 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 240/481] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:43:19 2022] GET /compute/v2.1/servers/eb7f2df0-7ac0-4253-a847-e0f797fa845c => generated 1144 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:43:20.403440 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-b5d28c61-a587-475e-a2b8-93205a1a48b6 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:43:20.404043 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-b5d28c61-a587-475e-a2b8-93205a1a48b6 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] [instance: 9307fdad-ca63-449d-bc5c-7e9e167c59f3] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:43:20.410758 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-b5d28c61-a587-475e-a2b8-93205a1a48b6 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:43:20.411202 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-b5d28c61-a587-475e-a2b8-93205a1a48b6 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:43:20.411960 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-b5d28c61-a587-475e-a2b8-93205a1a48b6 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:43:20.412432 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-b5d28c61-a587-475e-a2b8-93205a1a48b6 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:43:20.493967 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-2fa60376-b62e-4452-8b5f-626f1689313e tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:43:20.495477 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-2fa60376-b62e-4452-8b5f-626f1689313e tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] [instance: bd510bcc-33c6-4299-8a14-018dce8ee011] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:43:20.505003 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-2fa60376-b62e-4452-8b5f-626f1689313e tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:43:20.505992 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-2fa60376-b62e-4452-8b5f-626f1689313e tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:43:20.507553 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-2fa60376-b62e-4452-8b5f-626f1689313e tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:43:20.508708 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-2fa60376-b62e-4452-8b5f-626f1689313e tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:43:20.561307 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-b5d28c61-a587-475e-a2b8-93205a1a48b6 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dba436d0a67433f8c8ae7cd40d3f795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46b8dc64007429b805971d4c6f5b471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:43:20.569235 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-b5d28c61-a587-475e-a2b8-93205a1a48b6 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] 10.222.0.66 "GET /compute/v2.1/servers/9307fdad-ca63-449d-bc5c-7e9e167c59f3" status: 200 len: 1721 microversion: 2.1 time: 0.169682 Aug 04 03:43:20.569802 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 242/482] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:43:20 2022] GET /compute/v2.1/servers/9307fdad-ca63-449d-bc5c-7e9e167c59f3 => generated 1721 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:43:20.668288 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-2fa60376-b62e-4452-8b5f-626f1689313e tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd245c731eb58483bb635a7e70542b892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2049d7705d5c4afe94c22a6f1284327b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:43:20.677156 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-2fa60376-b62e-4452-8b5f-626f1689313e tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] 10.222.0.66 "GET /compute/v2.1/servers/bd510bcc-33c6-4299-8a14-018dce8ee011" status: 200 len: 1358 microversion: 2.1 time: 0.186866 Aug 04 03:43:20.678031 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 241/483] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:43:20 2022] GET /compute/v2.1/servers/bd510bcc-33c6-4299-8a14-018dce8ee011 => generated 1358 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:43:21.047484 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-a26aa1f7-2664-4623-aaab-effe22b56d17 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:43:21.048432 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-a26aa1f7-2664-4623-aaab-effe22b56d17 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] [instance: eb7f2df0-7ac0-4253-a847-e0f797fa845c] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:43:21.055369 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-a26aa1f7-2664-4623-aaab-effe22b56d17 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:43:21.055909 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-a26aa1f7-2664-4623-aaab-effe22b56d17 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:43:21.056812 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-a26aa1f7-2664-4623-aaab-effe22b56d17 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:43:21.057968 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-a26aa1f7-2664-4623-aaab-effe22b56d17 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:43:21.139611 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-a26aa1f7-2664-4623-aaab-effe22b56d17 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac48e585c133487dadbe0a1e095bfde0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32813adc26c64016b99c9c5fd838d391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:43:21.147749 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-a26aa1f7-2664-4623-aaab-effe22b56d17 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] 10.222.0.66 "GET /compute/v2.1/servers/eb7f2df0-7ac0-4253-a847-e0f797fa845c" status: 200 len: 1144 microversion: 2.1 time: 0.104233 Aug 04 03:43:21.148359 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 243/484] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:43:21 2022] GET /compute/v2.1/servers/eb7f2df0-7ac0-4253-a847-e0f797fa845c => generated 1144 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:43:21.592607 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-43891233-d102-431c-a710-5a25789e8f01 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:43:21.593488 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-43891233-d102-431c-a710-5a25789e8f01 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] [instance: 9307fdad-ca63-449d-bc5c-7e9e167c59f3] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:43:21.606813 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-43891233-d102-431c-a710-5a25789e8f01 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:43:21.607296 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-43891233-d102-431c-a710-5a25789e8f01 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:43:21.608372 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-43891233-d102-431c-a710-5a25789e8f01 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:43:21.608805 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-43891233-d102-431c-a710-5a25789e8f01 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:43:21.700138 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-e53b2968-aa45-4312-a1c2-5b53828d3d83 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:43:21.701683 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-e53b2968-aa45-4312-a1c2-5b53828d3d83 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] [instance: bd510bcc-33c6-4299-8a14-018dce8ee011] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:43:21.717156 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-e53b2968-aa45-4312-a1c2-5b53828d3d83 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:43:21.717906 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-e53b2968-aa45-4312-a1c2-5b53828d3d83 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:43:21.718867 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-e53b2968-aa45-4312-a1c2-5b53828d3d83 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:43:21.719465 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-e53b2968-aa45-4312-a1c2-5b53828d3d83 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:43:21.773068 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-43891233-d102-431c-a710-5a25789e8f01 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dba436d0a67433f8c8ae7cd40d3f795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46b8dc64007429b805971d4c6f5b471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:43:21.784922 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-43891233-d102-431c-a710-5a25789e8f01 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] 10.222.0.66 "GET /compute/v2.1/servers/9307fdad-ca63-449d-bc5c-7e9e167c59f3" status: 200 len: 1721 microversion: 2.1 time: 0.198094 Aug 04 03:43:21.786188 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 242/485] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:43:21 2022] GET /compute/v2.1/servers/9307fdad-ca63-449d-bc5c-7e9e167c59f3 => generated 1721 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:43:21.879214 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-e53b2968-aa45-4312-a1c2-5b53828d3d83 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd245c731eb58483bb635a7e70542b892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2049d7705d5c4afe94c22a6f1284327b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:43:21.886886 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-e53b2968-aa45-4312-a1c2-5b53828d3d83 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] 10.222.0.66 "GET /compute/v2.1/servers/bd510bcc-33c6-4299-8a14-018dce8ee011" status: 200 len: 1358 microversion: 2.1 time: 0.191782 Aug 04 03:43:21.887461 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 244/486] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:43:21 2022] GET /compute/v2.1/servers/bd510bcc-33c6-4299-8a14-018dce8ee011 => generated 1358 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 03:43:22.171621 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-05631566-7fed-451f-968e-52181a277446 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:43:22.173505 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-05631566-7fed-451f-968e-52181a277446 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] [instance: eb7f2df0-7ac0-4253-a847-e0f797fa845c] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:43:22.181827 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-05631566-7fed-451f-968e-52181a277446 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:43:22.183372 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-05631566-7fed-451f-968e-52181a277446 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:43:22.185107 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-05631566-7fed-451f-968e-52181a277446 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:43:22.185583 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-05631566-7fed-451f-968e-52181a277446 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:43:22.276980 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-05631566-7fed-451f-968e-52181a277446 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac48e585c133487dadbe0a1e095bfde0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32813adc26c64016b99c9c5fd838d391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:43:22.284591 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-05631566-7fed-451f-968e-52181a277446 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] 10.222.0.66 "GET /compute/v2.1/servers/eb7f2df0-7ac0-4253-a847-e0f797fa845c" status: 200 len: 1144 microversion: 2.1 time: 0.118788 Aug 04 03:43:22.285152 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 243/487] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:43:22 2022] GET /compute/v2.1/servers/eb7f2df0-7ac0-4253-a847-e0f797fa845c => generated 1144 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:43:22.806481 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-b4c752df-1959-4b9c-bebb-abc44d2897d0 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:43:22.808548 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-b4c752df-1959-4b9c-bebb-abc44d2897d0 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] [instance: 9307fdad-ca63-449d-bc5c-7e9e167c59f3] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:43:22.815760 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-b4c752df-1959-4b9c-bebb-abc44d2897d0 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:43:22.816535 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-b4c752df-1959-4b9c-bebb-abc44d2897d0 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:43:22.817548 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-b4c752df-1959-4b9c-bebb-abc44d2897d0 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:43:22.818052 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-b4c752df-1959-4b9c-bebb-abc44d2897d0 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:43:22.919430 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-29b08d73-ad51-465d-b609-475534c77043 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:43:22.919430 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-29b08d73-ad51-465d-b609-475534c77043 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] [instance: bd510bcc-33c6-4299-8a14-018dce8ee011] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:43:22.919430 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-29b08d73-ad51-465d-b609-475534c77043 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:43:22.919430 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-29b08d73-ad51-465d-b609-475534c77043 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:43:22.920819 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-29b08d73-ad51-465d-b609-475534c77043 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:43:22.920819 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-29b08d73-ad51-465d-b609-475534c77043 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:43:22.975563 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-b4c752df-1959-4b9c-bebb-abc44d2897d0 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dba436d0a67433f8c8ae7cd40d3f795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46b8dc64007429b805971d4c6f5b471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:43:22.983868 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-b4c752df-1959-4b9c-bebb-abc44d2897d0 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] 10.222.0.66 "GET /compute/v2.1/servers/9307fdad-ca63-449d-bc5c-7e9e167c59f3" status: 200 len: 1721 microversion: 2.1 time: 0.181244 Aug 04 03:43:22.984700 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 245/488] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:43:22 2022] GET /compute/v2.1/servers/9307fdad-ca63-449d-bc5c-7e9e167c59f3 => generated 1721 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:43:23.077273 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-29b08d73-ad51-465d-b609-475534c77043 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd245c731eb58483bb635a7e70542b892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2049d7705d5c4afe94c22a6f1284327b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:43:23.087795 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-29b08d73-ad51-465d-b609-475534c77043 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] 10.222.0.66 "GET /compute/v2.1/servers/bd510bcc-33c6-4299-8a14-018dce8ee011" status: 200 len: 1358 microversion: 2.1 time: 0.184400 Aug 04 03:43:23.088507 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 244/489] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:43:22 2022] GET /compute/v2.1/servers/bd510bcc-33c6-4299-8a14-018dce8ee011 => generated 1358 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 03:43:23.306092 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-93704cb5-9163-45ce-aa86-25d2fc5d8a31 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:43:23.306616 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-93704cb5-9163-45ce-aa86-25d2fc5d8a31 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] [instance: eb7f2df0-7ac0-4253-a847-e0f797fa845c] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:43:23.312677 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-93704cb5-9163-45ce-aa86-25d2fc5d8a31 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:43:23.313119 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-93704cb5-9163-45ce-aa86-25d2fc5d8a31 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:43:23.313927 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-93704cb5-9163-45ce-aa86-25d2fc5d8a31 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:43:23.314344 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-93704cb5-9163-45ce-aa86-25d2fc5d8a31 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:43:23.380061 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-93704cb5-9163-45ce-aa86-25d2fc5d8a31 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac48e585c133487dadbe0a1e095bfde0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32813adc26c64016b99c9c5fd838d391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:43:23.388665 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-93704cb5-9163-45ce-aa86-25d2fc5d8a31 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] 10.222.0.66 "GET /compute/v2.1/servers/eb7f2df0-7ac0-4253-a847-e0f797fa845c" status: 200 len: 1144 microversion: 2.1 time: 0.086356 Aug 04 03:43:23.389259 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 246/490] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:43:23 2022] GET /compute/v2.1/servers/eb7f2df0-7ac0-4253-a847-e0f797fa845c => generated 1144 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 03:43:24.005594 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-aceb3fcf-a0c7-4a75-b9f1-7d43d7135b19 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:43:24.006209 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-aceb3fcf-a0c7-4a75-b9f1-7d43d7135b19 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] [instance: 9307fdad-ca63-449d-bc5c-7e9e167c59f3] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:43:24.018886 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-aceb3fcf-a0c7-4a75-b9f1-7d43d7135b19 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:43:24.021583 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-aceb3fcf-a0c7-4a75-b9f1-7d43d7135b19 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:43:24.022389 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-aceb3fcf-a0c7-4a75-b9f1-7d43d7135b19 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:43:24.022824 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-aceb3fcf-a0c7-4a75-b9f1-7d43d7135b19 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:43:24.108885 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-3b3fd239-1768-44e5-b7cd-045d8b952a9e tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:43:24.109802 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-3b3fd239-1768-44e5-b7cd-045d8b952a9e tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] [instance: bd510bcc-33c6-4299-8a14-018dce8ee011] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:43:24.116278 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-3b3fd239-1768-44e5-b7cd-045d8b952a9e tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:43:24.116730 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-3b3fd239-1768-44e5-b7cd-045d8b952a9e tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:43:24.117583 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-3b3fd239-1768-44e5-b7cd-045d8b952a9e tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:43:24.118265 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-3b3fd239-1768-44e5-b7cd-045d8b952a9e tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:43:24.239432 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-aceb3fcf-a0c7-4a75-b9f1-7d43d7135b19 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dba436d0a67433f8c8ae7cd40d3f795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46b8dc64007429b805971d4c6f5b471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:43:24.247816 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-aceb3fcf-a0c7-4a75-b9f1-7d43d7135b19 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] 10.222.0.66 "GET /compute/v2.1/servers/9307fdad-ca63-449d-bc5c-7e9e167c59f3" status: 200 len: 1721 microversion: 2.1 time: 0.246018 Aug 04 03:43:24.248386 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 245/491] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:43:24 2022] GET /compute/v2.1/servers/9307fdad-ca63-449d-bc5c-7e9e167c59f3 => generated 1721 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:43:24.308228 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-3b3fd239-1768-44e5-b7cd-045d8b952a9e tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd245c731eb58483bb635a7e70542b892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2049d7705d5c4afe94c22a6f1284327b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:43:24.316951 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-3b3fd239-1768-44e5-b7cd-045d8b952a9e tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] 10.222.0.66 "GET /compute/v2.1/servers/bd510bcc-33c6-4299-8a14-018dce8ee011" status: 200 len: 1358 microversion: 2.1 time: 0.212831 Aug 04 03:43:24.317648 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 247/492] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:43:24 2022] GET /compute/v2.1/servers/bd510bcc-33c6-4299-8a14-018dce8ee011 => generated 1358 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 03:43:24.411673 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-f2953976-7ae4-4c53-bf66-da59be049ed8 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:43:24.412680 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-f2953976-7ae4-4c53-bf66-da59be049ed8 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] [instance: eb7f2df0-7ac0-4253-a847-e0f797fa845c] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:43:24.422707 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-f2953976-7ae4-4c53-bf66-da59be049ed8 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:43:24.423704 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-f2953976-7ae4-4c53-bf66-da59be049ed8 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:43:24.424857 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-f2953976-7ae4-4c53-bf66-da59be049ed8 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:43:24.425607 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-f2953976-7ae4-4c53-bf66-da59be049ed8 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:43:24.496922 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-f2953976-7ae4-4c53-bf66-da59be049ed8 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac48e585c133487dadbe0a1e095bfde0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32813adc26c64016b99c9c5fd838d391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:43:24.512422 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-f2953976-7ae4-4c53-bf66-da59be049ed8 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] 10.222.0.66 "GET /compute/v2.1/servers/eb7f2df0-7ac0-4253-a847-e0f797fa845c" status: 200 len: 1144 microversion: 2.1 time: 0.106040 Aug 04 03:43:24.513023 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 246/493] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:43:24 2022] GET /compute/v2.1/servers/eb7f2df0-7ac0-4253-a847-e0f797fa845c => generated 1144 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:43:25.270257 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-3c60d6a0-3604-478a-940b-cd6302a09b83 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:43:25.270879 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-3c60d6a0-3604-478a-940b-cd6302a09b83 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] [instance: 9307fdad-ca63-449d-bc5c-7e9e167c59f3] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:43:25.278097 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-3c60d6a0-3604-478a-940b-cd6302a09b83 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:43:25.278543 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-3c60d6a0-3604-478a-940b-cd6302a09b83 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:43:25.279305 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-3c60d6a0-3604-478a-940b-cd6302a09b83 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:43:25.279742 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-3c60d6a0-3604-478a-940b-cd6302a09b83 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:43:25.283619 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG dbcounter [-] [130262] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:43:25.339245 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-29b2e2ea-8d25-4d74-942e-c6483d930e3a tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:43:25.340822 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-29b2e2ea-8d25-4d74-942e-c6483d930e3a tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] [instance: bd510bcc-33c6-4299-8a14-018dce8ee011] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:43:25.348153 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-29b2e2ea-8d25-4d74-942e-c6483d930e3a tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:43:25.348968 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-29b2e2ea-8d25-4d74-942e-c6483d930e3a tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:43:25.350111 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-29b2e2ea-8d25-4d74-942e-c6483d930e3a tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:43:25.350990 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-29b2e2ea-8d25-4d74-942e-c6483d930e3a tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:43:25.501992 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-3c60d6a0-3604-478a-940b-cd6302a09b83 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dba436d0a67433f8c8ae7cd40d3f795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46b8dc64007429b805971d4c6f5b471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:43:25.509921 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-3c60d6a0-3604-478a-940b-cd6302a09b83 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] 10.222.0.66 "GET /compute/v2.1/servers/9307fdad-ca63-449d-bc5c-7e9e167c59f3" status: 200 len: 1721 microversion: 2.1 time: 0.243603 Aug 04 03:43:25.511054 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 248/494] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:43:25 2022] GET /compute/v2.1/servers/9307fdad-ca63-449d-bc5c-7e9e167c59f3 => generated 1721 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:43:25.532004 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-29b2e2ea-8d25-4d74-942e-c6483d930e3a tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd245c731eb58483bb635a7e70542b892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2049d7705d5c4afe94c22a6f1284327b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:43:25.533365 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-eecacf8f-b9fe-49b9-8a9c-a66618030004 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:43:25.533979 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-eecacf8f-b9fe-49b9-8a9c-a66618030004 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] [instance: eb7f2df0-7ac0-4253-a847-e0f797fa845c] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:43:25.539666 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-29b2e2ea-8d25-4d74-942e-c6483d930e3a tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] 10.222.0.66 "GET /compute/v2.1/servers/bd510bcc-33c6-4299-8a14-018dce8ee011" status: 200 len: 1358 microversion: 2.1 time: 0.205345 Aug 04 03:43:25.539822 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-eecacf8f-b9fe-49b9-8a9c-a66618030004 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:43:25.540245 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 247/495] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:43:25 2022] GET /compute/v2.1/servers/bd510bcc-33c6-4299-8a14-018dce8ee011 => generated 1358 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:43:25.540400 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-eecacf8f-b9fe-49b9-8a9c-a66618030004 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:43:25.541077 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-eecacf8f-b9fe-49b9-8a9c-a66618030004 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:43:25.542262 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-eecacf8f-b9fe-49b9-8a9c-a66618030004 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:43:25.608814 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-eecacf8f-b9fe-49b9-8a9c-a66618030004 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac48e585c133487dadbe0a1e095bfde0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32813adc26c64016b99c9c5fd838d391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:43:25.617419 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-eecacf8f-b9fe-49b9-8a9c-a66618030004 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] 10.222.0.66 "GET /compute/v2.1/servers/eb7f2df0-7ac0-4253-a847-e0f797fa845c" status: 200 len: 1144 microversion: 2.1 time: 0.087600 Aug 04 03:43:25.630857 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 249/496] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:43:25 2022] GET /compute/v2.1/servers/eb7f2df0-7ac0-4253-a847-e0f797fa845c => generated 1144 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 03:43:26.532408 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-bf01a7e4-895f-4252-9312-51f143bda87f tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:43:26.533078 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-bf01a7e4-895f-4252-9312-51f143bda87f tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] [instance: 9307fdad-ca63-449d-bc5c-7e9e167c59f3] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:43:26.540703 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-bf01a7e4-895f-4252-9312-51f143bda87f tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:43:26.541736 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-bf01a7e4-895f-4252-9312-51f143bda87f tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:43:26.542671 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-bf01a7e4-895f-4252-9312-51f143bda87f tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:43:26.543210 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-bf01a7e4-895f-4252-9312-51f143bda87f tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:43:26.561681 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-858db92e-13ac-45b5-9302-3750b45b5f85 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:43:26.562314 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-858db92e-13ac-45b5-9302-3750b45b5f85 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] [instance: bd510bcc-33c6-4299-8a14-018dce8ee011] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:43:26.569276 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-858db92e-13ac-45b5-9302-3750b45b5f85 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:43:26.569737 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-858db92e-13ac-45b5-9302-3750b45b5f85 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:43:26.570540 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-858db92e-13ac-45b5-9302-3750b45b5f85 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:43:26.571117 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-858db92e-13ac-45b5-9302-3750b45b5f85 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:43:26.766201 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-bf01a7e4-895f-4252-9312-51f143bda87f tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dba436d0a67433f8c8ae7cd40d3f795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46b8dc64007429b805971d4c6f5b471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:43:26.774067 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-bf01a7e4-895f-4252-9312-51f143bda87f tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] 10.222.0.66 "GET /compute/v2.1/servers/9307fdad-ca63-449d-bc5c-7e9e167c59f3" status: 200 len: 1721 microversion: 2.1 time: 0.246095 Aug 04 03:43:26.774638 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 248/497] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:43:26 2022] GET /compute/v2.1/servers/9307fdad-ca63-449d-bc5c-7e9e167c59f3 => generated 1721 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 03:43:26.779434 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-d19e6d63-91f4-4481-bbe3-21f50f047df5 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:43:26.780235 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-d19e6d63-91f4-4481-bbe3-21f50f047df5 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] [instance: eb7f2df0-7ac0-4253-a847-e0f797fa845c] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:43:26.786143 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-d19e6d63-91f4-4481-bbe3-21f50f047df5 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:43:26.786614 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-d19e6d63-91f4-4481-bbe3-21f50f047df5 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:43:26.787417 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-d19e6d63-91f4-4481-bbe3-21f50f047df5 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:43:26.787850 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-d19e6d63-91f4-4481-bbe3-21f50f047df5 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:43:26.792513 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-858db92e-13ac-45b5-9302-3750b45b5f85 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd245c731eb58483bb635a7e70542b892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2049d7705d5c4afe94c22a6f1284327b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:43:26.799464 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-858db92e-13ac-45b5-9302-3750b45b5f85 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] 10.222.0.66 "GET /compute/v2.1/servers/bd510bcc-33c6-4299-8a14-018dce8ee011" status: 200 len: 1358 microversion: 2.1 time: 0.243446 Aug 04 03:43:26.800307 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 250/498] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:43:26 2022] GET /compute/v2.1/servers/bd510bcc-33c6-4299-8a14-018dce8ee011 => generated 1358 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 03:43:26.861141 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-d19e6d63-91f4-4481-bbe3-21f50f047df5 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac48e585c133487dadbe0a1e095bfde0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32813adc26c64016b99c9c5fd838d391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:43:26.869875 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-d19e6d63-91f4-4481-bbe3-21f50f047df5 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] 10.222.0.66 "GET /compute/v2.1/servers/eb7f2df0-7ac0-4253-a847-e0f797fa845c" status: 200 len: 1144 microversion: 2.1 time: 0.093229 Aug 04 03:43:26.873183 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 249/499] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:43:26 2022] GET /compute/v2.1/servers/eb7f2df0-7ac0-4253-a847-e0f797fa845c => generated 1144 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:43:27.796538 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-000a8102-ec83-4c4e-a49d-22e449190a21 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:43:27.797566 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-000a8102-ec83-4c4e-a49d-22e449190a21 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] [instance: 9307fdad-ca63-449d-bc5c-7e9e167c59f3] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:43:27.808382 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-000a8102-ec83-4c4e-a49d-22e449190a21 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:43:27.809082 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-000a8102-ec83-4c4e-a49d-22e449190a21 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:43:27.810395 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-000a8102-ec83-4c4e-a49d-22e449190a21 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:43:27.810901 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-000a8102-ec83-4c4e-a49d-22e449190a21 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:43:27.814389 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG dbcounter [-] [130262] Writing DB stats nova_cell0:SELECT=8 {{(pid=130262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:43:27.823036 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-3669d75f-4134-42ac-b1f4-0c0ef20bb365 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:43:27.823699 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-3669d75f-4134-42ac-b1f4-0c0ef20bb365 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] [instance: bd510bcc-33c6-4299-8a14-018dce8ee011] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:43:27.825629 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG dbcounter [-] [130263] Writing DB stats nova_cell0:SELECT=2 {{(pid=130263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:43:27.830145 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG dbcounter [-] [130263] Writing DB stats nova_cell0:SELECT=12 {{(pid=130263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:43:27.831611 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-3669d75f-4134-42ac-b1f4-0c0ef20bb365 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:43:27.832057 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-3669d75f-4134-42ac-b1f4-0c0ef20bb365 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:43:27.832825 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-3669d75f-4134-42ac-b1f4-0c0ef20bb365 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:43:27.833287 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-3669d75f-4134-42ac-b1f4-0c0ef20bb365 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:43:28.016503 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-000a8102-ec83-4c4e-a49d-22e449190a21 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dba436d0a67433f8c8ae7cd40d3f795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46b8dc64007429b805971d4c6f5b471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:43:28.027792 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-000a8102-ec83-4c4e-a49d-22e449190a21 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] 10.222.0.66 "GET /compute/v2.1/servers/9307fdad-ca63-449d-bc5c-7e9e167c59f3" status: 200 len: 1721 microversion: 2.1 time: 0.234687 Aug 04 03:43:28.028397 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 251/500] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:43:27 2022] GET /compute/v2.1/servers/9307fdad-ca63-449d-bc5c-7e9e167c59f3 => generated 1721 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 03:43:28.029160 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-3669d75f-4134-42ac-b1f4-0c0ef20bb365 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd245c731eb58483bb635a7e70542b892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2049d7705d5c4afe94c22a6f1284327b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:43:28.032914 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-d8b86748-3e1c-4ec8-9774-f6c0b44bf080 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:43:28.033368 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG dbcounter [-] [130263] Writing DB stats nova_cell1:SELECT=100 {{(pid=130263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:43:28.033552 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-d8b86748-3e1c-4ec8-9774-f6c0b44bf080 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] [instance: eb7f2df0-7ac0-4253-a847-e0f797fa845c] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:43:28.038379 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-3669d75f-4134-42ac-b1f4-0c0ef20bb365 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] 10.222.0.66 "GET /compute/v2.1/servers/bd510bcc-33c6-4299-8a14-018dce8ee011" status: 200 len: 1358 microversion: 2.1 time: 0.219175 Aug 04 03:43:28.039643 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 250/501] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:43:27 2022] GET /compute/v2.1/servers/bd510bcc-33c6-4299-8a14-018dce8ee011 => generated 1358 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 03:43:28.041899 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-d8b86748-3e1c-4ec8-9774-f6c0b44bf080 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:43:28.043021 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-d8b86748-3e1c-4ec8-9774-f6c0b44bf080 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:43:28.044020 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-d8b86748-3e1c-4ec8-9774-f6c0b44bf080 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:43:28.044654 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-d8b86748-3e1c-4ec8-9774-f6c0b44bf080 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:43:28.111122 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-d8b86748-3e1c-4ec8-9774-f6c0b44bf080 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac48e585c133487dadbe0a1e095bfde0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32813adc26c64016b99c9c5fd838d391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:43:28.118921 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-d8b86748-3e1c-4ec8-9774-f6c0b44bf080 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] 10.222.0.66 "GET /compute/v2.1/servers/eb7f2df0-7ac0-4253-a847-e0f797fa845c" status: 200 len: 1144 microversion: 2.1 time: 0.089510 Aug 04 03:43:28.120035 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 252/502] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:43:28 2022] GET /compute/v2.1/servers/eb7f2df0-7ac0-4253-a847-e0f797fa845c => generated 1144 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:43:29.052884 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-1427f186-af18-455c-9f89-1ccab69778f5 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:43:29.053578 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-1427f186-af18-455c-9f89-1ccab69778f5 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] [instance: 9307fdad-ca63-449d-bc5c-7e9e167c59f3] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:43:29.060064 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-36f1ef28-7710-4b77-a4b7-1c0e741163fd tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:43:29.061612 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-36f1ef28-7710-4b77-a4b7-1c0e741163fd tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] [instance: bd510bcc-33c6-4299-8a14-018dce8ee011] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:43:29.068458 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-36f1ef28-7710-4b77-a4b7-1c0e741163fd tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:43:29.073325 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-36f1ef28-7710-4b77-a4b7-1c0e741163fd tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:43:29.073325 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-36f1ef28-7710-4b77-a4b7-1c0e741163fd tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:43:29.073325 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-36f1ef28-7710-4b77-a4b7-1c0e741163fd tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:43:29.073652 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-1427f186-af18-455c-9f89-1ccab69778f5 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:43:29.073652 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-1427f186-af18-455c-9f89-1ccab69778f5 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:43:29.073652 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-1427f186-af18-455c-9f89-1ccab69778f5 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:43:29.085682 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-1427f186-af18-455c-9f89-1ccab69778f5 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:43:29.312858 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-36f1ef28-7710-4b77-a4b7-1c0e741163fd tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd245c731eb58483bb635a7e70542b892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2049d7705d5c4afe94c22a6f1284327b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:43:29.326451 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-36f1ef28-7710-4b77-a4b7-1c0e741163fd tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] 10.222.0.66 "GET /compute/v2.1/servers/bd510bcc-33c6-4299-8a14-018dce8ee011" status: 200 len: 1358 microversion: 2.1 time: 0.271039 Aug 04 03:43:29.339083 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 253/503] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:43:29 2022] GET /compute/v2.1/servers/bd510bcc-33c6-4299-8a14-018dce8ee011 => generated 1358 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 03:43:29.339199 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-1427f186-af18-455c-9f89-1ccab69778f5 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dba436d0a67433f8c8ae7cd40d3f795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46b8dc64007429b805971d4c6f5b471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:43:29.348321 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-81c99d29-257a-4a16-ab98-e6c1ad31327c tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:43:29.349009 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-81c99d29-257a-4a16-ab98-e6c1ad31327c tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] [instance: eb7f2df0-7ac0-4253-a847-e0f797fa845c] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:43:29.356619 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-81c99d29-257a-4a16-ab98-e6c1ad31327c tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:43:29.356844 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-1427f186-af18-455c-9f89-1ccab69778f5 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] 10.222.0.66 "GET /compute/v2.1/servers/9307fdad-ca63-449d-bc5c-7e9e167c59f3" status: 200 len: 1721 microversion: 2.1 time: 0.308254 Aug 04 03:43:29.357078 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-81c99d29-257a-4a16-ab98-e6c1ad31327c tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:43:29.357349 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 251/504] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:43:29 2022] GET /compute/v2.1/servers/9307fdad-ca63-449d-bc5c-7e9e167c59f3 => generated 1721 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:43:29.358089 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-81c99d29-257a-4a16-ab98-e6c1ad31327c tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:43:29.358534 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-81c99d29-257a-4a16-ab98-e6c1ad31327c tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:43:29.427591 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-81c99d29-257a-4a16-ab98-e6c1ad31327c tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac48e585c133487dadbe0a1e095bfde0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32813adc26c64016b99c9c5fd838d391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:43:29.435826 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-81c99d29-257a-4a16-ab98-e6c1ad31327c tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] 10.222.0.66 "GET /compute/v2.1/servers/eb7f2df0-7ac0-4253-a847-e0f797fa845c" status: 200 len: 1144 microversion: 2.1 time: 0.100709 Aug 04 03:43:29.436478 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 254/505] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:43:29 2022] GET /compute/v2.1/servers/eb7f2df0-7ac0-4253-a847-e0f797fa845c => generated 1144 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:43:30.349916 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-8a1c57e1-098c-48d9-a5d6-cac080fc95f8 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:43:30.350525 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-8a1c57e1-098c-48d9-a5d6-cac080fc95f8 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] [instance: bd510bcc-33c6-4299-8a14-018dce8ee011] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:43:30.357176 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-8a1c57e1-098c-48d9-a5d6-cac080fc95f8 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:43:30.357656 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-8a1c57e1-098c-48d9-a5d6-cac080fc95f8 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:43:30.358413 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-8a1c57e1-098c-48d9-a5d6-cac080fc95f8 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:43:30.358847 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-8a1c57e1-098c-48d9-a5d6-cac080fc95f8 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:43:30.378523 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-65285174-0aa3-40ac-beb1-f2abf2db183c tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:43:30.379130 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-65285174-0aa3-40ac-beb1-f2abf2db183c tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] [instance: 9307fdad-ca63-449d-bc5c-7e9e167c59f3] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:43:30.386158 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-65285174-0aa3-40ac-beb1-f2abf2db183c tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:43:30.386556 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-65285174-0aa3-40ac-beb1-f2abf2db183c tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:43:30.387312 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-65285174-0aa3-40ac-beb1-f2abf2db183c tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:43:30.387741 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-65285174-0aa3-40ac-beb1-f2abf2db183c tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:43:30.555612 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-8a1c57e1-098c-48d9-a5d6-cac080fc95f8 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd245c731eb58483bb635a7e70542b892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2049d7705d5c4afe94c22a6f1284327b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:43:30.563204 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-65285174-0aa3-40ac-beb1-f2abf2db183c tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dba436d0a67433f8c8ae7cd40d3f795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46b8dc64007429b805971d4c6f5b471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:43:30.563974 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-8a1c57e1-098c-48d9-a5d6-cac080fc95f8 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] 10.222.0.66 "GET /compute/v2.1/servers/bd510bcc-33c6-4299-8a14-018dce8ee011" status: 200 len: 1358 microversion: 2.1 time: 0.217856 Aug 04 03:43:30.564536 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 252/506] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:43:30 2022] GET /compute/v2.1/servers/bd510bcc-33c6-4299-8a14-018dce8ee011 => generated 1358 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:43:30.572196 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-baea413a-1d1c-4124-a8e0-3f06bf91add0 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:43:30.572196 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-baea413a-1d1c-4124-a8e0-3f06bf91add0 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] [instance: eb7f2df0-7ac0-4253-a847-e0f797fa845c] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:43:30.572418 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-65285174-0aa3-40ac-beb1-f2abf2db183c tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] 10.222.0.66 "GET /compute/v2.1/servers/9307fdad-ca63-449d-bc5c-7e9e167c59f3" status: 200 len: 1721 microversion: 2.1 time: 0.196419 Aug 04 03:43:30.572418 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 255/507] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:43:30 2022] GET /compute/v2.1/servers/9307fdad-ca63-449d-bc5c-7e9e167c59f3 => generated 1721 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 03:43:30.577147 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-baea413a-1d1c-4124-a8e0-3f06bf91add0 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:43:30.577774 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-baea413a-1d1c-4124-a8e0-3f06bf91add0 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:43:30.578548 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-baea413a-1d1c-4124-a8e0-3f06bf91add0 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:43:30.578984 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-baea413a-1d1c-4124-a8e0-3f06bf91add0 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:43:30.639741 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-baea413a-1d1c-4124-a8e0-3f06bf91add0 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac48e585c133487dadbe0a1e095bfde0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32813adc26c64016b99c9c5fd838d391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:43:30.646996 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-baea413a-1d1c-4124-a8e0-3f06bf91add0 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] 10.222.0.66 "GET /compute/v2.1/servers/eb7f2df0-7ac0-4253-a847-e0f797fa845c" status: 200 len: 1144 microversion: 2.1 time: 0.081450 Aug 04 03:43:30.647560 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 253/508] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:43:30 2022] GET /compute/v2.1/servers/eb7f2df0-7ac0-4253-a847-e0f797fa845c => generated 1144 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:43:31.584447 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-77598c77-3680-4061-9603-6a87e254fa5d tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:43:31.585053 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-77598c77-3680-4061-9603-6a87e254fa5d tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] [instance: bd510bcc-33c6-4299-8a14-018dce8ee011] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:43:31.592083 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-77598c77-3680-4061-9603-6a87e254fa5d tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:43:31.592522 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-77598c77-3680-4061-9603-6a87e254fa5d tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:43:31.593007 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-0510c45f-65bb-4d15-a7a8-32f1ffdf51b2 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:43:31.593455 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-77598c77-3680-4061-9603-6a87e254fa5d tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:43:31.593659 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-0510c45f-65bb-4d15-a7a8-32f1ffdf51b2 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] [instance: 9307fdad-ca63-449d-bc5c-7e9e167c59f3] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:43:31.593845 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-77598c77-3680-4061-9603-6a87e254fa5d tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:43:31.600099 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-0510c45f-65bb-4d15-a7a8-32f1ffdf51b2 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:43:31.600583 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-0510c45f-65bb-4d15-a7a8-32f1ffdf51b2 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:43:31.601385 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-0510c45f-65bb-4d15-a7a8-32f1ffdf51b2 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:43:31.601831 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-0510c45f-65bb-4d15-a7a8-32f1ffdf51b2 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:43:31.793621 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-77598c77-3680-4061-9603-6a87e254fa5d tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd245c731eb58483bb635a7e70542b892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2049d7705d5c4afe94c22a6f1284327b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:43:31.796844 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-0510c45f-65bb-4d15-a7a8-32f1ffdf51b2 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dba436d0a67433f8c8ae7cd40d3f795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46b8dc64007429b805971d4c6f5b471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:43:31.801020 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-77598c77-3680-4061-9603-6a87e254fa5d tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] 10.222.0.66 "GET /compute/v2.1/servers/bd510bcc-33c6-4299-8a14-018dce8ee011" status: 200 len: 1358 microversion: 2.1 time: 0.220403 Aug 04 03:43:31.801633 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 256/509] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:43:31 2022] GET /compute/v2.1/servers/bd510bcc-33c6-4299-8a14-018dce8ee011 => generated 1358 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:43:31.805727 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-0510c45f-65bb-4d15-a7a8-32f1ffdf51b2 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] 10.222.0.66 "GET /compute/v2.1/servers/9307fdad-ca63-449d-bc5c-7e9e167c59f3" status: 200 len: 1721 microversion: 2.1 time: 0.217072 Aug 04 03:43:31.806177 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-47cd33c2-3422-4e94-9c35-ab0d63984540 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:43:31.814217 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 254/510] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:43:31 2022] GET /compute/v2.1/servers/9307fdad-ca63-449d-bc5c-7e9e167c59f3 => generated 1721 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 03:43:31.814371 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-47cd33c2-3422-4e94-9c35-ab0d63984540 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] [instance: eb7f2df0-7ac0-4253-a847-e0f797fa845c] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:43:31.814371 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-47cd33c2-3422-4e94-9c35-ab0d63984540 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:43:31.814371 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-47cd33c2-3422-4e94-9c35-ab0d63984540 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:43:31.814603 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-47cd33c2-3422-4e94-9c35-ab0d63984540 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:43:31.815172 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-47cd33c2-3422-4e94-9c35-ab0d63984540 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:43:31.875371 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-47cd33c2-3422-4e94-9c35-ab0d63984540 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac48e585c133487dadbe0a1e095bfde0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32813adc26c64016b99c9c5fd838d391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:43:31.882545 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-47cd33c2-3422-4e94-9c35-ab0d63984540 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] 10.222.0.66 "GET /compute/v2.1/servers/eb7f2df0-7ac0-4253-a847-e0f797fa845c" status: 200 len: 1144 microversion: 2.1 time: 0.079865 Aug 04 03:43:31.883100 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 257/511] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:43:31 2022] GET /compute/v2.1/servers/eb7f2df0-7ac0-4253-a847-e0f797fa845c => generated 1144 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:43:32.822032 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-9a9da255-d41e-4614-87ba-df457f1fb466 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:43:32.822709 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-9a9da255-d41e-4614-87ba-df457f1fb466 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] [instance: bd510bcc-33c6-4299-8a14-018dce8ee011] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:43:32.826991 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-da171904-186c-4165-ab89-02dace6823e8 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:43:32.827664 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-da171904-186c-4165-ab89-02dace6823e8 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] [instance: 9307fdad-ca63-449d-bc5c-7e9e167c59f3] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:43:32.830615 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-9a9da255-d41e-4614-87ba-df457f1fb466 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:43:32.831076 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-9a9da255-d41e-4614-87ba-df457f1fb466 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:43:32.831851 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-9a9da255-d41e-4614-87ba-df457f1fb466 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:43:32.832290 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-9a9da255-d41e-4614-87ba-df457f1fb466 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:43:32.842070 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-da171904-186c-4165-ab89-02dace6823e8 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:43:32.844100 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-da171904-186c-4165-ab89-02dace6823e8 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:43:32.844955 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-da171904-186c-4165-ab89-02dace6823e8 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:43:32.845643 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-da171904-186c-4165-ab89-02dace6823e8 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:43:33.045705 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-9a9da255-d41e-4614-87ba-df457f1fb466 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd245c731eb58483bb635a7e70542b892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2049d7705d5c4afe94c22a6f1284327b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:43:33.054714 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-9a9da255-d41e-4614-87ba-df457f1fb466 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] 10.222.0.66 "GET /compute/v2.1/servers/bd510bcc-33c6-4299-8a14-018dce8ee011" status: 200 len: 1358 microversion: 2.1 time: 0.236527 Aug 04 03:43:33.055299 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 255/512] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:43:32 2022] GET /compute/v2.1/servers/bd510bcc-33c6-4299-8a14-018dce8ee011 => generated 1358 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:43:33.060346 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-d093df81-6824-42c6-97e7-374c25b0df4d tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:43:33.061620 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-d093df81-6824-42c6-97e7-374c25b0df4d tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] [instance: eb7f2df0-7ac0-4253-a847-e0f797fa845c] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:43:33.063569 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-da171904-186c-4165-ab89-02dace6823e8 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dba436d0a67433f8c8ae7cd40d3f795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46b8dc64007429b805971d4c6f5b471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:43:33.068190 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-d093df81-6824-42c6-97e7-374c25b0df4d tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:43:33.068655 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-d093df81-6824-42c6-97e7-374c25b0df4d tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:43:33.069517 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-d093df81-6824-42c6-97e7-374c25b0df4d tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:43:33.070236 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-d093df81-6824-42c6-97e7-374c25b0df4d tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:43:33.077185 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-da171904-186c-4165-ab89-02dace6823e8 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] 10.222.0.66 "GET /compute/v2.1/servers/9307fdad-ca63-449d-bc5c-7e9e167c59f3" status: 200 len: 1721 microversion: 2.1 time: 0.254335 Aug 04 03:43:33.080085 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 258/513] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:43:32 2022] GET /compute/v2.1/servers/9307fdad-ca63-449d-bc5c-7e9e167c59f3 => generated 1721 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 03:43:33.137254 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-d093df81-6824-42c6-97e7-374c25b0df4d tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac48e585c133487dadbe0a1e095bfde0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32813adc26c64016b99c9c5fd838d391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:43:33.144373 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-d093df81-6824-42c6-97e7-374c25b0df4d tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] 10.222.0.66 "GET /compute/v2.1/servers/eb7f2df0-7ac0-4253-a847-e0f797fa845c" status: 200 len: 1144 microversion: 2.1 time: 0.087748 Aug 04 03:43:33.144947 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 256/514] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:43:33 2022] GET /compute/v2.1/servers/eb7f2df0-7ac0-4253-a847-e0f797fa845c => generated 1144 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:43:34.076333 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-cc845824-8090-43df-86b7-eab7c4f8fa5f tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:43:34.076991 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-cc845824-8090-43df-86b7-eab7c4f8fa5f tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] [instance: bd510bcc-33c6-4299-8a14-018dce8ee011] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:43:34.083617 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-cc845824-8090-43df-86b7-eab7c4f8fa5f tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:43:34.097979 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-cc845824-8090-43df-86b7-eab7c4f8fa5f tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:43:34.097979 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-cc845824-8090-43df-86b7-eab7c4f8fa5f tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:43:34.097979 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-cc845824-8090-43df-86b7-eab7c4f8fa5f tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:43:34.099961 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-b2cad605-ab81-4700-bf70-2a9ec385b9db tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:43:34.100574 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-b2cad605-ab81-4700-bf70-2a9ec385b9db tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] [instance: 9307fdad-ca63-449d-bc5c-7e9e167c59f3] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:43:34.108251 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-b2cad605-ab81-4700-bf70-2a9ec385b9db tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:43:34.108815 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-b2cad605-ab81-4700-bf70-2a9ec385b9db tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:43:34.110205 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-b2cad605-ab81-4700-bf70-2a9ec385b9db tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:43:34.110711 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-b2cad605-ab81-4700-bf70-2a9ec385b9db tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:43:34.306462 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-cc845824-8090-43df-86b7-eab7c4f8fa5f tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd245c731eb58483bb635a7e70542b892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2049d7705d5c4afe94c22a6f1284327b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:43:34.315577 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-b2cad605-ab81-4700-bf70-2a9ec385b9db tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dba436d0a67433f8c8ae7cd40d3f795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46b8dc64007429b805971d4c6f5b471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:43:34.315740 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-cc845824-8090-43df-86b7-eab7c4f8fa5f tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] 10.222.0.66 "GET /compute/v2.1/servers/bd510bcc-33c6-4299-8a14-018dce8ee011" status: 200 len: 1358 microversion: 2.1 time: 0.242678 Aug 04 03:43:34.315740 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 259/515] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:43:34 2022] GET /compute/v2.1/servers/bd510bcc-33c6-4299-8a14-018dce8ee011 => generated 1358 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:43:34.319449 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-222d0efc-f708-47c4-8449-06a3d6020dfa tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:43:34.320062 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-222d0efc-f708-47c4-8449-06a3d6020dfa tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] [instance: eb7f2df0-7ac0-4253-a847-e0f797fa845c] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:43:34.324680 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-b2cad605-ab81-4700-bf70-2a9ec385b9db tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] 10.222.0.66 "GET /compute/v2.1/servers/9307fdad-ca63-449d-bc5c-7e9e167c59f3" status: 200 len: 1698 microversion: 2.1 time: 0.228629 Aug 04 03:43:34.325518 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 257/516] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:43:34 2022] GET /compute/v2.1/servers/9307fdad-ca63-449d-bc5c-7e9e167c59f3 => generated 1698 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:43:34.326262 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-222d0efc-f708-47c4-8449-06a3d6020dfa tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:43:34.326716 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-222d0efc-f708-47c4-8449-06a3d6020dfa tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:43:34.327490 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-222d0efc-f708-47c4-8449-06a3d6020dfa tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:43:34.328073 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-222d0efc-f708-47c4-8449-06a3d6020dfa tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:43:34.350857 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-db1a040a-3a63-40bd-8abf-7a73f66e0c0f tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 03:43:34.356938 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-db1a040a-3a63-40bd-8abf-7a73f66e0c0f tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:43:34.357422 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-db1a040a-3a63-40bd-8abf-7a73f66e0c0f tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:43:34.391958 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-222d0efc-f708-47c4-8449-06a3d6020dfa tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac48e585c133487dadbe0a1e095bfde0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32813adc26c64016b99c9c5fd838d391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:43:34.399448 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-222d0efc-f708-47c4-8449-06a3d6020dfa tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] 10.222.0.66 "GET /compute/v2.1/servers/eb7f2df0-7ac0-4253-a847-e0f797fa845c" status: 200 len: 1200 microversion: 2.1 time: 0.083590 Aug 04 03:43:34.400010 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 260/517] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:43:34 2022] GET /compute/v2.1/servers/eb7f2df0-7ac0-4253-a847-e0f797fa845c => generated 1200 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:43:34.418202 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-db1a040a-3a63-40bd-8abf-7a73f66e0c0f tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] [instance: 9307fdad-ca63-449d-bc5c-7e9e167c59f3] Going to try to start instance {{(pid=130263) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 04 03:43:34.572688 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-db1a040a-3a63-40bd-8abf-7a73f66e0c0f tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] 10.222.0.66 "POST /compute/v2.1/servers/9307fdad-ca63-449d-bc5c-7e9e167c59f3/action" status: 202 len: 0 microversion: 2.1 time: 0.225525 Aug 04 03:43:34.573263 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 258/518] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 03:43:34 2022] POST /compute/v2.1/servers/9307fdad-ca63-449d-bc5c-7e9e167c59f3/action => generated 0 bytes in 227 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 04 03:43:34.581465 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-550c2174-08b7-40a5-a333-cb9116b4e7e5 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:43:34.586732 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-550c2174-08b7-40a5-a333-cb9116b4e7e5 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] [instance: 9307fdad-ca63-449d-bc5c-7e9e167c59f3] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:43:34.588298 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-550c2174-08b7-40a5-a333-cb9116b4e7e5 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:43:34.588801 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-550c2174-08b7-40a5-a333-cb9116b4e7e5 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:43:34.589676 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-550c2174-08b7-40a5-a333-cb9116b4e7e5 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:43:34.590118 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-550c2174-08b7-40a5-a333-cb9116b4e7e5 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:43:34.722006 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-550c2174-08b7-40a5-a333-cb9116b4e7e5 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dba436d0a67433f8c8ae7cd40d3f795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46b8dc64007429b805971d4c6f5b471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:43:34.731351 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-550c2174-08b7-40a5-a333-cb9116b4e7e5 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] 10.222.0.66 "GET /compute/v2.1/servers/9307fdad-ca63-449d-bc5c-7e9e167c59f3" status: 200 len: 1707 microversion: 2.1 time: 0.153945 Aug 04 03:43:34.731970 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 261/519] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:43:34 2022] GET /compute/v2.1/servers/9307fdad-ca63-449d-bc5c-7e9e167c59f3 => generated 1707 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:43:35.336252 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-e22aaeac-605e-4db5-b934-ae5e9e7e7f00 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:43:35.337072 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-e22aaeac-605e-4db5-b934-ae5e9e7e7f00 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] [instance: bd510bcc-33c6-4299-8a14-018dce8ee011] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:43:35.343915 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-e22aaeac-605e-4db5-b934-ae5e9e7e7f00 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:43:35.344362 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-e22aaeac-605e-4db5-b934-ae5e9e7e7f00 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:43:35.345132 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-e22aaeac-605e-4db5-b934-ae5e9e7e7f00 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:43:35.345587 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-e22aaeac-605e-4db5-b934-ae5e9e7e7f00 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:43:35.420165 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-fb106147-7b94-443b-87bb-e6d7d98090ae tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:43:35.421457 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-fb106147-7b94-443b-87bb-e6d7d98090ae tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] [instance: eb7f2df0-7ac0-4253-a847-e0f797fa845c] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:43:35.432710 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-fb106147-7b94-443b-87bb-e6d7d98090ae tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:43:35.433264 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-fb106147-7b94-443b-87bb-e6d7d98090ae tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:43:35.434642 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-fb106147-7b94-443b-87bb-e6d7d98090ae tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:43:35.435147 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-fb106147-7b94-443b-87bb-e6d7d98090ae tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:43:35.488451 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-e22aaeac-605e-4db5-b934-ae5e9e7e7f00 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd245c731eb58483bb635a7e70542b892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2049d7705d5c4afe94c22a6f1284327b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:43:35.497232 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-e22aaeac-605e-4db5-b934-ae5e9e7e7f00 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] 10.222.0.66 "GET /compute/v2.1/servers/bd510bcc-33c6-4299-8a14-018dce8ee011" status: 200 len: 1358 microversion: 2.1 time: 0.165474 Aug 04 03:43:35.497869 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 259/520] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:43:35 2022] GET /compute/v2.1/servers/bd510bcc-33c6-4299-8a14-018dce8ee011 => generated 1358 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:43:35.505952 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-fb106147-7b94-443b-87bb-e6d7d98090ae tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac48e585c133487dadbe0a1e095bfde0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32813adc26c64016b99c9c5fd838d391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:43:35.514040 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-fb106147-7b94-443b-87bb-e6d7d98090ae tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] 10.222.0.66 "GET /compute/v2.1/servers/eb7f2df0-7ac0-4253-a847-e0f797fa845c" status: 200 len: 1210 microversion: 2.1 time: 0.098054 Aug 04 03:43:35.514609 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 262/521] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:43:35 2022] GET /compute/v2.1/servers/eb7f2df0-7ac0-4253-a847-e0f797fa845c => generated 1210 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:43:35.752800 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-726f1d85-fd89-4077-851f-16903cf235eb tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:43:35.753481 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-726f1d85-fd89-4077-851f-16903cf235eb tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] [instance: 9307fdad-ca63-449d-bc5c-7e9e167c59f3] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:43:35.759399 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-726f1d85-fd89-4077-851f-16903cf235eb tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:43:35.759875 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-726f1d85-fd89-4077-851f-16903cf235eb tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:43:35.760621 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-726f1d85-fd89-4077-851f-16903cf235eb tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:43:35.761050 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-726f1d85-fd89-4077-851f-16903cf235eb tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:43:35.910810 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-726f1d85-fd89-4077-851f-16903cf235eb tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dba436d0a67433f8c8ae7cd40d3f795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46b8dc64007429b805971d4c6f5b471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:43:35.919530 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-726f1d85-fd89-4077-851f-16903cf235eb tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] 10.222.0.66 "GET /compute/v2.1/servers/9307fdad-ca63-449d-bc5c-7e9e167c59f3" status: 200 len: 1707 microversion: 2.1 time: 0.170426 Aug 04 03:43:35.920130 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 260/522] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:43:35 2022] GET /compute/v2.1/servers/9307fdad-ca63-449d-bc5c-7e9e167c59f3 => generated 1707 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:43:36.518083 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-215f082e-2c49-411b-bc9d-02c6aea6b888 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:43:36.518708 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-215f082e-2c49-411b-bc9d-02c6aea6b888 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] [instance: bd510bcc-33c6-4299-8a14-018dce8ee011] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:43:36.525242 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-215f082e-2c49-411b-bc9d-02c6aea6b888 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:43:36.525695 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-215f082e-2c49-411b-bc9d-02c6aea6b888 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:43:36.526453 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-215f082e-2c49-411b-bc9d-02c6aea6b888 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:43:36.526881 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-215f082e-2c49-411b-bc9d-02c6aea6b888 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:43:36.535608 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-c15afd4d-956d-4dd5-ac36-f4ce4d0c8835 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:43:36.536833 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-c15afd4d-956d-4dd5-ac36-f4ce4d0c8835 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] [instance: eb7f2df0-7ac0-4253-a847-e0f797fa845c] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:43:36.544040 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-c15afd4d-956d-4dd5-ac36-f4ce4d0c8835 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:43:36.544486 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-c15afd4d-956d-4dd5-ac36-f4ce4d0c8835 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:43:36.545266 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-c15afd4d-956d-4dd5-ac36-f4ce4d0c8835 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:43:36.545700 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-c15afd4d-956d-4dd5-ac36-f4ce4d0c8835 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:43:36.624543 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-c15afd4d-956d-4dd5-ac36-f4ce4d0c8835 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac48e585c133487dadbe0a1e095bfde0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32813adc26c64016b99c9c5fd838d391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:43:36.632130 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-c15afd4d-956d-4dd5-ac36-f4ce4d0c8835 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] 10.222.0.66 "GET /compute/v2.1/servers/eb7f2df0-7ac0-4253-a847-e0f797fa845c" status: 200 len: 1210 microversion: 2.1 time: 0.100499 Aug 04 03:43:36.632916 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 261/523] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:43:36 2022] GET /compute/v2.1/servers/eb7f2df0-7ac0-4253-a847-e0f797fa845c => generated 1210 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:43:36.688838 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-215f082e-2c49-411b-bc9d-02c6aea6b888 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd245c731eb58483bb635a7e70542b892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2049d7705d5c4afe94c22a6f1284327b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:43:36.696488 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-215f082e-2c49-411b-bc9d-02c6aea6b888 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] 10.222.0.66 "GET /compute/v2.1/servers/bd510bcc-33c6-4299-8a14-018dce8ee011" status: 200 len: 1358 microversion: 2.1 time: 0.182195 Aug 04 03:43:36.697055 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 263/524] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:43:36 2022] GET /compute/v2.1/servers/bd510bcc-33c6-4299-8a14-018dce8ee011 => generated 1358 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:43:36.940586 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-8a5ef485-968e-413d-b51e-e4f4fc3d5da1 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:43:36.941120 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-8a5ef485-968e-413d-b51e-e4f4fc3d5da1 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] [instance: 9307fdad-ca63-449d-bc5c-7e9e167c59f3] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:43:36.947316 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-8a5ef485-968e-413d-b51e-e4f4fc3d5da1 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:43:36.947775 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-8a5ef485-968e-413d-b51e-e4f4fc3d5da1 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:43:36.948542 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-8a5ef485-968e-413d-b51e-e4f4fc3d5da1 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:43:36.948982 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-8a5ef485-968e-413d-b51e-e4f4fc3d5da1 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:43:37.096960 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-8a5ef485-968e-413d-b51e-e4f4fc3d5da1 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dba436d0a67433f8c8ae7cd40d3f795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46b8dc64007429b805971d4c6f5b471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:43:37.106691 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-8a5ef485-968e-413d-b51e-e4f4fc3d5da1 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] 10.222.0.66 "GET /compute/v2.1/servers/9307fdad-ca63-449d-bc5c-7e9e167c59f3" status: 200 len: 1707 microversion: 2.1 time: 0.169901 Aug 04 03:43:37.109903 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 262/525] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:43:36 2022] GET /compute/v2.1/servers/9307fdad-ca63-449d-bc5c-7e9e167c59f3 => generated 1707 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:43:37.655947 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-acb5ba77-708e-4194-84bb-17870a79f64d tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:43:37.656602 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-acb5ba77-708e-4194-84bb-17870a79f64d tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] [instance: eb7f2df0-7ac0-4253-a847-e0f797fa845c] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:43:37.662846 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-acb5ba77-708e-4194-84bb-17870a79f64d tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:43:37.663356 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-acb5ba77-708e-4194-84bb-17870a79f64d tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:43:37.665314 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-acb5ba77-708e-4194-84bb-17870a79f64d tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:43:37.665906 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-acb5ba77-708e-4194-84bb-17870a79f64d tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:43:37.720422 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-f3dbf5ef-11bc-4c39-820d-5ad18734213b tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:43:37.721109 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-f3dbf5ef-11bc-4c39-820d-5ad18734213b tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] [instance: bd510bcc-33c6-4299-8a14-018dce8ee011] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:43:37.732132 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-f3dbf5ef-11bc-4c39-820d-5ad18734213b tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:43:37.732132 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-f3dbf5ef-11bc-4c39-820d-5ad18734213b tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:43:37.732132 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-f3dbf5ef-11bc-4c39-820d-5ad18734213b tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:43:37.732540 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-f3dbf5ef-11bc-4c39-820d-5ad18734213b tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:43:37.757120 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-acb5ba77-708e-4194-84bb-17870a79f64d tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac48e585c133487dadbe0a1e095bfde0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32813adc26c64016b99c9c5fd838d391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:43:37.762405 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG dbcounter [-] [130262] Writing DB stats nova_cell1:SELECT=100 {{(pid=130262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:43:37.767407 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-acb5ba77-708e-4194-84bb-17870a79f64d tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] 10.222.0.66 "GET /compute/v2.1/servers/eb7f2df0-7ac0-4253-a847-e0f797fa845c" status: 200 len: 1210 microversion: 2.1 time: 0.117210 Aug 04 03:43:37.768478 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 264/526] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:43:37 2022] GET /compute/v2.1/servers/eb7f2df0-7ac0-4253-a847-e0f797fa845c => generated 1210 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:43:37.986583 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-f3dbf5ef-11bc-4c39-820d-5ad18734213b tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd245c731eb58483bb635a7e70542b892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2049d7705d5c4afe94c22a6f1284327b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:43:37.994917 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-f3dbf5ef-11bc-4c39-820d-5ad18734213b tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] 10.222.0.66 "GET /compute/v2.1/servers/bd510bcc-33c6-4299-8a14-018dce8ee011" status: 200 len: 1358 microversion: 2.1 time: 0.280536 Aug 04 03:43:37.995579 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 263/527] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:43:37 2022] GET /compute/v2.1/servers/bd510bcc-33c6-4299-8a14-018dce8ee011 => generated 1358 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 03:43:38.128522 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-26aac4e1-0116-42c3-a3ce-268386de4efb tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:43:38.129751 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-26aac4e1-0116-42c3-a3ce-268386de4efb tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] [instance: 9307fdad-ca63-449d-bc5c-7e9e167c59f3] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:43:38.137508 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-26aac4e1-0116-42c3-a3ce-268386de4efb tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:43:38.138028 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-26aac4e1-0116-42c3-a3ce-268386de4efb tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:43:38.138821 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-26aac4e1-0116-42c3-a3ce-268386de4efb tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:43:38.139438 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-26aac4e1-0116-42c3-a3ce-268386de4efb tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:43:38.276029 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-26aac4e1-0116-42c3-a3ce-268386de4efb tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dba436d0a67433f8c8ae7cd40d3f795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46b8dc64007429b805971d4c6f5b471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:43:38.284484 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-26aac4e1-0116-42c3-a3ce-268386de4efb tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] 10.222.0.66 "GET /compute/v2.1/servers/9307fdad-ca63-449d-bc5c-7e9e167c59f3" status: 200 len: 1707 microversion: 2.1 time: 0.159989 Aug 04 03:43:38.285041 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 265/528] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:43:38 2022] GET /compute/v2.1/servers/9307fdad-ca63-449d-bc5c-7e9e167c59f3 => generated 1707 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:43:38.788621 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-936bc368-0c0e-44c8-a6c0-73aca5a3288a tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:43:38.789183 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-936bc368-0c0e-44c8-a6c0-73aca5a3288a tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] [instance: eb7f2df0-7ac0-4253-a847-e0f797fa845c] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:43:38.791670 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG dbcounter [-] [130263] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=4 {{(pid=130263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:43:38.797164 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-936bc368-0c0e-44c8-a6c0-73aca5a3288a tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:43:38.797643 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-936bc368-0c0e-44c8-a6c0-73aca5a3288a tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:43:38.798417 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-936bc368-0c0e-44c8-a6c0-73aca5a3288a tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:43:38.798852 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-936bc368-0c0e-44c8-a6c0-73aca5a3288a tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:43:38.953682 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-936bc368-0c0e-44c8-a6c0-73aca5a3288a tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac48e585c133487dadbe0a1e095bfde0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32813adc26c64016b99c9c5fd838d391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:43:38.961586 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-936bc368-0c0e-44c8-a6c0-73aca5a3288a tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] 10.222.0.66 "GET /compute/v2.1/servers/eb7f2df0-7ac0-4253-a847-e0f797fa845c" status: 200 len: 1265 microversion: 2.1 time: 0.176874 Aug 04 03:43:38.964857 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 264/529] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:43:38 2022] GET /compute/v2.1/servers/eb7f2df0-7ac0-4253-a847-e0f797fa845c => generated 1265 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:43:39.016146 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-451ec087-9d57-4b52-84b7-05f7746a3f29 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:43:39.016814 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-451ec087-9d57-4b52-84b7-05f7746a3f29 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] [instance: bd510bcc-33c6-4299-8a14-018dce8ee011] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:43:39.019110 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG dbcounter [-] [130262] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=3 {{(pid=130262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:43:39.023756 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-451ec087-9d57-4b52-84b7-05f7746a3f29 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:43:39.024207 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-451ec087-9d57-4b52-84b7-05f7746a3f29 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:43:39.024972 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-451ec087-9d57-4b52-84b7-05f7746a3f29 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:43:39.025446 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-451ec087-9d57-4b52-84b7-05f7746a3f29 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:43:39.179601 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-451ec087-9d57-4b52-84b7-05f7746a3f29 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd245c731eb58483bb635a7e70542b892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2049d7705d5c4afe94c22a6f1284327b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:43:39.189055 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-451ec087-9d57-4b52-84b7-05f7746a3f29 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] 10.222.0.66 "GET /compute/v2.1/servers/bd510bcc-33c6-4299-8a14-018dce8ee011" status: 200 len: 1358 microversion: 2.1 time: 0.176956 Aug 04 03:43:39.195141 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 266/530] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:43:39 2022] GET /compute/v2.1/servers/bd510bcc-33c6-4299-8a14-018dce8ee011 => generated 1358 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:43:39.306064 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-63576b93-b9d4-4e0a-b819-589a4e98a65d tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:43:39.306624 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-63576b93-b9d4-4e0a-b819-589a4e98a65d tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] [instance: 9307fdad-ca63-449d-bc5c-7e9e167c59f3] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:43:39.313744 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-63576b93-b9d4-4e0a-b819-589a4e98a65d tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:43:39.314194 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-63576b93-b9d4-4e0a-b819-589a4e98a65d tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:43:39.315907 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-63576b93-b9d4-4e0a-b819-589a4e98a65d tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:43:39.315907 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-63576b93-b9d4-4e0a-b819-589a4e98a65d tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:43:39.379806 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [req-cabced3a-92e4-4754-a673-a32b8067ab9f req-70a37773-464b-4f0f-b3fc-da8bd2ca54c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb7f2df0-7ac0-4253-a847-e0f797fa845c", "tag": "6d1957ef-9b04-4f77-b14d-a55bdf6ca5b0"}]} {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 03:43:39.391185 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [req-cabced3a-92e4-4754-a673-a32b8067ab9f req-70a37773-464b-4f0f-b3fc-da8bd2ca54c0 service nova] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:43:39.391789 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [req-cabced3a-92e4-4754-a673-a32b8067ab9f req-70a37773-464b-4f0f-b3fc-da8bd2ca54c0 service nova] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:43:39.404185 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.compute.server_external_events [req-cabced3a-92e4-4754-a673-a32b8067ab9f req-70a37773-464b-4f0f-b3fc-da8bd2ca54c0 service nova] Creating event network-changed:6d1957ef-9b04-4f77-b14d-a55bdf6ca5b0 for instance eb7f2df0-7ac0-4253-a847-e0f797fa845c on hv-cinder-73306 Aug 04 03:43:39.409342 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [req-cabced3a-92e4-4754-a673-a32b8067ab9f req-70a37773-464b-4f0f-b3fc-da8bd2ca54c0 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033497 Aug 04 03:43:39.410413 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 267/531] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 03:43:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 03:43:39.465610 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-63576b93-b9d4-4e0a-b819-589a4e98a65d tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dba436d0a67433f8c8ae7cd40d3f795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46b8dc64007429b805971d4c6f5b471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:43:39.475875 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-63576b93-b9d4-4e0a-b819-589a4e98a65d tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] 10.222.0.66 "GET /compute/v2.1/servers/9307fdad-ca63-449d-bc5c-7e9e167c59f3" status: 200 len: 1711 microversion: 2.1 time: 0.173202 Aug 04 03:43:39.476679 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 265/532] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:43:39 2022] GET /compute/v2.1/servers/9307fdad-ca63-449d-bc5c-7e9e167c59f3 => generated 1711 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:43:39.986756 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-02a48c83-1736-4cf2-b6d0-626bcfdce5ba tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:43:39.987577 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-02a48c83-1736-4cf2-b6d0-626bcfdce5ba tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] [instance: eb7f2df0-7ac0-4253-a847-e0f797fa845c] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:43:39.993939 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-02a48c83-1736-4cf2-b6d0-626bcfdce5ba tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:43:39.994568 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-02a48c83-1736-4cf2-b6d0-626bcfdce5ba tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:43:39.995334 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-02a48c83-1736-4cf2-b6d0-626bcfdce5ba tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:43:39.996498 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-02a48c83-1736-4cf2-b6d0-626bcfdce5ba tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:43:40.138461 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-02a48c83-1736-4cf2-b6d0-626bcfdce5ba tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac48e585c133487dadbe0a1e095bfde0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32813adc26c64016b99c9c5fd838d391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:43:40.145978 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-02a48c83-1736-4cf2-b6d0-626bcfdce5ba tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] 10.222.0.66 "GET /compute/v2.1/servers/eb7f2df0-7ac0-4253-a847-e0f797fa845c" status: 200 len: 1265 microversion: 2.1 time: 0.165338 Aug 04 03:43:40.146550 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 268/533] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:43:39 2022] GET /compute/v2.1/servers/eb7f2df0-7ac0-4253-a847-e0f797fa845c => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:43:40.210537 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-fa48062c-deb3-403e-8f4a-5ee427a44921 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:43:40.211147 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-fa48062c-deb3-403e-8f4a-5ee427a44921 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] [instance: bd510bcc-33c6-4299-8a14-018dce8ee011] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:43:40.217319 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-fa48062c-deb3-403e-8f4a-5ee427a44921 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:43:40.217771 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-fa48062c-deb3-403e-8f4a-5ee427a44921 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:43:40.218530 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-fa48062c-deb3-403e-8f4a-5ee427a44921 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:43:40.218968 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-fa48062c-deb3-403e-8f4a-5ee427a44921 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:43:40.237989 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG dbcounter [-] [130263] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:43:40.349599 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-fa48062c-deb3-403e-8f4a-5ee427a44921 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd245c731eb58483bb635a7e70542b892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2049d7705d5c4afe94c22a6f1284327b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:43:40.357999 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-fa48062c-deb3-403e-8f4a-5ee427a44921 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] 10.222.0.66 "GET /compute/v2.1/servers/bd510bcc-33c6-4299-8a14-018dce8ee011" status: 200 len: 1358 microversion: 2.1 time: 0.151376 Aug 04 03:43:40.358871 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 266/534] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:43:40 2022] GET /compute/v2.1/servers/bd510bcc-33c6-4299-8a14-018dce8ee011 => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:43:41.166339 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-1dbc509b-07fd-467c-b874-692cadb06786 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:43:41.166852 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-1dbc509b-07fd-467c-b874-692cadb06786 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] [instance: eb7f2df0-7ac0-4253-a847-e0f797fa845c] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:43:41.174178 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-1dbc509b-07fd-467c-b874-692cadb06786 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:43:41.174500 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-1dbc509b-07fd-467c-b874-692cadb06786 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:43:41.175672 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-1dbc509b-07fd-467c-b874-692cadb06786 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:43:41.175672 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-1dbc509b-07fd-467c-b874-692cadb06786 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:43:41.264681 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [req-1a3566ca-e3e3-4378-bf48-1530d23af117 req-0a5a48b5-440c-4bdf-b5e0-1e22f4c56b7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd510bcc-33c6-4299-8a14-018dce8ee011", "name": "network-vif-plugged", "status": "completed", "tag": "c6499e78-e527-405f-ab7c-374a6cec81fb"}]} {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 03:43:41.280356 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [req-1a3566ca-e3e3-4378-bf48-1530d23af117 req-0a5a48b5-440c-4bdf-b5e0-1e22f4c56b7a service nova] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:43:41.281452 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [req-1a3566ca-e3e3-4378-bf48-1530d23af117 req-0a5a48b5-440c-4bdf-b5e0-1e22f4c56b7a service nova] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:43:41.295849 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.compute.server_external_events [req-1a3566ca-e3e3-4378-bf48-1530d23af117 req-0a5a48b5-440c-4bdf-b5e0-1e22f4c56b7a service nova] Creating event network-vif-plugged:c6499e78-e527-405f-ab7c-374a6cec81fb for instance bd510bcc-33c6-4299-8a14-018dce8ee011 on hv-cinder-73306 Aug 04 03:43:41.301524 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [req-1a3566ca-e3e3-4378-bf48-1530d23af117 req-0a5a48b5-440c-4bdf-b5e0-1e22f4c56b7a service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043734 Aug 04 03:43:41.302925 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 267/535] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 03:43:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 03:43:41.315231 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-1dbc509b-07fd-467c-b874-692cadb06786 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac48e585c133487dadbe0a1e095bfde0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32813adc26c64016b99c9c5fd838d391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:43:41.323562 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-1dbc509b-07fd-467c-b874-692cadb06786 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] 10.222.0.66 "GET /compute/v2.1/servers/eb7f2df0-7ac0-4253-a847-e0f797fa845c" status: 200 len: 1265 microversion: 2.1 time: 0.161063 Aug 04 03:43:41.324713 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 269/536] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:43:41 2022] GET /compute/v2.1/servers/eb7f2df0-7ac0-4253-a847-e0f797fa845c => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:43:41.380869 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-4a2c8574-3e2e-4aba-a5e8-7c508a444fb8 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:43:41.381693 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-4a2c8574-3e2e-4aba-a5e8-7c508a444fb8 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] [instance: bd510bcc-33c6-4299-8a14-018dce8ee011] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:43:41.389934 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-4a2c8574-3e2e-4aba-a5e8-7c508a444fb8 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:43:41.390545 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-4a2c8574-3e2e-4aba-a5e8-7c508a444fb8 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:43:41.391377 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-4a2c8574-3e2e-4aba-a5e8-7c508a444fb8 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:43:41.391902 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-4a2c8574-3e2e-4aba-a5e8-7c508a444fb8 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:43:41.525623 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-4a2c8574-3e2e-4aba-a5e8-7c508a444fb8 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd245c731eb58483bb635a7e70542b892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2049d7705d5c4afe94c22a6f1284327b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:43:41.533114 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-4a2c8574-3e2e-4aba-a5e8-7c508a444fb8 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] 10.222.0.66 "GET /compute/v2.1/servers/bd510bcc-33c6-4299-8a14-018dce8ee011" status: 200 len: 1358 microversion: 2.1 time: 0.156934 Aug 04 03:43:41.533705 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 268/537] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:43:41 2022] GET /compute/v2.1/servers/bd510bcc-33c6-4299-8a14-018dce8ee011 => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:43:42.345911 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-17c6d9fa-b6d1-44e6-8cf5-ad1566c8085b tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:43:42.346577 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-17c6d9fa-b6d1-44e6-8cf5-ad1566c8085b tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] [instance: eb7f2df0-7ac0-4253-a847-e0f797fa845c] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:43:42.358113 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-17c6d9fa-b6d1-44e6-8cf5-ad1566c8085b tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:43:42.358562 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-17c6d9fa-b6d1-44e6-8cf5-ad1566c8085b tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:43:42.359591 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-17c6d9fa-b6d1-44e6-8cf5-ad1566c8085b tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:43:42.360029 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-17c6d9fa-b6d1-44e6-8cf5-ad1566c8085b tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:43:42.557972 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-45821972-b493-4a3f-a586-4ac9e8fa4bc5 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:43:42.559078 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-45821972-b493-4a3f-a586-4ac9e8fa4bc5 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] [instance: bd510bcc-33c6-4299-8a14-018dce8ee011] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:43:42.568356 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-45821972-b493-4a3f-a586-4ac9e8fa4bc5 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:43:42.568808 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-45821972-b493-4a3f-a586-4ac9e8fa4bc5 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:43:42.569648 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-45821972-b493-4a3f-a586-4ac9e8fa4bc5 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:43:42.570093 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-45821972-b493-4a3f-a586-4ac9e8fa4bc5 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:43:42.821496 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-17c6d9fa-b6d1-44e6-8cf5-ad1566c8085b tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac48e585c133487dadbe0a1e095bfde0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32813adc26c64016b99c9c5fd838d391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:43:42.831753 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-17c6d9fa-b6d1-44e6-8cf5-ad1566c8085b tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] 10.222.0.66 "GET /compute/v2.1/servers/eb7f2df0-7ac0-4253-a847-e0f797fa845c" status: 200 len: 1265 microversion: 2.1 time: 0.489578 Aug 04 03:43:42.832352 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 270/538] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:43:42 2022] GET /compute/v2.1/servers/eb7f2df0-7ac0-4253-a847-e0f797fa845c => generated 1265 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:43:42.833581 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-45821972-b493-4a3f-a586-4ac9e8fa4bc5 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd245c731eb58483bb635a7e70542b892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2049d7705d5c4afe94c22a6f1284327b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:43:42.843988 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-45821972-b493-4a3f-a586-4ac9e8fa4bc5 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] 10.222.0.66 "GET /compute/v2.1/servers/bd510bcc-33c6-4299-8a14-018dce8ee011" status: 200 len: 1358 microversion: 2.1 time: 0.291522 Aug 04 03:43:42.844960 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 269/539] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:43:42 2022] GET /compute/v2.1/servers/bd510bcc-33c6-4299-8a14-018dce8ee011 => generated 1358 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:43:43.853318 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-aa39e26c-9b21-44ca-891a-bebf669d8455 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:43:43.853940 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-aa39e26c-9b21-44ca-891a-bebf669d8455 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] [instance: eb7f2df0-7ac0-4253-a847-e0f797fa845c] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:43:43.860746 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-aa39e26c-9b21-44ca-891a-bebf669d8455 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:43:43.861217 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-aa39e26c-9b21-44ca-891a-bebf669d8455 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:43:43.861990 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-aa39e26c-9b21-44ca-891a-bebf669d8455 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:43:43.862430 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-aa39e26c-9b21-44ca-891a-bebf669d8455 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:43:43.866861 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-388df921-cb16-483c-ae7e-20cefd555704 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:43:43.867456 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-388df921-cb16-483c-ae7e-20cefd555704 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] [instance: bd510bcc-33c6-4299-8a14-018dce8ee011] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:43:43.874617 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-388df921-cb16-483c-ae7e-20cefd555704 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:43:43.875073 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-388df921-cb16-483c-ae7e-20cefd555704 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:43:43.875846 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-388df921-cb16-483c-ae7e-20cefd555704 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:43:43.876285 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-388df921-cb16-483c-ae7e-20cefd555704 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:43:44.058007 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-aa39e26c-9b21-44ca-891a-bebf669d8455 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac48e585c133487dadbe0a1e095bfde0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32813adc26c64016b99c9c5fd838d391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:43:44.066218 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-aa39e26c-9b21-44ca-891a-bebf669d8455 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] 10.222.0.66 "GET /compute/v2.1/servers/eb7f2df0-7ac0-4253-a847-e0f797fa845c" status: 200 len: 1265 microversion: 2.1 time: 0.216730 Aug 04 03:43:44.066387 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-388df921-cb16-483c-ae7e-20cefd555704 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd245c731eb58483bb635a7e70542b892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2049d7705d5c4afe94c22a6f1284327b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:43:44.066985 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 271/540] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:43:43 2022] GET /compute/v2.1/servers/eb7f2df0-7ac0-4253-a847-e0f797fa845c => generated 1265 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:43:44.074531 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-388df921-cb16-483c-ae7e-20cefd555704 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] 10.222.0.66 "GET /compute/v2.1/servers/bd510bcc-33c6-4299-8a14-018dce8ee011" status: 200 len: 1547 microversion: 2.1 time: 0.210927 Aug 04 03:43:44.075092 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 270/541] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:43:43 2022] GET /compute/v2.1/servers/bd510bcc-33c6-4299-8a14-018dce8ee011 => generated 1547 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 03:43:44.094435 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-2e3831ed-1f5d-4030-ac7e-1697f9dc21a6 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:43:44.095043 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-2e3831ed-1f5d-4030-ac7e-1697f9dc21a6 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] [instance: bd510bcc-33c6-4299-8a14-018dce8ee011] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:43:44.100874 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-2e3831ed-1f5d-4030-ac7e-1697f9dc21a6 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:43:44.101366 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-2e3831ed-1f5d-4030-ac7e-1697f9dc21a6 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:43:44.102123 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-2e3831ed-1f5d-4030-ac7e-1697f9dc21a6 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:43:44.102556 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-2e3831ed-1f5d-4030-ac7e-1697f9dc21a6 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:43:44.234765 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-2e3831ed-1f5d-4030-ac7e-1697f9dc21a6 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd245c731eb58483bb635a7e70542b892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2049d7705d5c4afe94c22a6f1284327b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:43:44.242162 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-2e3831ed-1f5d-4030-ac7e-1697f9dc21a6 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] 10.222.0.66 "GET /compute/v2.1/servers/bd510bcc-33c6-4299-8a14-018dce8ee011" status: 200 len: 1547 microversion: 2.1 time: 0.151542 Aug 04 03:43:44.242713 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 272/542] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:43:44 2022] GET /compute/v2.1/servers/bd510bcc-33c6-4299-8a14-018dce8ee011 => generated 1547 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:43:44.262627 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-9f79cdac-02e1-4607-9181-d259de5f748a tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:43:44.267463 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-9f79cdac-02e1-4607-9181-d259de5f748a tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd245c731eb58483bb635a7e70542b892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2049d7705d5c4afe94c22a6f1284327b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:43:44.268221 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-9f79cdac-02e1-4607-9181-d259de5f748a tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Searching by: {'deleted': False, 'project_id': '2049d7705d5c4afe94c22a6f1284327b'} {{(pid=130263) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 04 03:43:44.274757 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-9f79cdac-02e1-4607-9181-d259de5f748a tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:43:44.275200 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-9f79cdac-02e1-4607-9181-d259de5f748a tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:43:44.275983 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-9f79cdac-02e1-4607-9181-d259de5f748a tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:43:44.276410 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-9f79cdac-02e1-4607-9181-d259de5f748a tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:43:44.364063 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.multi_cell_list [None req-9f79cdac-02e1-4607-9181-d259de5f748a tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=130263) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 04 03:43:44.458560 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-9f79cdac-02e1-4607-9181-d259de5f748a tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] 10.222.0.66 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.200099 Aug 04 03:43:44.459059 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 271/543] 10.222.0.66 () {58 vars in 1125 bytes} [Thu Aug 4 03:43:44 2022] GET /compute/v2.1/servers => generated 343 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 03:43:44.470164 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-6331b3a3-7e2e-41af-8281-5c1e5ec9d0cf tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:43:44.470770 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-6331b3a3-7e2e-41af-8281-5c1e5ec9d0cf tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] [instance: bd510bcc-33c6-4299-8a14-018dce8ee011] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:43:44.476738 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-6331b3a3-7e2e-41af-8281-5c1e5ec9d0cf tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:43:44.477182 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-6331b3a3-7e2e-41af-8281-5c1e5ec9d0cf tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:43:44.477976 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-6331b3a3-7e2e-41af-8281-5c1e5ec9d0cf tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:43:44.478412 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-6331b3a3-7e2e-41af-8281-5c1e5ec9d0cf tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:43:44.606534 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-6331b3a3-7e2e-41af-8281-5c1e5ec9d0cf tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd245c731eb58483bb635a7e70542b892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2049d7705d5c4afe94c22a6f1284327b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:43:44.614139 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-6331b3a3-7e2e-41af-8281-5c1e5ec9d0cf tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] 10.222.0.66 "GET /compute/v2.1/servers/bd510bcc-33c6-4299-8a14-018dce8ee011" status: 200 len: 1547 microversion: 2.1 time: 0.147772 Aug 04 03:43:44.614696 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 273/544] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:43:44 2022] GET /compute/v2.1/servers/bd510bcc-33c6-4299-8a14-018dce8ee011 => generated 1547 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:43:45.086980 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-b637f65a-14c0-45e7-b906-fafb09f00d22 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:43:45.087577 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-b637f65a-14c0-45e7-b906-fafb09f00d22 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] [instance: eb7f2df0-7ac0-4253-a847-e0f797fa845c] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:43:45.094185 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-b637f65a-14c0-45e7-b906-fafb09f00d22 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:43:45.099890 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-b637f65a-14c0-45e7-b906-fafb09f00d22 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:43:45.099890 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-b637f65a-14c0-45e7-b906-fafb09f00d22 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:43:45.099890 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-b637f65a-14c0-45e7-b906-fafb09f00d22 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:43:45.237270 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-b637f65a-14c0-45e7-b906-fafb09f00d22 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac48e585c133487dadbe0a1e095bfde0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32813adc26c64016b99c9c5fd838d391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:43:45.245056 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-b637f65a-14c0-45e7-b906-fafb09f00d22 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] 10.222.0.66 "GET /compute/v2.1/servers/eb7f2df0-7ac0-4253-a847-e0f797fa845c" status: 200 len: 1265 microversion: 2.1 time: 0.161865 Aug 04 03:43:45.245681 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 272/545] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:43:45 2022] GET /compute/v2.1/servers/eb7f2df0-7ac0-4253-a847-e0f797fa845c => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:43:46.266732 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-8012e74b-41fc-4399-945b-9eaeb417db7d tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:43:46.267349 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-8012e74b-41fc-4399-945b-9eaeb417db7d tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] [instance: eb7f2df0-7ac0-4253-a847-e0f797fa845c] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:43:46.273910 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-8012e74b-41fc-4399-945b-9eaeb417db7d tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:43:46.275028 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-8012e74b-41fc-4399-945b-9eaeb417db7d tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:43:46.275265 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-8012e74b-41fc-4399-945b-9eaeb417db7d tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:43:46.275614 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-8012e74b-41fc-4399-945b-9eaeb417db7d tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:43:46.408811 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-8012e74b-41fc-4399-945b-9eaeb417db7d tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac48e585c133487dadbe0a1e095bfde0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32813adc26c64016b99c9c5fd838d391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:43:46.416270 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-8012e74b-41fc-4399-945b-9eaeb417db7d tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] 10.222.0.66 "GET /compute/v2.1/servers/eb7f2df0-7ac0-4253-a847-e0f797fa845c" status: 200 len: 1265 microversion: 2.1 time: 0.154151 Aug 04 03:43:46.417359 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 274/546] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:43:46 2022] GET /compute/v2.1/servers/eb7f2df0-7ac0-4253-a847-e0f797fa845c => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 03:43:47.438313 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-c9dbfa75-19c6-43e0-b400-34a712b92983 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:43:47.438932 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-c9dbfa75-19c6-43e0-b400-34a712b92983 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] [instance: eb7f2df0-7ac0-4253-a847-e0f797fa845c] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:43:47.445577 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-c9dbfa75-19c6-43e0-b400-34a712b92983 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:43:47.446029 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-c9dbfa75-19c6-43e0-b400-34a712b92983 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:43:47.446787 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-c9dbfa75-19c6-43e0-b400-34a712b92983 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:43:47.447248 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-c9dbfa75-19c6-43e0-b400-34a712b92983 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:43:47.489691 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-20c22517-ed92-46e5-b2d8-b9bb0a9f2619 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "78b2ce5e-d82b-4b06-8d4d-a89912a5fcea"}} {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 03:43:47.492038 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-20c22517-ed92-46e5-b2d8-b9bb0a9f2619 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] [instance: bd510bcc-33c6-4299-8a14-018dce8ee011] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:43:47.499481 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-20c22517-ed92-46e5-b2d8-b9bb0a9f2619 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:43:47.499915 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-20c22517-ed92-46e5-b2d8-b9bb0a9f2619 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:43:47.500692 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-20c22517-ed92-46e5-b2d8-b9bb0a9f2619 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:43:47.501128 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-20c22517-ed92-46e5-b2d8-b9bb0a9f2619 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:43:47.591344 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-c9dbfa75-19c6-43e0-b400-34a712b92983 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac48e585c133487dadbe0a1e095bfde0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32813adc26c64016b99c9c5fd838d391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:43:47.598829 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-c9dbfa75-19c6-43e0-b400-34a712b92983 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] 10.222.0.66 "GET /compute/v2.1/servers/eb7f2df0-7ac0-4253-a847-e0f797fa845c" status: 200 len: 1265 microversion: 2.1 time: 0.164253 Aug 04 03:43:47.599389 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 273/547] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:43:47 2022] GET /compute/v2.1/servers/eb7f2df0-7ac0-4253-a847-e0f797fa845c => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:43:48.596574 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-20c22517-ed92-46e5-b2d8-b9bb0a9f2619 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] 10.222.0.66 "POST /compute/v2.1/servers/bd510bcc-33c6-4299-8a14-018dce8ee011/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.110562 Aug 04 03:43:48.597182 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 275/548] 10.222.0.66 () {60 vars in 1323 bytes} [Thu Aug 4 03:43:47 2022] POST /compute/v2.1/servers/bd510bcc-33c6-4299-8a14-018dce8ee011/os-volume_attachments => generated 194 bytes in 1112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 03:43:48.619841 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-203a32ef-b0df-4ff7-b6d7-5849166fa6b3 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:43:48.620608 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-203a32ef-b0df-4ff7-b6d7-5849166fa6b3 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] [instance: eb7f2df0-7ac0-4253-a847-e0f797fa845c] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:43:48.628139 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-203a32ef-b0df-4ff7-b6d7-5849166fa6b3 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:43:48.628589 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-203a32ef-b0df-4ff7-b6d7-5849166fa6b3 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:43:48.634699 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-203a32ef-b0df-4ff7-b6d7-5849166fa6b3 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:43:48.634699 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-203a32ef-b0df-4ff7-b6d7-5849166fa6b3 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:43:48.764448 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-203a32ef-b0df-4ff7-b6d7-5849166fa6b3 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac48e585c133487dadbe0a1e095bfde0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32813adc26c64016b99c9c5fd838d391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:43:48.772153 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-203a32ef-b0df-4ff7-b6d7-5849166fa6b3 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] 10.222.0.66 "GET /compute/v2.1/servers/eb7f2df0-7ac0-4253-a847-e0f797fa845c" status: 200 len: 1265 microversion: 2.1 time: 0.156142 Aug 04 03:43:48.772725 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 274/549] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:43:48 2022] GET /compute/v2.1/servers/eb7f2df0-7ac0-4253-a847-e0f797fa845c => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:43:49.793391 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-9849683f-200d-4277-afeb-35da7f8a295a tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:43:49.794069 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-9849683f-200d-4277-afeb-35da7f8a295a tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] [instance: eb7f2df0-7ac0-4253-a847-e0f797fa845c] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:43:49.800806 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-9849683f-200d-4277-afeb-35da7f8a295a tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:43:49.801282 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-9849683f-200d-4277-afeb-35da7f8a295a tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:43:49.802036 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-9849683f-200d-4277-afeb-35da7f8a295a tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:43:49.802468 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-9849683f-200d-4277-afeb-35da7f8a295a tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:43:49.937514 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-9849683f-200d-4277-afeb-35da7f8a295a tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac48e585c133487dadbe0a1e095bfde0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32813adc26c64016b99c9c5fd838d391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:43:49.945558 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-9849683f-200d-4277-afeb-35da7f8a295a tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] 10.222.0.66 "GET /compute/v2.1/servers/eb7f2df0-7ac0-4253-a847-e0f797fa845c" status: 200 len: 1265 microversion: 2.1 time: 0.156677 Aug 04 03:43:49.948795 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 276/550] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:43:49 2022] GET /compute/v2.1/servers/eb7f2df0-7ac0-4253-a847-e0f797fa845c => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:43:50.967639 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-d583d386-7c1f-41cf-8f48-64b4fe827511 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:43:50.968255 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-d583d386-7c1f-41cf-8f48-64b4fe827511 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] [instance: eb7f2df0-7ac0-4253-a847-e0f797fa845c] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:43:50.974952 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-d583d386-7c1f-41cf-8f48-64b4fe827511 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:43:50.975406 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-d583d386-7c1f-41cf-8f48-64b4fe827511 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:43:50.976170 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-d583d386-7c1f-41cf-8f48-64b4fe827511 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:43:50.976639 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-d583d386-7c1f-41cf-8f48-64b4fe827511 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:43:51.108609 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-d583d386-7c1f-41cf-8f48-64b4fe827511 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac48e585c133487dadbe0a1e095bfde0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32813adc26c64016b99c9c5fd838d391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:43:51.116295 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-d583d386-7c1f-41cf-8f48-64b4fe827511 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] 10.222.0.66 "GET /compute/v2.1/servers/eb7f2df0-7ac0-4253-a847-e0f797fa845c" status: 200 len: 1265 microversion: 2.1 time: 0.153310 Aug 04 03:43:51.116878 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 275/551] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:43:50 2022] GET /compute/v2.1/servers/eb7f2df0-7ac0-4253-a847-e0f797fa845c => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:43:51.441329 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [req-31e256f4-67a9-4884-a562-3dd8dd9ff078 req-ca1a4ddb-0eec-4081-b1fb-c208bac2fd2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb7f2df0-7ac0-4253-a847-e0f797fa845c", "name": "network-vif-plugged", "status": "completed", "tag": "6d1957ef-9b04-4f77-b14d-a55bdf6ca5b0"}]} {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 03:43:51.451894 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [req-31e256f4-67a9-4884-a562-3dd8dd9ff078 req-ca1a4ddb-0eec-4081-b1fb-c208bac2fd2a service nova] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:43:51.452347 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [req-31e256f4-67a9-4884-a562-3dd8dd9ff078 req-ca1a4ddb-0eec-4081-b1fb-c208bac2fd2a service nova] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:43:51.463041 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.compute.server_external_events [req-31e256f4-67a9-4884-a562-3dd8dd9ff078 req-ca1a4ddb-0eec-4081-b1fb-c208bac2fd2a service nova] Creating event network-vif-plugged:6d1957ef-9b04-4f77-b14d-a55bdf6ca5b0 for instance eb7f2df0-7ac0-4253-a847-e0f797fa845c on hv-cinder-73306 Aug 04 03:43:51.468363 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [req-31e256f4-67a9-4884-a562-3dd8dd9ff078 req-ca1a4ddb-0eec-4081-b1fb-c208bac2fd2a service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030870 Aug 04 03:43:51.469119 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 277/552] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 03:43:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 03:43:52.137572 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-f3732965-f6f3-4095-9ad8-201b433c2045 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:43:52.138304 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-f3732965-f6f3-4095-9ad8-201b433c2045 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] [instance: eb7f2df0-7ac0-4253-a847-e0f797fa845c] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:43:52.144630 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-f3732965-f6f3-4095-9ad8-201b433c2045 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:43:52.145082 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-f3732965-f6f3-4095-9ad8-201b433c2045 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:43:52.145877 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-f3732965-f6f3-4095-9ad8-201b433c2045 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:43:52.146314 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-f3732965-f6f3-4095-9ad8-201b433c2045 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:43:52.275076 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-f3732965-f6f3-4095-9ad8-201b433c2045 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac48e585c133487dadbe0a1e095bfde0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32813adc26c64016b99c9c5fd838d391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:43:52.282648 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-f3732965-f6f3-4095-9ad8-201b433c2045 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] 10.222.0.66 "GET /compute/v2.1/servers/eb7f2df0-7ac0-4253-a847-e0f797fa845c" status: 200 len: 1265 microversion: 2.1 time: 0.149549 Aug 04 03:43:52.283210 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 276/553] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:43:52 2022] GET /compute/v2.1/servers/eb7f2df0-7ac0-4253-a847-e0f797fa845c => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:43:53.304880 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-125bad9b-5a73-4c62-8c8a-0b47c2a1fbb3 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:43:53.305622 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-125bad9b-5a73-4c62-8c8a-0b47c2a1fbb3 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] [instance: eb7f2df0-7ac0-4253-a847-e0f797fa845c] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:43:53.312918 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-125bad9b-5a73-4c62-8c8a-0b47c2a1fbb3 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:43:53.313389 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-125bad9b-5a73-4c62-8c8a-0b47c2a1fbb3 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:43:53.314142 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-125bad9b-5a73-4c62-8c8a-0b47c2a1fbb3 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:43:53.314574 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-125bad9b-5a73-4c62-8c8a-0b47c2a1fbb3 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:43:53.447436 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-125bad9b-5a73-4c62-8c8a-0b47c2a1fbb3 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac48e585c133487dadbe0a1e095bfde0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32813adc26c64016b99c9c5fd838d391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:43:53.454823 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-125bad9b-5a73-4c62-8c8a-0b47c2a1fbb3 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] 10.222.0.66 "GET /compute/v2.1/servers/eb7f2df0-7ac0-4253-a847-e0f797fa845c" status: 200 len: 1265 microversion: 2.1 time: 0.154631 Aug 04 03:43:53.455383 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 278/554] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:43:53 2022] GET /compute/v2.1/servers/eb7f2df0-7ac0-4253-a847-e0f797fa845c => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:43:54.475834 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-41b5580e-b1ce-401c-8e82-994cc5d27301 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:43:54.476363 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-41b5580e-b1ce-401c-8e82-994cc5d27301 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] [instance: eb7f2df0-7ac0-4253-a847-e0f797fa845c] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:43:54.478848 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG dbcounter [-] [130263] Writing DB stats nova_cell0:SELECT=2 {{(pid=130263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:43:54.484580 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-41b5580e-b1ce-401c-8e82-994cc5d27301 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:43:54.485051 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-41b5580e-b1ce-401c-8e82-994cc5d27301 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:43:54.485844 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-41b5580e-b1ce-401c-8e82-994cc5d27301 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:43:54.486277 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-41b5580e-b1ce-401c-8e82-994cc5d27301 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:43:54.619972 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-41b5580e-b1ce-401c-8e82-994cc5d27301 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac48e585c133487dadbe0a1e095bfde0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32813adc26c64016b99c9c5fd838d391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:43:54.627543 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-41b5580e-b1ce-401c-8e82-994cc5d27301 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] 10.222.0.66 "GET /compute/v2.1/servers/eb7f2df0-7ac0-4253-a847-e0f797fa845c" status: 200 len: 1451 microversion: 2.1 time: 0.155632 Aug 04 03:43:54.628105 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 277/555] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:43:54 2022] GET /compute/v2.1/servers/eb7f2df0-7ac0-4253-a847-e0f797fa845c => generated 1451 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:43:54.648212 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-1e73c335-3f61-48be-a4ea-ff497e158331 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:43:54.648818 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-1e73c335-3f61-48be-a4ea-ff497e158331 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] [instance: eb7f2df0-7ac0-4253-a847-e0f797fa845c] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:43:54.656043 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-1e73c335-3f61-48be-a4ea-ff497e158331 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:43:54.656483 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-1e73c335-3f61-48be-a4ea-ff497e158331 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:43:54.657251 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-1e73c335-3f61-48be-a4ea-ff497e158331 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:43:54.657686 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-1e73c335-3f61-48be-a4ea-ff497e158331 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:43:54.790958 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-1e73c335-3f61-48be-a4ea-ff497e158331 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac48e585c133487dadbe0a1e095bfde0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32813adc26c64016b99c9c5fd838d391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:43:54.798502 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-1e73c335-3f61-48be-a4ea-ff497e158331 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] 10.222.0.66 "GET /compute/v2.1/servers/eb7f2df0-7ac0-4253-a847-e0f797fa845c" status: 200 len: 1451 microversion: 2.1 time: 0.154107 Aug 04 03:43:54.799057 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 279/556] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:43:54 2022] GET /compute/v2.1/servers/eb7f2df0-7ac0-4253-a847-e0f797fa845c => generated 1451 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:43:57.128162 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [req-6dad6a62-279e-4dc8-a667-999a403aff5f req-89aef44f-faf2-48d3-8414-be6536a2aa41 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb7f2df0-7ac0-4253-a847-e0f797fa845c", "tag": "6d1957ef-9b04-4f77-b14d-a55bdf6ca5b0"}]} {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 03:43:57.143169 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [req-6dad6a62-279e-4dc8-a667-999a403aff5f req-89aef44f-faf2-48d3-8414-be6536a2aa41 service nova] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:43:57.143169 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [req-6dad6a62-279e-4dc8-a667-999a403aff5f req-89aef44f-faf2-48d3-8414-be6536a2aa41 service nova] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:43:57.151700 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.compute.server_external_events [req-6dad6a62-279e-4dc8-a667-999a403aff5f req-89aef44f-faf2-48d3-8414-be6536a2aa41 service nova] Creating event network-changed:6d1957ef-9b04-4f77-b14d-a55bdf6ca5b0 for instance eb7f2df0-7ac0-4253-a847-e0f797fa845c on hv-cinder-73306 Aug 04 03:43:57.158124 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [req-6dad6a62-279e-4dc8-a667-999a403aff5f req-89aef44f-faf2-48d3-8414-be6536a2aa41 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040047 Aug 04 03:43:57.158731 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 278/557] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 03:43:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 03:43:57.263887 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-b4f7d0a6-fc0f-488f-8be0-cb27b2f5a9dc tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:43:57.264503 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-b4f7d0a6-fc0f-488f-8be0-cb27b2f5a9dc tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] [instance: bd510bcc-33c6-4299-8a14-018dce8ee011] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:43:57.270939 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-b4f7d0a6-fc0f-488f-8be0-cb27b2f5a9dc tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:43:57.271590 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-b4f7d0a6-fc0f-488f-8be0-cb27b2f5a9dc tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:43:57.272365 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-b4f7d0a6-fc0f-488f-8be0-cb27b2f5a9dc tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:43:57.272965 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-b4f7d0a6-fc0f-488f-8be0-cb27b2f5a9dc tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:43:57.420229 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-b4f7d0a6-fc0f-488f-8be0-cb27b2f5a9dc tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd245c731eb58483bb635a7e70542b892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2049d7705d5c4afe94c22a6f1284327b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:43:57.428950 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-b4f7d0a6-fc0f-488f-8be0-cb27b2f5a9dc tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] 10.222.0.66 "GET /compute/v2.1/servers/bd510bcc-33c6-4299-8a14-018dce8ee011" status: 200 len: 1593 microversion: 2.1 time: 0.169308 Aug 04 03:43:57.441225 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 280/558] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:43:57 2022] GET /compute/v2.1/servers/bd510bcc-33c6-4299-8a14-018dce8ee011 => generated 1593 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:43:59.443774 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [req-bb8246f7-db34-4df4-b660-f3fe08578ebf req-6de43088-6885-4761-b0ae-d4f62a7d6661 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd510bcc-33c6-4299-8a14-018dce8ee011", "tag": "c6499e78-e527-405f-ab7c-374a6cec81fb"}]} {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 03:43:59.455125 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [req-bb8246f7-db34-4df4-b660-f3fe08578ebf req-6de43088-6885-4761-b0ae-d4f62a7d6661 service nova] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:43:59.455559 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [req-bb8246f7-db34-4df4-b660-f3fe08578ebf req-6de43088-6885-4761-b0ae-d4f62a7d6661 service nova] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:43:59.467337 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.compute.server_external_events [req-bb8246f7-db34-4df4-b660-f3fe08578ebf req-6de43088-6885-4761-b0ae-d4f62a7d6661 service nova] Creating event network-changed:c6499e78-e527-405f-ab7c-374a6cec81fb for instance bd510bcc-33c6-4299-8a14-018dce8ee011 on hv-cinder-73306 Aug 04 03:43:59.472135 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [req-bb8246f7-db34-4df4-b660-f3fe08578ebf req-6de43088-6885-4761-b0ae-d4f62a7d6661 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032419 Aug 04 03:43:59.472720 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 279/559] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 03:43:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 03:44:02.041967 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-b482ca6d-eb7e-4569-9c98-6fcc9e33e0dd tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-57974030"}} {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 03:44:02.043342 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-b482ca6d-eb7e-4569-9c98-6fcc9e33e0dd tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] [instance: bd510bcc-33c6-4299-8a14-018dce8ee011] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:44:02.049566 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-b482ca6d-eb7e-4569-9c98-6fcc9e33e0dd tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:44:02.050019 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-b482ca6d-eb7e-4569-9c98-6fcc9e33e0dd tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:44:02.050825 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-b482ca6d-eb7e-4569-9c98-6fcc9e33e0dd tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:44:02.051261 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-b482ca6d-eb7e-4569-9c98-6fcc9e33e0dd tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:44:02.068523 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG dbcounter [-] [130262] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=130262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:44:02.181931 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.network.security_group_api [None req-b482ca6d-eb7e-4569-9c98-6fcc9e33e0dd tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Adding security group f37aa3b3-db55-4759-8933-608dbe65d3dc to port c6499e78-e527-405f-ab7c-374a6cec81fb Aug 04 03:44:02.613590 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-b482ca6d-eb7e-4569-9c98-6fcc9e33e0dd tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] 10.222.0.66 "POST /compute/v2.1/servers/bd510bcc-33c6-4299-8a14-018dce8ee011/action" status: 202 len: 0 microversion: 2.1 time: 0.575441 Aug 04 03:44:02.618539 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 281/560] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 03:44:02 2022] POST /compute/v2.1/servers/bd510bcc-33c6-4299-8a14-018dce8ee011/action => generated 0 bytes in 577 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 03:44:02.623413 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [req-cbaf68af-bc32-43e4-b74a-2210a21de597 req-dc52b773-bc75-4850-a1f5-363de0686a09 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd510bcc-33c6-4299-8a14-018dce8ee011", "tag": "c6499e78-e527-405f-ab7c-374a6cec81fb"}]} {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 03:44:02.633963 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-5081d761-e627-4430-ac67-2d3b4c02fc6a tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:44:02.634579 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-5081d761-e627-4430-ac67-2d3b4c02fc6a tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] [instance: bd510bcc-33c6-4299-8a14-018dce8ee011] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:44:02.638751 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [req-cbaf68af-bc32-43e4-b74a-2210a21de597 req-dc52b773-bc75-4850-a1f5-363de0686a09 service nova] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:44:02.640318 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [req-cbaf68af-bc32-43e4-b74a-2210a21de597 req-dc52b773-bc75-4850-a1f5-363de0686a09 service nova] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:44:02.642275 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-5081d761-e627-4430-ac67-2d3b4c02fc6a tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:44:02.643122 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-5081d761-e627-4430-ac67-2d3b4c02fc6a tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:44:02.643508 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-5081d761-e627-4430-ac67-2d3b4c02fc6a tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:44:02.643949 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-5081d761-e627-4430-ac67-2d3b4c02fc6a tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:44:02.659860 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.compute.server_external_events [req-cbaf68af-bc32-43e4-b74a-2210a21de597 req-dc52b773-bc75-4850-a1f5-363de0686a09 service nova] Creating event network-changed:c6499e78-e527-405f-ab7c-374a6cec81fb for instance bd510bcc-33c6-4299-8a14-018dce8ee011 on hv-cinder-73306 Aug 04 03:44:02.665622 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [req-cbaf68af-bc32-43e4-b74a-2210a21de597 req-dc52b773-bc75-4850-a1f5-363de0686a09 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047597 Aug 04 03:44:02.666811 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 280/561] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 03:44:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 03:44:02.809723 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-5081d761-e627-4430-ac67-2d3b4c02fc6a tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd245c731eb58483bb635a7e70542b892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2049d7705d5c4afe94c22a6f1284327b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:44:02.818698 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-5081d761-e627-4430-ac67-2d3b4c02fc6a tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] 10.222.0.66 "GET /compute/v2.1/servers/bd510bcc-33c6-4299-8a14-018dce8ee011" status: 200 len: 1757 microversion: 2.1 time: 0.188442 Aug 04 03:44:02.819483 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 282/562] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:44:02 2022] GET /compute/v2.1/servers/bd510bcc-33c6-4299-8a14-018dce8ee011 => generated 1757 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:44:19.235170 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG dbcounter [-] [130263] Writing DB stats nova_api:SELECT=33 {{(pid=130263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:44:19.235928 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG dbcounter [-] [130263] Writing DB stats nova_cell1:SELECT=72 {{(pid=130263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:44:19.239980 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-6e047789-d176-45a2-919d-9a09b8c03a8c tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:44:19.240554 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-6e047789-d176-45a2-919d-9a09b8c03a8c tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] [instance: 3bf41d49-2b84-4f59-a019-a8b1e45891d1] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:44:19.246598 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-6e047789-d176-45a2-919d-9a09b8c03a8c tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:44:19.257062 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-6e047789-d176-45a2-919d-9a09b8c03a8c tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:44:19.257062 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-6e047789-d176-45a2-919d-9a09b8c03a8c tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:44:19.257062 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-6e047789-d176-45a2-919d-9a09b8c03a8c tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:44:19.271176 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-6e047789-d176-45a2-919d-9a09b8c03a8c tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] 10.222.0.66 "GET /compute/v2.1/servers/3bf41d49-2b84-4f59-a019-a8b1e45891d1/ips" status: 200 len: 151 microversion: 2.20 time: 0.037848 Aug 04 03:44:19.271725 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 281/563] 10.222.0.66 () {60 vars in 1289 bytes} [Thu Aug 4 03:44:19 2022] GET /compute/v2.1/servers/3bf41d49-2b84-4f59-a019-a8b1e45891d1/ips => generated 151 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 03:44:22.466593 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG dbcounter [-] [130262] Writing DB stats nova_api:SELECT=33 {{(pid=130262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:44:22.469395 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG dbcounter [-] [130262] Writing DB stats nova_cell1:SELECT=6 {{(pid=130262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:44:22.612297 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-fbb294a7-8631-45c3-86ca-9161040ac8da tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 03:44:22.618596 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-fbb294a7-8631-45c3-86ca-9161040ac8da tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] [instance: 3bf41d49-2b84-4f59-a019-a8b1e45891d1] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:44:22.622165 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-fbb294a7-8631-45c3-86ca-9161040ac8da tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:44:22.622872 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-fbb294a7-8631-45c3-86ca-9161040ac8da tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:44:22.624481 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-fbb294a7-8631-45c3-86ca-9161040ac8da tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:44:22.624925 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-fbb294a7-8631-45c3-86ca-9161040ac8da tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:44:22.637808 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-f7c3129a-530c-4507-97f7-ae255ab24d14 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b94cd936-978d-4beb-a0db-308b6c06ce5d"}} {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 03:44:22.640845 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-f7c3129a-530c-4507-97f7-ae255ab24d14 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] [instance: f69fd00d-cf45-4c17-aee5-701e87ebab82] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:44:22.646976 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-f7c3129a-530c-4507-97f7-ae255ab24d14 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:44:22.647519 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-f7c3129a-530c-4507-97f7-ae255ab24d14 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:44:22.648324 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-f7c3129a-530c-4507-97f7-ae255ab24d14 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:44:22.648630 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.objects.instance [None req-fbb294a7-8631-45c3-86ca-9161040ac8da tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lazy-loading 'flavor' on Instance uuid 3bf41d49-2b84-4f59-a019-a8b1e45891d1 {{(pid=130263) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 03:44:22.648761 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-f7c3129a-530c-4507-97f7-ae255ab24d14 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:44:23.238491 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-fbb294a7-8631-45c3-86ca-9161040ac8da tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] 10.222.0.66 "POST /compute/v2.1/servers/3bf41d49-2b84-4f59-a019-a8b1e45891d1/action" status: 202 len: 0 microversion: 2.20 time: 0.630957 Aug 04 03:44:23.239072 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 282/564] 10.222.0.66 () {62 vars in 1319 bytes} [Thu Aug 4 03:44:22 2022] POST /compute/v2.1/servers/3bf41d49-2b84-4f59-a019-a8b1e45891d1/action => generated 0 bytes in 632 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 04 03:44:23.248732 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-3edf9be6-6ac6-40eb-b85c-f1313b6c04f1 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:44:23.250277 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-3edf9be6-6ac6-40eb-b85c-f1313b6c04f1 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] [instance: 3bf41d49-2b84-4f59-a019-a8b1e45891d1] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:44:23.258112 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-3edf9be6-6ac6-40eb-b85c-f1313b6c04f1 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:44:23.258560 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-3edf9be6-6ac6-40eb-b85c-f1313b6c04f1 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:44:23.259372 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-3edf9be6-6ac6-40eb-b85c-f1313b6c04f1 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:44:23.259747 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-3edf9be6-6ac6-40eb-b85c-f1313b6c04f1 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:44:23.396707 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-3edf9be6-6ac6-40eb-b85c-f1313b6c04f1 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:44:23.405240 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-3edf9be6-6ac6-40eb-b85c-f1313b6c04f1 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:44:23.406763 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-3edf9be6-6ac6-40eb-b85c-f1313b6c04f1 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:44:23.407917 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-3edf9be6-6ac6-40eb-b85c-f1313b6c04f1 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] 10.222.0.66 "GET /compute/v2.1/servers/3bf41d49-2b84-4f59-a019-a8b1e45891d1" status: 200 len: 1723 microversion: 2.20 time: 0.164047 Aug 04 03:44:23.408471 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 283/565] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 03:44:23 2022] GET /compute/v2.1/servers/3bf41d49-2b84-4f59-a019-a8b1e45891d1 => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 03:44:23.521425 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-f7c3129a-530c-4507-97f7-ae255ab24d14 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] 10.222.0.66 "POST /compute/v2.1/servers/f69fd00d-cf45-4c17-aee5-701e87ebab82/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.060226 Aug 04 03:44:23.522008 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 283/566] 10.222.0.66 () {60 vars in 1323 bytes} [Thu Aug 4 03:44:22 2022] POST /compute/v2.1/servers/f69fd00d-cf45-4c17-aee5-701e87ebab82/os-volume_attachments => generated 194 bytes in 1062 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 03:44:24.432006 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-5bab7263-04e1-4c08-90c7-1278d1dde0d2 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:44:24.432530 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-5bab7263-04e1-4c08-90c7-1278d1dde0d2 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] [instance: 3bf41d49-2b84-4f59-a019-a8b1e45891d1] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:44:24.439441 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-5bab7263-04e1-4c08-90c7-1278d1dde0d2 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:44:24.439895 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-5bab7263-04e1-4c08-90c7-1278d1dde0d2 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:44:24.440738 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-5bab7263-04e1-4c08-90c7-1278d1dde0d2 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:44:24.441222 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-5bab7263-04e1-4c08-90c7-1278d1dde0d2 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:44:24.575122 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-5bab7263-04e1-4c08-90c7-1278d1dde0d2 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:44:24.583935 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-5bab7263-04e1-4c08-90c7-1278d1dde0d2 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:44:24.585479 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-5bab7263-04e1-4c08-90c7-1278d1dde0d2 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:44:24.586641 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-5bab7263-04e1-4c08-90c7-1278d1dde0d2 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] 10.222.0.66 "GET /compute/v2.1/servers/3bf41d49-2b84-4f59-a019-a8b1e45891d1" status: 200 len: 1723 microversion: 2.20 time: 0.158696 Aug 04 03:44:24.587198 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 284/567] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 03:44:24 2022] GET /compute/v2.1/servers/3bf41d49-2b84-4f59-a019-a8b1e45891d1 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 03:44:25.612113 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-79135da9-01d4-4bda-a1ca-ab0e92a45575 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:44:25.612805 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-79135da9-01d4-4bda-a1ca-ab0e92a45575 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] [instance: 3bf41d49-2b84-4f59-a019-a8b1e45891d1] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:44:25.619058 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-79135da9-01d4-4bda-a1ca-ab0e92a45575 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:44:25.619502 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-79135da9-01d4-4bda-a1ca-ab0e92a45575 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:44:25.620257 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-79135da9-01d4-4bda-a1ca-ab0e92a45575 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:44:25.620688 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-79135da9-01d4-4bda-a1ca-ab0e92a45575 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:44:25.751546 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-79135da9-01d4-4bda-a1ca-ab0e92a45575 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:44:25.759381 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-79135da9-01d4-4bda-a1ca-ab0e92a45575 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:44:25.760905 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-79135da9-01d4-4bda-a1ca-ab0e92a45575 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:44:25.762079 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-79135da9-01d4-4bda-a1ca-ab0e92a45575 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] 10.222.0.66 "GET /compute/v2.1/servers/3bf41d49-2b84-4f59-a019-a8b1e45891d1" status: 200 len: 1723 microversion: 2.20 time: 0.155583 Aug 04 03:44:25.762628 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 284/568] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 03:44:25 2022] GET /compute/v2.1/servers/3bf41d49-2b84-4f59-a019-a8b1e45891d1 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 03:44:26.785851 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-490702f4-33cb-4890-8e5f-5a90f1800194 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:44:26.786479 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-490702f4-33cb-4890-8e5f-5a90f1800194 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] [instance: 3bf41d49-2b84-4f59-a019-a8b1e45891d1] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:44:26.792834 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-490702f4-33cb-4890-8e5f-5a90f1800194 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:44:26.793311 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-490702f4-33cb-4890-8e5f-5a90f1800194 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:44:26.794062 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-490702f4-33cb-4890-8e5f-5a90f1800194 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:44:26.794492 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-490702f4-33cb-4890-8e5f-5a90f1800194 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:44:26.923178 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-490702f4-33cb-4890-8e5f-5a90f1800194 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:44:26.930949 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-490702f4-33cb-4890-8e5f-5a90f1800194 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:44:26.932438 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-490702f4-33cb-4890-8e5f-5a90f1800194 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:44:26.933601 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-490702f4-33cb-4890-8e5f-5a90f1800194 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] 10.222.0.66 "GET /compute/v2.1/servers/3bf41d49-2b84-4f59-a019-a8b1e45891d1" status: 200 len: 1723 microversion: 2.20 time: 0.151575 Aug 04 03:44:26.934148 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 285/569] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 03:44:26 2022] GET /compute/v2.1/servers/3bf41d49-2b84-4f59-a019-a8b1e45891d1 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 03:44:27.957177 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-680667bf-20b6-4d49-b8a4-d57daf7367f2 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:44:27.957842 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-680667bf-20b6-4d49-b8a4-d57daf7367f2 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] [instance: 3bf41d49-2b84-4f59-a019-a8b1e45891d1] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:44:27.964505 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-680667bf-20b6-4d49-b8a4-d57daf7367f2 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:44:27.964953 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-680667bf-20b6-4d49-b8a4-d57daf7367f2 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:44:27.965828 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-680667bf-20b6-4d49-b8a4-d57daf7367f2 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:44:27.966264 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-680667bf-20b6-4d49-b8a4-d57daf7367f2 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:44:28.305384 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-680667bf-20b6-4d49-b8a4-d57daf7367f2 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:44:28.313655 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-680667bf-20b6-4d49-b8a4-d57daf7367f2 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:44:28.315172 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-680667bf-20b6-4d49-b8a4-d57daf7367f2 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:44:28.316348 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-680667bf-20b6-4d49-b8a4-d57daf7367f2 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] 10.222.0.66 "GET /compute/v2.1/servers/3bf41d49-2b84-4f59-a019-a8b1e45891d1" status: 200 len: 1723 microversion: 2.20 time: 0.363125 Aug 04 03:44:28.316907 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 285/570] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 03:44:27 2022] GET /compute/v2.1/servers/3bf41d49-2b84-4f59-a019-a8b1e45891d1 => generated 1723 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 03:44:29.339836 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-a83d5a73-b847-462f-a542-f1681f6ff4e9 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:44:29.340472 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-a83d5a73-b847-462f-a542-f1681f6ff4e9 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] [instance: 3bf41d49-2b84-4f59-a019-a8b1e45891d1] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:44:29.347564 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-a83d5a73-b847-462f-a542-f1681f6ff4e9 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:44:29.348024 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-a83d5a73-b847-462f-a542-f1681f6ff4e9 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:44:29.348770 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-a83d5a73-b847-462f-a542-f1681f6ff4e9 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:44:29.349263 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-a83d5a73-b847-462f-a542-f1681f6ff4e9 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:44:29.477091 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-a83d5a73-b847-462f-a542-f1681f6ff4e9 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:44:29.485853 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-a83d5a73-b847-462f-a542-f1681f6ff4e9 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:44:29.487361 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-a83d5a73-b847-462f-a542-f1681f6ff4e9 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:44:29.488507 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-a83d5a73-b847-462f-a542-f1681f6ff4e9 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] 10.222.0.66 "GET /compute/v2.1/servers/3bf41d49-2b84-4f59-a019-a8b1e45891d1" status: 200 len: 1723 microversion: 2.20 time: 0.152691 Aug 04 03:44:29.489056 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 286/571] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 03:44:29 2022] GET /compute/v2.1/servers/3bf41d49-2b84-4f59-a019-a8b1e45891d1 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 03:44:30.511751 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-cd6ebae6-ebd4-4329-8fe6-9fe896db95c4 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:44:30.512300 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-cd6ebae6-ebd4-4329-8fe6-9fe896db95c4 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] [instance: 3bf41d49-2b84-4f59-a019-a8b1e45891d1] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:44:30.518919 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-cd6ebae6-ebd4-4329-8fe6-9fe896db95c4 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:44:30.519369 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-cd6ebae6-ebd4-4329-8fe6-9fe896db95c4 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:44:30.520130 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-cd6ebae6-ebd4-4329-8fe6-9fe896db95c4 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:44:30.520570 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-cd6ebae6-ebd4-4329-8fe6-9fe896db95c4 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:44:30.653011 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-cd6ebae6-ebd4-4329-8fe6-9fe896db95c4 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:44:30.662035 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-cd6ebae6-ebd4-4329-8fe6-9fe896db95c4 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:44:30.663649 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-cd6ebae6-ebd4-4329-8fe6-9fe896db95c4 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:44:30.664814 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-cd6ebae6-ebd4-4329-8fe6-9fe896db95c4 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] 10.222.0.66 "GET /compute/v2.1/servers/3bf41d49-2b84-4f59-a019-a8b1e45891d1" status: 200 len: 1723 microversion: 2.20 time: 0.157358 Aug 04 03:44:30.665398 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 286/572] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 03:44:30 2022] GET /compute/v2.1/servers/3bf41d49-2b84-4f59-a019-a8b1e45891d1 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 03:44:31.687518 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-bd929729-e63c-465b-a86c-ba105c6ae6fb tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:44:31.688110 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-bd929729-e63c-465b-a86c-ba105c6ae6fb tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] [instance: 3bf41d49-2b84-4f59-a019-a8b1e45891d1] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:44:31.694636 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-bd929729-e63c-465b-a86c-ba105c6ae6fb tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:44:31.695092 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-bd929729-e63c-465b-a86c-ba105c6ae6fb tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:44:31.695854 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-bd929729-e63c-465b-a86c-ba105c6ae6fb tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:44:31.696325 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-bd929729-e63c-465b-a86c-ba105c6ae6fb tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:44:31.822303 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-bd929729-e63c-465b-a86c-ba105c6ae6fb tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:44:31.830814 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-bd929729-e63c-465b-a86c-ba105c6ae6fb tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:44:31.832353 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-bd929729-e63c-465b-a86c-ba105c6ae6fb tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:44:31.833562 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-bd929729-e63c-465b-a86c-ba105c6ae6fb tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] 10.222.0.66 "GET /compute/v2.1/servers/3bf41d49-2b84-4f59-a019-a8b1e45891d1" status: 200 len: 1723 microversion: 2.20 time: 0.150487 Aug 04 03:44:31.834106 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 287/573] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 03:44:31 2022] GET /compute/v2.1/servers/3bf41d49-2b84-4f59-a019-a8b1e45891d1 => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 03:44:32.104841 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-476c09ca-eb10-47a4-be22-165c90c30127 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 03:44:32.107721 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-476c09ca-eb10-47a4-be22-165c90c30127 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] [instance: f69fd00d-cf45-4c17-aee5-701e87ebab82] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:44:32.114491 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-476c09ca-eb10-47a4-be22-165c90c30127 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:44:32.114975 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-476c09ca-eb10-47a4-be22-165c90c30127 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:44:32.115742 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-476c09ca-eb10-47a4-be22-165c90c30127 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:44:32.116181 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-476c09ca-eb10-47a4-be22-165c90c30127 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:44:32.141635 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.objects.instance [None req-476c09ca-eb10-47a4-be22-165c90c30127 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lazy-loading 'flavor' on Instance uuid f69fd00d-cf45-4c17-aee5-701e87ebab82 {{(pid=130262) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 03:44:32.452676 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-476c09ca-eb10-47a4-be22-165c90c30127 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] 10.222.0.66 "POST /compute/v2.1/servers/f69fd00d-cf45-4c17-aee5-701e87ebab82/action" status: 200 len: 32 microversion: 2.1 time: 0.351855 Aug 04 03:44:32.453304 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 287/574] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 03:44:32 2022] POST /compute/v2.1/servers/f69fd00d-cf45-4c17-aee5-701e87ebab82/action => generated 32 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 03:44:32.462481 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-85f685ac-87c8-4f91-8b95-ade7960893be tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:44:32.463122 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-85f685ac-87c8-4f91-8b95-ade7960893be tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] [instance: f69fd00d-cf45-4c17-aee5-701e87ebab82] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:44:32.469861 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-85f685ac-87c8-4f91-8b95-ade7960893be tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:44:32.470313 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-85f685ac-87c8-4f91-8b95-ade7960893be tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:44:32.471079 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-85f685ac-87c8-4f91-8b95-ade7960893be tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:44:32.471515 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-85f685ac-87c8-4f91-8b95-ade7960893be tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:44:32.606443 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-85f685ac-87c8-4f91-8b95-ade7960893be tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec8d131a9764028a096314a4ecd58f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9ff6952b014d0a9abb28dcf0b818b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:44:32.614831 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-85f685ac-87c8-4f91-8b95-ade7960893be tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] 10.222.0.66 "GET /compute/v2.1/servers/f69fd00d-cf45-4c17-aee5-701e87ebab82" status: 200 len: 1736 microversion: 2.1 time: 0.156021 Aug 04 03:44:32.615394 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 288/575] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:44:32 2022] GET /compute/v2.1/servers/f69fd00d-cf45-4c17-aee5-701e87ebab82 => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:44:32.856679 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-15cc214f-2e59-45f0-b402-f9c0b113ed1a tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:44:32.857983 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-15cc214f-2e59-45f0-b402-f9c0b113ed1a tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] [instance: 3bf41d49-2b84-4f59-a019-a8b1e45891d1] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:44:32.867140 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-15cc214f-2e59-45f0-b402-f9c0b113ed1a tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:44:32.867140 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-15cc214f-2e59-45f0-b402-f9c0b113ed1a tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:44:32.867140 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-15cc214f-2e59-45f0-b402-f9c0b113ed1a tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:44:32.867140 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-15cc214f-2e59-45f0-b402-f9c0b113ed1a tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:44:32.998330 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-15cc214f-2e59-45f0-b402-f9c0b113ed1a tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:44:33.006424 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-15cc214f-2e59-45f0-b402-f9c0b113ed1a tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:44:33.007902 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-15cc214f-2e59-45f0-b402-f9c0b113ed1a tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:44:33.009077 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-15cc214f-2e59-45f0-b402-f9c0b113ed1a tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] 10.222.0.66 "GET /compute/v2.1/servers/3bf41d49-2b84-4f59-a019-a8b1e45891d1" status: 200 len: 1723 microversion: 2.20 time: 0.156951 Aug 04 03:44:33.009652 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 288/576] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 03:44:32 2022] GET /compute/v2.1/servers/3bf41d49-2b84-4f59-a019-a8b1e45891d1 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 03:44:33.637131 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-aeef80ed-b5ce-42bf-bca0-4ea0874d37d3 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:44:33.637779 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-aeef80ed-b5ce-42bf-bca0-4ea0874d37d3 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] [instance: f69fd00d-cf45-4c17-aee5-701e87ebab82] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:44:33.644902 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-aeef80ed-b5ce-42bf-bca0-4ea0874d37d3 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:44:33.645396 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-aeef80ed-b5ce-42bf-bca0-4ea0874d37d3 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:44:33.646159 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-aeef80ed-b5ce-42bf-bca0-4ea0874d37d3 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:44:33.646598 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-aeef80ed-b5ce-42bf-bca0-4ea0874d37d3 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:44:33.777722 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-aeef80ed-b5ce-42bf-bca0-4ea0874d37d3 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec8d131a9764028a096314a4ecd58f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9ff6952b014d0a9abb28dcf0b818b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:44:33.785560 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-aeef80ed-b5ce-42bf-bca0-4ea0874d37d3 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] 10.222.0.66 "GET /compute/v2.1/servers/f69fd00d-cf45-4c17-aee5-701e87ebab82" status: 200 len: 1736 microversion: 2.1 time: 0.152220 Aug 04 03:44:33.786137 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 289/577] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:44:33 2022] GET /compute/v2.1/servers/f69fd00d-cf45-4c17-aee5-701e87ebab82 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:44:34.032403 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-17d43f36-877c-43c3-a148-199add42da48 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:44:34.032930 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-17d43f36-877c-43c3-a148-199add42da48 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] [instance: 3bf41d49-2b84-4f59-a019-a8b1e45891d1] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:44:34.039462 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-17d43f36-877c-43c3-a148-199add42da48 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:44:34.039912 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-17d43f36-877c-43c3-a148-199add42da48 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:44:34.040674 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-17d43f36-877c-43c3-a148-199add42da48 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:44:34.041148 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-17d43f36-877c-43c3-a148-199add42da48 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:44:34.175237 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-17d43f36-877c-43c3-a148-199add42da48 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:44:34.183159 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-17d43f36-877c-43c3-a148-199add42da48 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:44:34.184664 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-17d43f36-877c-43c3-a148-199add42da48 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:44:34.186374 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-17d43f36-877c-43c3-a148-199add42da48 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] 10.222.0.66 "GET /compute/v2.1/servers/3bf41d49-2b84-4f59-a019-a8b1e45891d1" status: 200 len: 1723 microversion: 2.20 time: 0.158113 Aug 04 03:44:34.186921 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 289/578] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 03:44:34 2022] GET /compute/v2.1/servers/3bf41d49-2b84-4f59-a019-a8b1e45891d1 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 03:44:34.806351 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-20815bc3-ae25-4bbd-ba5a-e1f76d8c390d tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:44:34.806991 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-20815bc3-ae25-4bbd-ba5a-e1f76d8c390d tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] [instance: f69fd00d-cf45-4c17-aee5-701e87ebab82] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:44:34.813960 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-20815bc3-ae25-4bbd-ba5a-e1f76d8c390d tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:44:34.814353 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-20815bc3-ae25-4bbd-ba5a-e1f76d8c390d tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:44:34.815106 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-20815bc3-ae25-4bbd-ba5a-e1f76d8c390d tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:44:34.815540 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-20815bc3-ae25-4bbd-ba5a-e1f76d8c390d tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:44:34.945426 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-20815bc3-ae25-4bbd-ba5a-e1f76d8c390d tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec8d131a9764028a096314a4ecd58f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9ff6952b014d0a9abb28dcf0b818b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:44:34.954022 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-20815bc3-ae25-4bbd-ba5a-e1f76d8c390d tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] 10.222.0.66 "GET /compute/v2.1/servers/f69fd00d-cf45-4c17-aee5-701e87ebab82" status: 200 len: 1736 microversion: 2.1 time: 0.151505 Aug 04 03:44:34.954582 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 290/579] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:44:34 2022] GET /compute/v2.1/servers/f69fd00d-cf45-4c17-aee5-701e87ebab82 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:44:35.209937 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-13a29c53-b517-486e-adec-6a255013c906 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:44:35.210537 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-13a29c53-b517-486e-adec-6a255013c906 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] [instance: 3bf41d49-2b84-4f59-a019-a8b1e45891d1] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:44:35.216861 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-13a29c53-b517-486e-adec-6a255013c906 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:44:35.217348 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-13a29c53-b517-486e-adec-6a255013c906 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:44:35.218105 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-13a29c53-b517-486e-adec-6a255013c906 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:44:35.218531 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-13a29c53-b517-486e-adec-6a255013c906 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:44:35.351096 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-13a29c53-b517-486e-adec-6a255013c906 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:44:35.359819 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-13a29c53-b517-486e-adec-6a255013c906 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:44:35.361983 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-13a29c53-b517-486e-adec-6a255013c906 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:44:35.362549 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-13a29c53-b517-486e-adec-6a255013c906 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] 10.222.0.66 "GET /compute/v2.1/servers/3bf41d49-2b84-4f59-a019-a8b1e45891d1" status: 200 len: 1744 microversion: 2.20 time: 0.156421 Aug 04 03:44:35.363094 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 290/580] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 03:44:35 2022] GET /compute/v2.1/servers/3bf41d49-2b84-4f59-a019-a8b1e45891d1 => generated 1744 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 03:44:35.975604 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-b97860e4-7440-4420-9725-fae06f4cd7fe tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:44:35.976225 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-b97860e4-7440-4420-9725-fae06f4cd7fe tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] [instance: f69fd00d-cf45-4c17-aee5-701e87ebab82] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:44:35.983352 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-b97860e4-7440-4420-9725-fae06f4cd7fe tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:44:35.984094 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-b97860e4-7440-4420-9725-fae06f4cd7fe tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:44:35.984842 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-b97860e4-7440-4420-9725-fae06f4cd7fe tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:44:35.985291 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-b97860e4-7440-4420-9725-fae06f4cd7fe tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:44:36.113778 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-b97860e4-7440-4420-9725-fae06f4cd7fe tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec8d131a9764028a096314a4ecd58f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9ff6952b014d0a9abb28dcf0b818b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:44:36.121635 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-b97860e4-7440-4420-9725-fae06f4cd7fe tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] 10.222.0.66 "GET /compute/v2.1/servers/f69fd00d-cf45-4c17-aee5-701e87ebab82" status: 200 len: 1736 microversion: 2.1 time: 0.149827 Aug 04 03:44:36.122190 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 291/581] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:44:35 2022] GET /compute/v2.1/servers/f69fd00d-cf45-4c17-aee5-701e87ebab82 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:44:36.386101 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-0646dba7-40fa-4d62-89af-416174a85926 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:44:36.386733 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-0646dba7-40fa-4d62-89af-416174a85926 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] [instance: 3bf41d49-2b84-4f59-a019-a8b1e45891d1] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:44:36.393519 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-0646dba7-40fa-4d62-89af-416174a85926 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:44:36.394016 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-0646dba7-40fa-4d62-89af-416174a85926 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:44:36.394784 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-0646dba7-40fa-4d62-89af-416174a85926 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:44:36.395220 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-0646dba7-40fa-4d62-89af-416174a85926 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:44:36.522649 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-0646dba7-40fa-4d62-89af-416174a85926 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:44:36.530744 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-0646dba7-40fa-4d62-89af-416174a85926 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:44:36.532243 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-0646dba7-40fa-4d62-89af-416174a85926 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:44:36.533416 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-0646dba7-40fa-4d62-89af-416174a85926 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] 10.222.0.66 "GET /compute/v2.1/servers/3bf41d49-2b84-4f59-a019-a8b1e45891d1" status: 200 len: 1744 microversion: 2.20 time: 0.151258 Aug 04 03:44:36.533973 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 291/582] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 03:44:36 2022] GET /compute/v2.1/servers/3bf41d49-2b84-4f59-a019-a8b1e45891d1 => generated 1744 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 03:44:37.142413 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-5ce3dcbe-e522-488c-beb4-765771bc44af tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:44:37.143021 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-5ce3dcbe-e522-488c-beb4-765771bc44af tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] [instance: f69fd00d-cf45-4c17-aee5-701e87ebab82] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:44:37.149654 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-5ce3dcbe-e522-488c-beb4-765771bc44af tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:44:37.150104 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-5ce3dcbe-e522-488c-beb4-765771bc44af tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:44:37.150864 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-5ce3dcbe-e522-488c-beb4-765771bc44af tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:44:37.151298 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-5ce3dcbe-e522-488c-beb4-765771bc44af tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:44:37.283391 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-5ce3dcbe-e522-488c-beb4-765771bc44af tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec8d131a9764028a096314a4ecd58f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9ff6952b014d0a9abb28dcf0b818b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:44:37.291286 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-5ce3dcbe-e522-488c-beb4-765771bc44af tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] 10.222.0.66 "GET /compute/v2.1/servers/f69fd00d-cf45-4c17-aee5-701e87ebab82" status: 200 len: 1736 microversion: 2.1 time: 0.153359 Aug 04 03:44:37.291854 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 292/583] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:44:37 2022] GET /compute/v2.1/servers/f69fd00d-cf45-4c17-aee5-701e87ebab82 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:44:37.556372 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-86b7e072-9600-4aa2-8986-747cd1ff23c7 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:44:37.556899 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-86b7e072-9600-4aa2-8986-747cd1ff23c7 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] [instance: 3bf41d49-2b84-4f59-a019-a8b1e45891d1] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:44:37.564080 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-86b7e072-9600-4aa2-8986-747cd1ff23c7 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:44:37.564529 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-86b7e072-9600-4aa2-8986-747cd1ff23c7 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:44:37.565316 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-86b7e072-9600-4aa2-8986-747cd1ff23c7 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:44:37.565751 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-86b7e072-9600-4aa2-8986-747cd1ff23c7 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:44:37.695008 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-86b7e072-9600-4aa2-8986-747cd1ff23c7 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:44:37.703123 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-86b7e072-9600-4aa2-8986-747cd1ff23c7 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:44:37.704615 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-86b7e072-9600-4aa2-8986-747cd1ff23c7 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:44:37.705790 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-86b7e072-9600-4aa2-8986-747cd1ff23c7 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] 10.222.0.66 "GET /compute/v2.1/servers/3bf41d49-2b84-4f59-a019-a8b1e45891d1" status: 200 len: 1744 microversion: 2.20 time: 0.153432 Aug 04 03:44:37.706344 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 292/584] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 03:44:37 2022] GET /compute/v2.1/servers/3bf41d49-2b84-4f59-a019-a8b1e45891d1 => generated 1744 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 03:44:38.313591 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-d326edca-7f54-4617-89f6-980224fae25f tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:44:38.314194 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-d326edca-7f54-4617-89f6-980224fae25f tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] [instance: f69fd00d-cf45-4c17-aee5-701e87ebab82] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:44:38.320535 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-d326edca-7f54-4617-89f6-980224fae25f tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:44:38.320976 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-d326edca-7f54-4617-89f6-980224fae25f tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:44:38.321759 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-d326edca-7f54-4617-89f6-980224fae25f tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:44:38.322188 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-d326edca-7f54-4617-89f6-980224fae25f tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:44:38.453234 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-d326edca-7f54-4617-89f6-980224fae25f tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec8d131a9764028a096314a4ecd58f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9ff6952b014d0a9abb28dcf0b818b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:44:38.464183 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-d326edca-7f54-4617-89f6-980224fae25f tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] 10.222.0.66 "GET /compute/v2.1/servers/f69fd00d-cf45-4c17-aee5-701e87ebab82" status: 200 len: 1736 microversion: 2.1 time: 0.154909 Aug 04 03:44:38.464744 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 293/585] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:44:38 2022] GET /compute/v2.1/servers/f69fd00d-cf45-4c17-aee5-701e87ebab82 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 03:44:38.729502 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-f669abbd-5d12-4ab5-a9af-68dc5ba3592d tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:44:38.730399 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-f669abbd-5d12-4ab5-a9af-68dc5ba3592d tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] [instance: 3bf41d49-2b84-4f59-a019-a8b1e45891d1] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:44:38.737278 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-f669abbd-5d12-4ab5-a9af-68dc5ba3592d tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:44:38.737733 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-f669abbd-5d12-4ab5-a9af-68dc5ba3592d tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:44:38.738492 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-f669abbd-5d12-4ab5-a9af-68dc5ba3592d tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:44:38.738930 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-f669abbd-5d12-4ab5-a9af-68dc5ba3592d tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:44:38.869085 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-f669abbd-5d12-4ab5-a9af-68dc5ba3592d tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:44:38.877491 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-f669abbd-5d12-4ab5-a9af-68dc5ba3592d tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:44:38.878971 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-f669abbd-5d12-4ab5-a9af-68dc5ba3592d tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:44:38.880142 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-f669abbd-5d12-4ab5-a9af-68dc5ba3592d tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] 10.222.0.66 "GET /compute/v2.1/servers/3bf41d49-2b84-4f59-a019-a8b1e45891d1" status: 200 len: 1744 microversion: 2.20 time: 0.154620 Aug 04 03:44:38.880683 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 293/586] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 03:44:38 2022] GET /compute/v2.1/servers/3bf41d49-2b84-4f59-a019-a8b1e45891d1 => generated 1744 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 03:44:39.486941 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-5574cee7-ffe1-4a0d-88c5-71b25d4f9537 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:44:39.487465 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-5574cee7-ffe1-4a0d-88c5-71b25d4f9537 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] [instance: f69fd00d-cf45-4c17-aee5-701e87ebab82] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:44:39.493717 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-5574cee7-ffe1-4a0d-88c5-71b25d4f9537 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:44:39.494170 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-5574cee7-ffe1-4a0d-88c5-71b25d4f9537 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:44:39.494934 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-5574cee7-ffe1-4a0d-88c5-71b25d4f9537 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:44:39.495374 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-5574cee7-ffe1-4a0d-88c5-71b25d4f9537 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:44:39.624194 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-5574cee7-ffe1-4a0d-88c5-71b25d4f9537 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec8d131a9764028a096314a4ecd58f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9ff6952b014d0a9abb28dcf0b818b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:44:39.632163 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-5574cee7-ffe1-4a0d-88c5-71b25d4f9537 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] 10.222.0.66 "GET /compute/v2.1/servers/f69fd00d-cf45-4c17-aee5-701e87ebab82" status: 200 len: 1736 microversion: 2.1 time: 0.150049 Aug 04 03:44:39.632727 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 294/587] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:44:39 2022] GET /compute/v2.1/servers/f69fd00d-cf45-4c17-aee5-701e87ebab82 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:44:39.858355 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [req-7f300052-63c7-4f40-b642-fb6f3cd3ad2e req-1cfc0115-d8b9-4f04-930a-76bd33cc0b22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3bf41d49-2b84-4f59-a019-a8b1e45891d1", "name": "network-vif-plugged", "status": "completed", "tag": "8144b5cf-3a6c-452a-a3bb-81896a2ba4e0"}]} {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 03:44:39.868362 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [req-7f300052-63c7-4f40-b642-fb6f3cd3ad2e req-1cfc0115-d8b9-4f04-930a-76bd33cc0b22 service nova] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:44:39.868800 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [req-7f300052-63c7-4f40-b642-fb6f3cd3ad2e req-1cfc0115-d8b9-4f04-930a-76bd33cc0b22 service nova] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:44:39.879713 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.compute.server_external_events [req-7f300052-63c7-4f40-b642-fb6f3cd3ad2e req-1cfc0115-d8b9-4f04-930a-76bd33cc0b22 service nova] Creating event network-vif-plugged:8144b5cf-3a6c-452a-a3bb-81896a2ba4e0 for instance 3bf41d49-2b84-4f59-a019-a8b1e45891d1 on hv-cinder-73306 Aug 04 03:44:39.884780 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [req-7f300052-63c7-4f40-b642-fb6f3cd3ad2e req-1cfc0115-d8b9-4f04-930a-76bd33cc0b22 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030783 Aug 04 03:44:39.885414 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 294/588] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 03:44:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 03:44:39.903428 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-ec42ac9c-6c7b-446b-89f2-b9e7d3a9327f tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:44:39.905114 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-ec42ac9c-6c7b-446b-89f2-b9e7d3a9327f tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] [instance: 3bf41d49-2b84-4f59-a019-a8b1e45891d1] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:44:39.911600 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-ec42ac9c-6c7b-446b-89f2-b9e7d3a9327f tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:44:39.917193 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-ec42ac9c-6c7b-446b-89f2-b9e7d3a9327f tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:44:39.917193 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-ec42ac9c-6c7b-446b-89f2-b9e7d3a9327f tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:44:39.917193 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-ec42ac9c-6c7b-446b-89f2-b9e7d3a9327f tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:44:40.048642 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-ec42ac9c-6c7b-446b-89f2-b9e7d3a9327f tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:44:40.052185 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG dbcounter [-] [130263] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=130263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:44:40.056905 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-ec42ac9c-6c7b-446b-89f2-b9e7d3a9327f tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:44:40.058427 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-ec42ac9c-6c7b-446b-89f2-b9e7d3a9327f tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:44:40.059642 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-ec42ac9c-6c7b-446b-89f2-b9e7d3a9327f tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] 10.222.0.66 "GET /compute/v2.1/servers/3bf41d49-2b84-4f59-a019-a8b1e45891d1" status: 200 len: 1744 microversion: 2.20 time: 0.160136 Aug 04 03:44:40.060307 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 295/589] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 03:44:39 2022] GET /compute/v2.1/servers/3bf41d49-2b84-4f59-a019-a8b1e45891d1 => generated 1744 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 03:44:40.654264 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-954920f6-dfb7-45da-beb4-baa0a4b9b681 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:44:40.654959 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-954920f6-dfb7-45da-beb4-baa0a4b9b681 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] [instance: f69fd00d-cf45-4c17-aee5-701e87ebab82] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:44:40.661132 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-954920f6-dfb7-45da-beb4-baa0a4b9b681 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:44:40.661610 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-954920f6-dfb7-45da-beb4-baa0a4b9b681 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:44:40.662365 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-954920f6-dfb7-45da-beb4-baa0a4b9b681 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:44:40.662799 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-954920f6-dfb7-45da-beb4-baa0a4b9b681 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:44:40.794103 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-954920f6-dfb7-45da-beb4-baa0a4b9b681 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec8d131a9764028a096314a4ecd58f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9ff6952b014d0a9abb28dcf0b818b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:44:40.802298 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-954920f6-dfb7-45da-beb4-baa0a4b9b681 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] 10.222.0.66 "GET /compute/v2.1/servers/f69fd00d-cf45-4c17-aee5-701e87ebab82" status: 200 len: 1736 microversion: 2.1 time: 0.152448 Aug 04 03:44:40.802856 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 295/590] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:44:40 2022] GET /compute/v2.1/servers/f69fd00d-cf45-4c17-aee5-701e87ebab82 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:44:41.083088 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-8ccf724d-7dc5-46d7-9bdd-72156e2d7e84 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:44:41.083699 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-8ccf724d-7dc5-46d7-9bdd-72156e2d7e84 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] [instance: 3bf41d49-2b84-4f59-a019-a8b1e45891d1] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:44:41.090765 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-8ccf724d-7dc5-46d7-9bdd-72156e2d7e84 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:44:41.091208 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-8ccf724d-7dc5-46d7-9bdd-72156e2d7e84 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:44:41.093057 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-8ccf724d-7dc5-46d7-9bdd-72156e2d7e84 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:44:41.093526 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-8ccf724d-7dc5-46d7-9bdd-72156e2d7e84 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:44:41.227571 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-8ccf724d-7dc5-46d7-9bdd-72156e2d7e84 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:44:41.236451 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-8ccf724d-7dc5-46d7-9bdd-72156e2d7e84 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:44:41.238011 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-8ccf724d-7dc5-46d7-9bdd-72156e2d7e84 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:44:41.239173 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-8ccf724d-7dc5-46d7-9bdd-72156e2d7e84 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] 10.222.0.66 "GET /compute/v2.1/servers/3bf41d49-2b84-4f59-a019-a8b1e45891d1" status: 200 len: 1744 microversion: 2.20 time: 0.160141 Aug 04 03:44:41.239727 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 296/591] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 03:44:41 2022] GET /compute/v2.1/servers/3bf41d49-2b84-4f59-a019-a8b1e45891d1 => generated 1744 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 03:44:41.823922 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-0a679a6d-fc68-44b1-8d25-e4cb8af58618 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:44:41.824551 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-0a679a6d-fc68-44b1-8d25-e4cb8af58618 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] [instance: f69fd00d-cf45-4c17-aee5-701e87ebab82] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:44:41.831704 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-0a679a6d-fc68-44b1-8d25-e4cb8af58618 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:44:41.832151 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-0a679a6d-fc68-44b1-8d25-e4cb8af58618 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:44:41.832915 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-0a679a6d-fc68-44b1-8d25-e4cb8af58618 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:44:41.833384 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-0a679a6d-fc68-44b1-8d25-e4cb8af58618 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:44:41.963041 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-0a679a6d-fc68-44b1-8d25-e4cb8af58618 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec8d131a9764028a096314a4ecd58f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9ff6952b014d0a9abb28dcf0b818b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:44:41.967571 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG dbcounter [-] [130262] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=130262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:44:41.973061 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-0a679a6d-fc68-44b1-8d25-e4cb8af58618 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] 10.222.0.66 "GET /compute/v2.1/servers/f69fd00d-cf45-4c17-aee5-701e87ebab82" status: 200 len: 1736 microversion: 2.1 time: 0.152827 Aug 04 03:44:41.973667 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 296/592] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:44:41 2022] GET /compute/v2.1/servers/f69fd00d-cf45-4c17-aee5-701e87ebab82 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:44:42.264003 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-287e9fed-39ce-4139-b984-1172c6497cea tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:44:42.265811 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-287e9fed-39ce-4139-b984-1172c6497cea tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] [instance: 3bf41d49-2b84-4f59-a019-a8b1e45891d1] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:44:42.272792 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-287e9fed-39ce-4139-b984-1172c6497cea tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:44:42.273274 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-287e9fed-39ce-4139-b984-1172c6497cea tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:44:42.274099 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-287e9fed-39ce-4139-b984-1172c6497cea tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:44:42.274538 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-287e9fed-39ce-4139-b984-1172c6497cea tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:44:42.415081 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-287e9fed-39ce-4139-b984-1172c6497cea tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:44:42.423918 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-287e9fed-39ce-4139-b984-1172c6497cea tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:44:42.425738 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-287e9fed-39ce-4139-b984-1172c6497cea tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:44:42.426900 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-287e9fed-39ce-4139-b984-1172c6497cea tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] 10.222.0.66 "GET /compute/v2.1/servers/3bf41d49-2b84-4f59-a019-a8b1e45891d1" status: 200 len: 1739 microversion: 2.20 time: 0.167661 Aug 04 03:44:42.427460 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 297/593] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 03:44:42 2022] GET /compute/v2.1/servers/3bf41d49-2b84-4f59-a019-a8b1e45891d1 => generated 1739 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 03:44:42.997144 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-847a7796-13be-4c31-afac-c984cd79968e tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:44:42.997977 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-847a7796-13be-4c31-afac-c984cd79968e tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] [instance: f69fd00d-cf45-4c17-aee5-701e87ebab82] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:44:43.005252 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-847a7796-13be-4c31-afac-c984cd79968e tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:44:43.005787 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-847a7796-13be-4c31-afac-c984cd79968e tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:44:43.006638 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-847a7796-13be-4c31-afac-c984cd79968e tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:44:43.007302 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-847a7796-13be-4c31-afac-c984cd79968e tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:44:43.153328 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-847a7796-13be-4c31-afac-c984cd79968e tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec8d131a9764028a096314a4ecd58f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9ff6952b014d0a9abb28dcf0b818b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:44:43.163444 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-847a7796-13be-4c31-afac-c984cd79968e tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] 10.222.0.66 "GET /compute/v2.1/servers/f69fd00d-cf45-4c17-aee5-701e87ebab82" status: 200 len: 1736 microversion: 2.1 time: 0.171619 Aug 04 03:44:43.177608 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 297/594] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:44:42 2022] GET /compute/v2.1/servers/f69fd00d-cf45-4c17-aee5-701e87ebab82 => generated 1736 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:44:43.456554 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-5cfd238f-81f2-4188-88c8-11660673d497 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:44:43.457400 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-5cfd238f-81f2-4188-88c8-11660673d497 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] [instance: 3bf41d49-2b84-4f59-a019-a8b1e45891d1] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:44:43.470186 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-5cfd238f-81f2-4188-88c8-11660673d497 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:44:43.470658 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-5cfd238f-81f2-4188-88c8-11660673d497 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:44:43.471408 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-5cfd238f-81f2-4188-88c8-11660673d497 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:44:43.471848 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-5cfd238f-81f2-4188-88c8-11660673d497 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:44:43.621505 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-5cfd238f-81f2-4188-88c8-11660673d497 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:44:43.631090 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-5cfd238f-81f2-4188-88c8-11660673d497 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:44:43.633110 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-5cfd238f-81f2-4188-88c8-11660673d497 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:44:43.635475 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-5cfd238f-81f2-4188-88c8-11660673d497 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] 10.222.0.66 "GET /compute/v2.1/servers/3bf41d49-2b84-4f59-a019-a8b1e45891d1" status: 200 len: 1739 microversion: 2.20 time: 0.183037 Aug 04 03:44:43.636042 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 298/595] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 03:44:43 2022] GET /compute/v2.1/servers/3bf41d49-2b84-4f59-a019-a8b1e45891d1 => generated 1739 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 03:44:44.192672 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-8710cede-85fe-46d1-9179-9a77554b8b1a tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:44:44.193493 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-8710cede-85fe-46d1-9179-9a77554b8b1a tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] [instance: f69fd00d-cf45-4c17-aee5-701e87ebab82] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:44:44.200387 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-8710cede-85fe-46d1-9179-9a77554b8b1a tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:44:44.200869 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-8710cede-85fe-46d1-9179-9a77554b8b1a tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:44:44.201828 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-8710cede-85fe-46d1-9179-9a77554b8b1a tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:44:44.202457 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-8710cede-85fe-46d1-9179-9a77554b8b1a tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:44:44.349768 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-8710cede-85fe-46d1-9179-9a77554b8b1a tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec8d131a9764028a096314a4ecd58f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9ff6952b014d0a9abb28dcf0b818b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:44:44.359130 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-8710cede-85fe-46d1-9179-9a77554b8b1a tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] 10.222.0.66 "GET /compute/v2.1/servers/f69fd00d-cf45-4c17-aee5-701e87ebab82" status: 200 len: 1736 microversion: 2.1 time: 0.169956 Aug 04 03:44:44.360920 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 298/596] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:44:44 2022] GET /compute/v2.1/servers/f69fd00d-cf45-4c17-aee5-701e87ebab82 => generated 1736 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 03:44:44.666062 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-c856b21b-f114-4e84-bc11-3df65fe8483a tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:44:44.666850 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-c856b21b-f114-4e84-bc11-3df65fe8483a tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] [instance: 3bf41d49-2b84-4f59-a019-a8b1e45891d1] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:44:44.675058 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-c856b21b-f114-4e84-bc11-3df65fe8483a tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:44:44.675791 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-c856b21b-f114-4e84-bc11-3df65fe8483a tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:44:44.676576 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-c856b21b-f114-4e84-bc11-3df65fe8483a tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:44:44.677470 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-c856b21b-f114-4e84-bc11-3df65fe8483a tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:44:44.818224 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-c856b21b-f114-4e84-bc11-3df65fe8483a tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:44:44.827468 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-c856b21b-f114-4e84-bc11-3df65fe8483a tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:44:44.829288 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-c856b21b-f114-4e84-bc11-3df65fe8483a tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:44:44.830450 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-c856b21b-f114-4e84-bc11-3df65fe8483a tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] 10.222.0.66 "GET /compute/v2.1/servers/3bf41d49-2b84-4f59-a019-a8b1e45891d1" status: 200 len: 1739 microversion: 2.20 time: 0.168853 Aug 04 03:44:44.831011 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 299/597] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 03:44:44 2022] GET /compute/v2.1/servers/3bf41d49-2b84-4f59-a019-a8b1e45891d1 => generated 1739 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 03:44:45.383271 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-27f9f11f-43ba-4a8a-afac-a866554d3297 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:44:45.383892 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-27f9f11f-43ba-4a8a-afac-a866554d3297 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] [instance: f69fd00d-cf45-4c17-aee5-701e87ebab82] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:44:45.390886 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-27f9f11f-43ba-4a8a-afac-a866554d3297 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:44:45.391334 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-27f9f11f-43ba-4a8a-afac-a866554d3297 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:44:45.392346 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-27f9f11f-43ba-4a8a-afac-a866554d3297 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:44:45.392866 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-27f9f11f-43ba-4a8a-afac-a866554d3297 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:44:45.542808 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-27f9f11f-43ba-4a8a-afac-a866554d3297 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec8d131a9764028a096314a4ecd58f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9ff6952b014d0a9abb28dcf0b818b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:44:45.551788 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-27f9f11f-43ba-4a8a-afac-a866554d3297 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] 10.222.0.66 "GET /compute/v2.1/servers/f69fd00d-cf45-4c17-aee5-701e87ebab82" status: 200 len: 1736 microversion: 2.1 time: 0.172243 Aug 04 03:44:45.552501 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 299/598] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:44:45 2022] GET /compute/v2.1/servers/f69fd00d-cf45-4c17-aee5-701e87ebab82 => generated 1736 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:44:45.853510 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-c8c5a969-56ca-49f2-84b7-f47097563d24 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:44:45.854153 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-c8c5a969-56ca-49f2-84b7-f47097563d24 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] [instance: 3bf41d49-2b84-4f59-a019-a8b1e45891d1] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:44:45.861116 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-c8c5a969-56ca-49f2-84b7-f47097563d24 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:44:45.861689 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-c8c5a969-56ca-49f2-84b7-f47097563d24 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:44:45.862656 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-c8c5a969-56ca-49f2-84b7-f47097563d24 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:44:45.863094 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-c8c5a969-56ca-49f2-84b7-f47097563d24 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:44:46.012428 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-c8c5a969-56ca-49f2-84b7-f47097563d24 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:44:46.021494 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-c8c5a969-56ca-49f2-84b7-f47097563d24 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:44:46.023230 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-c8c5a969-56ca-49f2-84b7-f47097563d24 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:44:46.024374 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-c8c5a969-56ca-49f2-84b7-f47097563d24 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] 10.222.0.66 "GET /compute/v2.1/servers/3bf41d49-2b84-4f59-a019-a8b1e45891d1" status: 200 len: 1739 microversion: 2.20 time: 0.174864 Aug 04 03:44:46.025094 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 300/599] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 03:44:45 2022] GET /compute/v2.1/servers/3bf41d49-2b84-4f59-a019-a8b1e45891d1 => generated 1739 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 03:44:46.573641 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-2b26667b-03e7-4dc2-a4e8-6d941bfee010 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:44:46.574245 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-2b26667b-03e7-4dc2-a4e8-6d941bfee010 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] [instance: f69fd00d-cf45-4c17-aee5-701e87ebab82] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:44:46.580748 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-2b26667b-03e7-4dc2-a4e8-6d941bfee010 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:44:46.581220 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-2b26667b-03e7-4dc2-a4e8-6d941bfee010 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:44:46.581974 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-2b26667b-03e7-4dc2-a4e8-6d941bfee010 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:44:46.582407 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-2b26667b-03e7-4dc2-a4e8-6d941bfee010 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:44:46.725540 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-2b26667b-03e7-4dc2-a4e8-6d941bfee010 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec8d131a9764028a096314a4ecd58f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9ff6952b014d0a9abb28dcf0b818b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:44:46.735519 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-2b26667b-03e7-4dc2-a4e8-6d941bfee010 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] 10.222.0.66 "GET /compute/v2.1/servers/f69fd00d-cf45-4c17-aee5-701e87ebab82" status: 200 len: 1736 microversion: 2.1 time: 0.165624 Aug 04 03:44:46.749222 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 300/600] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:44:46 2022] GET /compute/v2.1/servers/f69fd00d-cf45-4c17-aee5-701e87ebab82 => generated 1736 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:44:47.048141 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-6b37e19e-a306-46c1-94af-0eb79f45ec64 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:44:47.048925 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-6b37e19e-a306-46c1-94af-0eb79f45ec64 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] [instance: 3bf41d49-2b84-4f59-a019-a8b1e45891d1] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:44:47.057318 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-6b37e19e-a306-46c1-94af-0eb79f45ec64 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:44:47.057864 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-6b37e19e-a306-46c1-94af-0eb79f45ec64 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:44:47.058849 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-6b37e19e-a306-46c1-94af-0eb79f45ec64 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:44:47.059354 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-6b37e19e-a306-46c1-94af-0eb79f45ec64 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:44:47.211043 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-6b37e19e-a306-46c1-94af-0eb79f45ec64 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:44:47.220391 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-6b37e19e-a306-46c1-94af-0eb79f45ec64 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:44:47.222072 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-6b37e19e-a306-46c1-94af-0eb79f45ec64 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:44:47.223368 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-6b37e19e-a306-46c1-94af-0eb79f45ec64 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] 10.222.0.66 "GET /compute/v2.1/servers/3bf41d49-2b84-4f59-a019-a8b1e45891d1" status: 200 len: 1739 microversion: 2.20 time: 0.179424 Aug 04 03:44:47.224002 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 301/601] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 03:44:47 2022] GET /compute/v2.1/servers/3bf41d49-2b84-4f59-a019-a8b1e45891d1 => generated 1739 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 03:44:47.758058 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-cd49893e-72bf-4f04-b581-22bff34a9bdd tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:44:47.758870 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-cd49893e-72bf-4f04-b581-22bff34a9bdd tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] [instance: f69fd00d-cf45-4c17-aee5-701e87ebab82] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:44:47.765273 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-cd49893e-72bf-4f04-b581-22bff34a9bdd tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:44:47.765723 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-cd49893e-72bf-4f04-b581-22bff34a9bdd tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:44:47.766484 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-cd49893e-72bf-4f04-b581-22bff34a9bdd tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:44:47.766919 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-cd49893e-72bf-4f04-b581-22bff34a9bdd tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:44:47.916373 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-cd49893e-72bf-4f04-b581-22bff34a9bdd tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec8d131a9764028a096314a4ecd58f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9ff6952b014d0a9abb28dcf0b818b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:44:47.925176 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-cd49893e-72bf-4f04-b581-22bff34a9bdd tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] 10.222.0.66 "GET /compute/v2.1/servers/f69fd00d-cf45-4c17-aee5-701e87ebab82" status: 200 len: 1736 microversion: 2.1 time: 0.171507 Aug 04 03:44:47.927489 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 301/602] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:44:47 2022] GET /compute/v2.1/servers/f69fd00d-cf45-4c17-aee5-701e87ebab82 => generated 1736 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 03:44:48.254099 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-47b2458b-6e77-4449-8f57-e3f8f12374e7 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:44:48.255452 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-47b2458b-6e77-4449-8f57-e3f8f12374e7 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] [instance: 3bf41d49-2b84-4f59-a019-a8b1e45891d1] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:44:48.262818 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-47b2458b-6e77-4449-8f57-e3f8f12374e7 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:44:48.264059 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-47b2458b-6e77-4449-8f57-e3f8f12374e7 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:44:48.265083 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-47b2458b-6e77-4449-8f57-e3f8f12374e7 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:44:48.265707 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-47b2458b-6e77-4449-8f57-e3f8f12374e7 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:44:48.423001 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-47b2458b-6e77-4449-8f57-e3f8f12374e7 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:44:48.432025 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-47b2458b-6e77-4449-8f57-e3f8f12374e7 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:44:48.433499 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-47b2458b-6e77-4449-8f57-e3f8f12374e7 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:44:48.434728 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-47b2458b-6e77-4449-8f57-e3f8f12374e7 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] 10.222.0.66 "GET /compute/v2.1/servers/3bf41d49-2b84-4f59-a019-a8b1e45891d1" status: 200 len: 1739 microversion: 2.20 time: 0.184423 Aug 04 03:44:48.435477 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 302/603] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 03:44:48 2022] GET /compute/v2.1/servers/3bf41d49-2b84-4f59-a019-a8b1e45891d1 => generated 1739 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 03:44:48.947363 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-212772d3-0e0d-4081-9795-c9d61ccce83b tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:44:48.948058 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-212772d3-0e0d-4081-9795-c9d61ccce83b tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] [instance: f69fd00d-cf45-4c17-aee5-701e87ebab82] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:44:48.954399 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-212772d3-0e0d-4081-9795-c9d61ccce83b tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:44:48.954837 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-212772d3-0e0d-4081-9795-c9d61ccce83b tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:44:48.955591 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-212772d3-0e0d-4081-9795-c9d61ccce83b tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:44:48.956026 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-212772d3-0e0d-4081-9795-c9d61ccce83b tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:44:49.093728 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-212772d3-0e0d-4081-9795-c9d61ccce83b tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec8d131a9764028a096314a4ecd58f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9ff6952b014d0a9abb28dcf0b818b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:44:49.102270 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-212772d3-0e0d-4081-9795-c9d61ccce83b tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] 10.222.0.66 "GET /compute/v2.1/servers/f69fd00d-cf45-4c17-aee5-701e87ebab82" status: 200 len: 1736 microversion: 2.1 time: 0.158723 Aug 04 03:44:49.103148 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 302/604] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:44:48 2022] GET /compute/v2.1/servers/f69fd00d-cf45-4c17-aee5-701e87ebab82 => generated 1736 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:44:49.459335 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-ba9a5d90-a46f-410d-beea-063a531002f4 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:44:49.459886 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-ba9a5d90-a46f-410d-beea-063a531002f4 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] [instance: 3bf41d49-2b84-4f59-a019-a8b1e45891d1] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:44:49.467533 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-ba9a5d90-a46f-410d-beea-063a531002f4 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:44:49.467995 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-ba9a5d90-a46f-410d-beea-063a531002f4 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:44:49.468878 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-ba9a5d90-a46f-410d-beea-063a531002f4 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:44:49.469568 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-ba9a5d90-a46f-410d-beea-063a531002f4 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:44:49.618995 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-ba9a5d90-a46f-410d-beea-063a531002f4 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:44:49.628045 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-ba9a5d90-a46f-410d-beea-063a531002f4 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:44:49.629631 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-ba9a5d90-a46f-410d-beea-063a531002f4 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:44:49.630840 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-ba9a5d90-a46f-410d-beea-063a531002f4 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] 10.222.0.66 "GET /compute/v2.1/servers/3bf41d49-2b84-4f59-a019-a8b1e45891d1" status: 200 len: 1739 microversion: 2.20 time: 0.175709 Aug 04 03:44:49.631455 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 303/605] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 03:44:49 2022] GET /compute/v2.1/servers/3bf41d49-2b84-4f59-a019-a8b1e45891d1 => generated 1739 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 03:44:50.125034 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-596b5f0d-b299-44b2-8d18-fa4d6a4163a2 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:44:50.125699 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-596b5f0d-b299-44b2-8d18-fa4d6a4163a2 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] [instance: f69fd00d-cf45-4c17-aee5-701e87ebab82] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:44:50.132951 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-596b5f0d-b299-44b2-8d18-fa4d6a4163a2 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:44:50.133464 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-596b5f0d-b299-44b2-8d18-fa4d6a4163a2 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:44:50.134225 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-596b5f0d-b299-44b2-8d18-fa4d6a4163a2 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:44:50.134660 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-596b5f0d-b299-44b2-8d18-fa4d6a4163a2 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:44:50.265866 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-596b5f0d-b299-44b2-8d18-fa4d6a4163a2 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec8d131a9764028a096314a4ecd58f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9ff6952b014d0a9abb28dcf0b818b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:44:50.273859 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-596b5f0d-b299-44b2-8d18-fa4d6a4163a2 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] 10.222.0.66 "GET /compute/v2.1/servers/f69fd00d-cf45-4c17-aee5-701e87ebab82" status: 200 len: 1736 microversion: 2.1 time: 0.153392 Aug 04 03:44:50.274414 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 303/606] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:44:50 2022] GET /compute/v2.1/servers/f69fd00d-cf45-4c17-aee5-701e87ebab82 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:44:50.654364 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-e3c2ce31-71f2-4060-b199-c26643ad7862 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:44:50.663362 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-e3c2ce31-71f2-4060-b199-c26643ad7862 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] [instance: 3bf41d49-2b84-4f59-a019-a8b1e45891d1] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:44:50.669858 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-e3c2ce31-71f2-4060-b199-c26643ad7862 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:44:50.671383 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-e3c2ce31-71f2-4060-b199-c26643ad7862 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:44:50.673567 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-e3c2ce31-71f2-4060-b199-c26643ad7862 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:44:50.674253 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-e3c2ce31-71f2-4060-b199-c26643ad7862 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:44:50.843694 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-e3c2ce31-71f2-4060-b199-c26643ad7862 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:44:50.853015 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-e3c2ce31-71f2-4060-b199-c26643ad7862 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:44:50.854574 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-e3c2ce31-71f2-4060-b199-c26643ad7862 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:44:50.855751 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-e3c2ce31-71f2-4060-b199-c26643ad7862 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] 10.222.0.66 "GET /compute/v2.1/servers/3bf41d49-2b84-4f59-a019-a8b1e45891d1" status: 200 len: 1739 microversion: 2.20 time: 0.205413 Aug 04 03:44:50.856371 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 304/607] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 03:44:50 2022] GET /compute/v2.1/servers/3bf41d49-2b84-4f59-a019-a8b1e45891d1 => generated 1739 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 03:44:51.298577 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-7d075458-9ccd-4680-8fc6-c6a2ec5dc5d4 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:44:51.299191 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-7d075458-9ccd-4680-8fc6-c6a2ec5dc5d4 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] [instance: f69fd00d-cf45-4c17-aee5-701e87ebab82] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:44:51.305575 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-7d075458-9ccd-4680-8fc6-c6a2ec5dc5d4 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:44:51.306028 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-7d075458-9ccd-4680-8fc6-c6a2ec5dc5d4 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:44:51.306798 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-7d075458-9ccd-4680-8fc6-c6a2ec5dc5d4 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:44:51.307258 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-7d075458-9ccd-4680-8fc6-c6a2ec5dc5d4 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:44:51.460631 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-7d075458-9ccd-4680-8fc6-c6a2ec5dc5d4 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec8d131a9764028a096314a4ecd58f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9ff6952b014d0a9abb28dcf0b818b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:44:51.471372 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-7d075458-9ccd-4680-8fc6-c6a2ec5dc5d4 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] 10.222.0.66 "GET /compute/v2.1/servers/f69fd00d-cf45-4c17-aee5-701e87ebab82" status: 200 len: 1736 microversion: 2.1 time: 0.177159 Aug 04 03:44:51.471949 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 304/608] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:44:51 2022] GET /compute/v2.1/servers/f69fd00d-cf45-4c17-aee5-701e87ebab82 => generated 1736 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 03:44:51.881043 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-50ec685e-f40a-4b80-b9ab-e846d378dd0e tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:44:51.881641 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-50ec685e-f40a-4b80-b9ab-e846d378dd0e tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] [instance: 3bf41d49-2b84-4f59-a019-a8b1e45891d1] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:44:51.888452 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-50ec685e-f40a-4b80-b9ab-e846d378dd0e tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:44:51.889272 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-50ec685e-f40a-4b80-b9ab-e846d378dd0e tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:44:51.890292 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-50ec685e-f40a-4b80-b9ab-e846d378dd0e tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:44:51.891010 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-50ec685e-f40a-4b80-b9ab-e846d378dd0e tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:44:52.039769 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-50ec685e-f40a-4b80-b9ab-e846d378dd0e tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:44:52.050209 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-50ec685e-f40a-4b80-b9ab-e846d378dd0e tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:44:52.057824 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-50ec685e-f40a-4b80-b9ab-e846d378dd0e tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:44:52.059185 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-50ec685e-f40a-4b80-b9ab-e846d378dd0e tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] 10.222.0.66 "GET /compute/v2.1/servers/3bf41d49-2b84-4f59-a019-a8b1e45891d1" status: 200 len: 1739 microversion: 2.20 time: 0.182507 Aug 04 03:44:52.063962 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 305/609] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 03:44:51 2022] GET /compute/v2.1/servers/3bf41d49-2b84-4f59-a019-a8b1e45891d1 => generated 1739 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 03:44:52.493806 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-36c622d0-91bb-48e1-b410-947fdf79137f tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:44:52.495639 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-36c622d0-91bb-48e1-b410-947fdf79137f tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] [instance: f69fd00d-cf45-4c17-aee5-701e87ebab82] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:44:52.503960 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-36c622d0-91bb-48e1-b410-947fdf79137f tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:44:52.504403 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-36c622d0-91bb-48e1-b410-947fdf79137f tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:44:52.505408 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-36c622d0-91bb-48e1-b410-947fdf79137f tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:44:52.506050 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-36c622d0-91bb-48e1-b410-947fdf79137f tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:44:52.664271 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-36c622d0-91bb-48e1-b410-947fdf79137f tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec8d131a9764028a096314a4ecd58f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9ff6952b014d0a9abb28dcf0b818b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:44:52.673312 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-36c622d0-91bb-48e1-b410-947fdf79137f tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] 10.222.0.66 "GET /compute/v2.1/servers/f69fd00d-cf45-4c17-aee5-701e87ebab82" status: 200 len: 1716 microversion: 2.1 time: 0.183815 Aug 04 03:44:52.673884 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 305/610] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:44:52 2022] GET /compute/v2.1/servers/f69fd00d-cf45-4c17-aee5-701e87ebab82 => generated 1716 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:44:52.739911 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-a79df931-a0ad-4c29-b641-a17380e79656 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:44:52.740535 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-a79df931-a0ad-4c29-b641-a17380e79656 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] [instance: f69fd00d-cf45-4c17-aee5-701e87ebab82] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:44:52.745671 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG dbcounter [-] [130263] Writing DB stats nova_api:SELECT=51 {{(pid=130263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:44:52.748097 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-a79df931-a0ad-4c29-b641-a17380e79656 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:44:52.748834 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-a79df931-a0ad-4c29-b641-a17380e79656 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:44:52.750003 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-a79df931-a0ad-4c29-b641-a17380e79656 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:44:52.750459 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-a79df931-a0ad-4c29-b641-a17380e79656 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:44:52.902724 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.wsgi [None req-a79df931-a0ad-4c29-b641-a17380e79656 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] HTTP exception thrown: Cannot 'detach_volume' instance f69fd00d-cf45-4c17-aee5-701e87ebab82 while it is in vm_state rescued Aug 04 03:44:52.905889 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-a79df931-a0ad-4c29-b641-a17380e79656 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Request method failure captured: Aug 04 03:44:52.905889 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: request: DELETE /compute/v2.1/servers/f69fd00d-cf45-4c17-aee5-701e87ebab82/os-volume_attachments/b94cd936-978d-4beb-a0db-308b6c06ce5d HTTP/1.1 Aug 04 03:44:52.905889 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Accept: application/json Aug 04 03:44:52.905889 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Accept-Encoding: identity Aug 04 03:44:52.905889 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Connection: close Aug 04 03:44:52.905889 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Content-Length: 0 Aug 04 03:44:52.905889 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Content-Type: application/json Aug 04 03:44:52.905889 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Host: 10.222.0.66 Aug 04 03:44:52.905889 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Openstack-System-Scope: None Aug 04 03:44:52.905889 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: User-Agent: python-urllib3/1.26.11 Aug 04 03:44:52.905889 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Auth-Token: gAAAAABi6z9iJGtDuNMkQNRzXKMLfYH03ewA3atDGoFpPxtvts1QZtyCLQeJxJ5xZv4Jb-yIauhBf4zpbsK162-B4YQFxwTxCIkCQ6jvB-tFo8yRaZBs3m8Flt5Gurg1Uwbts57F5uW3TIfvRnRvF-jH58mlrMbD9VNKLxPPHo2uIUs41P8tL24 Aug 04 03:44:52.905889 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Domain-Id: None Aug 04 03:44:52.905889 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Domain-Name: None Aug 04 03:44:52.905889 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Identity-Status: Confirmed Aug 04 03:44:52.905889 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Is-Admin-Project: True Aug 04 03:44:52.905889 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Project-Domain-Id: default Aug 04 03:44:52.905889 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Project-Domain-Name: Default Aug 04 03:44:52.905889 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Project-Id: 7d9ff6952b014d0a9abb28dcf0b818b0 Aug 04 03:44:52.905889 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-603950778 Aug 04 03:44:52.905889 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Role: member,reader Aug 04 03:44:52.905889 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Roles: member,reader Aug 04 03:44:52.907492 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/7d9ff6952b014d0a9abb28dcf0b818b0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/7d9ff6952b014d0a9abb28dcf0b818b0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/7d9ff6952b014d0a9abb28dcf0b818b0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_7d9ff6952b014d0a9abb28dcf0b818b0"}]}] Aug 04 03:44:52.907492 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Tenant: tempest-ServerRescueNegativeTestJSON-603950778 Aug 04 03:44:52.907492 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Tenant-Id: 7d9ff6952b014d0a9abb28dcf0b818b0 Aug 04 03:44:52.907492 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-603950778 Aug 04 03:44:52.907492 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-User: tempest-ServerRescueNegativeTestJSON-603950778-project Aug 04 03:44:52.907492 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-User-Domain-Id: default Aug 04 03:44:52.907492 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-User-Domain-Name: Default Aug 04 03:44:52.907492 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-User-Id: 3ec8d131a9764028a096314a4ecd58f9 Aug 04 03:44:52.907492 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-User-Name: tempest-ServerRescueNegativeTestJSON-603950778-project Aug 04 03:44:52.907492 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: method: > Aug 04 03:44:52.907492 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: exception: Cannot 'detach_volume' instance f69fd00d-cf45-4c17-aee5-701e87ebab82 while it is in vm_state rescued Aug 04 03:44:52.908468 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: action_args: {'server_id': 'f69fd00d-cf45-4c17-aee5-701e87ebab82', 'id': 'b94cd936-978d-4beb-a0db-308b6c06ce5d'} Aug 04 03:44:52.908468 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 03:44:52.908468 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 03:44:52.908468 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 04 03:44:52.908468 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 04 03:44:52.908468 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 04 03:44:52.908468 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 04 03:44:52.908468 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 04 03:44:52.908468 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 04 03:44:52.908468 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance f69fd00d-cf45-4c17-aee5-701e87ebab82 in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 04 03:44:52.908468 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Aug 04 03:44:52.908468 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 03:44:52.908468 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Aug 04 03:44:52.908468 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 03:44:52.908468 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 03:44:52.908468 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 03:44:52.908468 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 03:44:52.908468 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 03:44:52.908468 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 03:44:52.908468 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 03:44:52.909991 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 04 03:44:52.909991 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 04 03:44:52.909991 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 04 03:44:52.909991 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 04 03:44:52.909991 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance f69fd00d-cf45-4c17-aee5-701e87ebab82 while it is in vm_state rescued Aug 04 03:44:52.909991 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Aug 04 03:44:52.909991 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 03:44:52.909991 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Aug 04 03:44:52.909991 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 03:44:52.909991 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 03:44:52.909991 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 03:44:52.909991 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 03:44:52.909991 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 03:44:52.909991 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance f69fd00d-cf45-4c17-aee5-701e87ebab82 while it is in vm_state rescued Aug 04 03:44:52.909991 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Aug 04 03:44:52.909991 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-a79df931-a0ad-4c29-b641-a17380e79656 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Returning 409 to user: Cannot 'detach_volume' instance f69fd00d-cf45-4c17-aee5-701e87ebab82 while it is in vm_state rescued {{(pid=130263) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 03:44:52.915356 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-a79df931-a0ad-4c29-b641-a17380e79656 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] 10.222.0.66 "DELETE /compute/v2.1/servers/f69fd00d-cf45-4c17-aee5-701e87ebab82/os-volume_attachments/b94cd936-978d-4beb-a0db-308b6c06ce5d" status: 409 len: 152 microversion: 2.1 time: 0.175636 Aug 04 03:44:52.915938 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 306/611] 10.222.0.66 () {58 vars in 1416 bytes} [Thu Aug 4 03:44:52 2022] DELETE /compute/v2.1/servers/f69fd00d-cf45-4c17-aee5-701e87ebab82/os-volume_attachments/b94cd936-978d-4beb-a0db-308b6c06ce5d => generated 152 bytes in 181 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 04 03:44:52.926568 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-ed02a23f-b1bb-4753-911a-1f5a6c63846f tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 03:44:52.927108 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-ed02a23f-b1bb-4753-911a-1f5a6c63846f tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] [instance: f69fd00d-cf45-4c17-aee5-701e87ebab82] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:44:52.932844 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG dbcounter [-] [130262] Writing DB stats nova_api:SELECT=47 {{(pid=130262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:44:52.934846 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-ed02a23f-b1bb-4753-911a-1f5a6c63846f tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:44:52.935304 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-ed02a23f-b1bb-4753-911a-1f5a6c63846f tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:44:52.936137 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-ed02a23f-b1bb-4753-911a-1f5a6c63846f tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:44:52.937138 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-ed02a23f-b1bb-4753-911a-1f5a6c63846f tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:44:53.089175 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-b47b0ff5-450b-4d55-a5b1-606795011537 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:44:53.093293 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-b47b0ff5-450b-4d55-a5b1-606795011537 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] [instance: 3bf41d49-2b84-4f59-a019-a8b1e45891d1] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:44:53.100012 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-b47b0ff5-450b-4d55-a5b1-606795011537 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:44:53.100689 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-b47b0ff5-450b-4d55-a5b1-606795011537 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:44:53.101665 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-b47b0ff5-450b-4d55-a5b1-606795011537 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:44:53.102133 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-b47b0ff5-450b-4d55-a5b1-606795011537 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:44:53.184446 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-ed02a23f-b1bb-4753-911a-1f5a6c63846f tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] 10.222.0.66 "POST /compute/v2.1/servers/f69fd00d-cf45-4c17-aee5-701e87ebab82/action" status: 202 len: 0 microversion: 2.1 time: 0.263641 Aug 04 03:44:53.191460 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 306/612] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 03:44:52 2022] POST /compute/v2.1/servers/f69fd00d-cf45-4c17-aee5-701e87ebab82/action => generated 0 bytes in 265 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 04 03:44:53.195561 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-17f26efc-6561-42f7-a6d1-fa536c2caedb tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:44:53.196462 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-17f26efc-6561-42f7-a6d1-fa536c2caedb tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] [instance: f69fd00d-cf45-4c17-aee5-701e87ebab82] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:44:53.214652 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-17f26efc-6561-42f7-a6d1-fa536c2caedb tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:44:53.215943 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-17f26efc-6561-42f7-a6d1-fa536c2caedb tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:44:53.216568 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-17f26efc-6561-42f7-a6d1-fa536c2caedb tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:44:53.217100 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-17f26efc-6561-42f7-a6d1-fa536c2caedb tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:44:53.280749 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-b47b0ff5-450b-4d55-a5b1-606795011537 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:44:53.293028 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-b47b0ff5-450b-4d55-a5b1-606795011537 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:44:53.296567 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-b47b0ff5-450b-4d55-a5b1-606795011537 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:44:53.297845 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-b47b0ff5-450b-4d55-a5b1-606795011537 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] 10.222.0.66 "GET /compute/v2.1/servers/3bf41d49-2b84-4f59-a019-a8b1e45891d1" status: 200 len: 1739 microversion: 2.20 time: 0.213991 Aug 04 03:44:53.309118 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 307/613] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 03:44:53 2022] GET /compute/v2.1/servers/3bf41d49-2b84-4f59-a019-a8b1e45891d1 => generated 1739 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 03:44:53.384900 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-17f26efc-6561-42f7-a6d1-fa536c2caedb tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec8d131a9764028a096314a4ecd58f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9ff6952b014d0a9abb28dcf0b818b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:44:53.396787 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-17f26efc-6561-42f7-a6d1-fa536c2caedb tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] 10.222.0.66 "GET /compute/v2.1/servers/f69fd00d-cf45-4c17-aee5-701e87ebab82" status: 200 len: 1724 microversion: 2.1 time: 0.202791 Aug 04 03:44:53.396787 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 307/614] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:44:53 2022] GET /compute/v2.1/servers/f69fd00d-cf45-4c17-aee5-701e87ebab82 => generated 1724 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 03:44:54.322067 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-e4e0ce12-cfb2-4b2b-a933-ea9cc7640d6e tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:44:54.323322 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-e4e0ce12-cfb2-4b2b-a933-ea9cc7640d6e tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] [instance: 3bf41d49-2b84-4f59-a019-a8b1e45891d1] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:44:54.333072 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-e4e0ce12-cfb2-4b2b-a933-ea9cc7640d6e tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:44:54.333558 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-e4e0ce12-cfb2-4b2b-a933-ea9cc7640d6e tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:44:54.334337 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-e4e0ce12-cfb2-4b2b-a933-ea9cc7640d6e tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:44:54.334991 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-e4e0ce12-cfb2-4b2b-a933-ea9cc7640d6e tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:44:54.419644 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-a94aabcc-2006-4c1e-b458-4c6604e1e2ce tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:44:54.421574 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-a94aabcc-2006-4c1e-b458-4c6604e1e2ce tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] [instance: f69fd00d-cf45-4c17-aee5-701e87ebab82] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:44:54.429539 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-a94aabcc-2006-4c1e-b458-4c6604e1e2ce tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:44:54.430195 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-a94aabcc-2006-4c1e-b458-4c6604e1e2ce tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:44:54.431313 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-a94aabcc-2006-4c1e-b458-4c6604e1e2ce tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:44:54.431918 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-a94aabcc-2006-4c1e-b458-4c6604e1e2ce tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:44:54.527501 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-e4e0ce12-cfb2-4b2b-a933-ea9cc7640d6e tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:44:54.536789 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-e4e0ce12-cfb2-4b2b-a933-ea9cc7640d6e tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:44:54.538839 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-e4e0ce12-cfb2-4b2b-a933-ea9cc7640d6e tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:44:54.540105 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-e4e0ce12-cfb2-4b2b-a933-ea9cc7640d6e tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] 10.222.0.66 "GET /compute/v2.1/servers/3bf41d49-2b84-4f59-a019-a8b1e45891d1" status: 200 len: 1739 microversion: 2.20 time: 0.221947 Aug 04 03:44:54.554239 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 308/615] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 03:44:54 2022] GET /compute/v2.1/servers/3bf41d49-2b84-4f59-a019-a8b1e45891d1 => generated 1739 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 03:44:54.607772 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-a94aabcc-2006-4c1e-b458-4c6604e1e2ce tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec8d131a9764028a096314a4ecd58f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9ff6952b014d0a9abb28dcf0b818b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:44:54.616506 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-a94aabcc-2006-4c1e-b458-4c6604e1e2ce tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] 10.222.0.66 "GET /compute/v2.1/servers/f69fd00d-cf45-4c17-aee5-701e87ebab82" status: 200 len: 1724 microversion: 2.1 time: 0.201035 Aug 04 03:44:54.617071 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 308/616] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:44:54 2022] GET /compute/v2.1/servers/f69fd00d-cf45-4c17-aee5-701e87ebab82 => generated 1724 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 03:44:55.564398 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-605c99f1-ddf8-424e-aed1-ee4e7f6f8750 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:44:55.564958 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-605c99f1-ddf8-424e-aed1-ee4e7f6f8750 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] [instance: 3bf41d49-2b84-4f59-a019-a8b1e45891d1] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:44:55.571437 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-605c99f1-ddf8-424e-aed1-ee4e7f6f8750 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:44:55.571879 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-605c99f1-ddf8-424e-aed1-ee4e7f6f8750 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:44:55.572628 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-605c99f1-ddf8-424e-aed1-ee4e7f6f8750 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:44:55.573058 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-605c99f1-ddf8-424e-aed1-ee4e7f6f8750 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:44:55.638803 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-2add4467-fb03-4aef-9e72-5a473071b5c5 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:44:55.639434 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-2add4467-fb03-4aef-9e72-5a473071b5c5 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] [instance: f69fd00d-cf45-4c17-aee5-701e87ebab82] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:44:55.646091 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-2add4467-fb03-4aef-9e72-5a473071b5c5 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:44:55.646539 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-2add4467-fb03-4aef-9e72-5a473071b5c5 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:44:55.647307 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-2add4467-fb03-4aef-9e72-5a473071b5c5 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:44:55.647742 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-2add4467-fb03-4aef-9e72-5a473071b5c5 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:44:55.739693 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-605c99f1-ddf8-424e-aed1-ee4e7f6f8750 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:44:55.747595 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-605c99f1-ddf8-424e-aed1-ee4e7f6f8750 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:44:55.749092 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-605c99f1-ddf8-424e-aed1-ee4e7f6f8750 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:44:55.750319 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-605c99f1-ddf8-424e-aed1-ee4e7f6f8750 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] 10.222.0.66 "GET /compute/v2.1/servers/3bf41d49-2b84-4f59-a019-a8b1e45891d1" status: 200 len: 1739 microversion: 2.20 time: 0.190047 Aug 04 03:44:55.750994 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 309/617] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 03:44:55 2022] GET /compute/v2.1/servers/3bf41d49-2b84-4f59-a019-a8b1e45891d1 => generated 1739 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 03:44:55.794255 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-2add4467-fb03-4aef-9e72-5a473071b5c5 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec8d131a9764028a096314a4ecd58f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9ff6952b014d0a9abb28dcf0b818b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:44:55.802850 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-2add4467-fb03-4aef-9e72-5a473071b5c5 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] 10.222.0.66 "GET /compute/v2.1/servers/f69fd00d-cf45-4c17-aee5-701e87ebab82" status: 200 len: 1724 microversion: 2.1 time: 0.167977 Aug 04 03:44:55.803400 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 309/618] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:44:55 2022] GET /compute/v2.1/servers/f69fd00d-cf45-4c17-aee5-701e87ebab82 => generated 1724 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 03:44:56.772824 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-3ca28b19-2df4-41f8-9d36-8557c16e82a8 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:44:56.773380 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-3ca28b19-2df4-41f8-9d36-8557c16e82a8 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] [instance: 3bf41d49-2b84-4f59-a019-a8b1e45891d1] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:44:56.779808 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-3ca28b19-2df4-41f8-9d36-8557c16e82a8 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:44:56.780256 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-3ca28b19-2df4-41f8-9d36-8557c16e82a8 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:44:56.781180 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-3ca28b19-2df4-41f8-9d36-8557c16e82a8 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:44:56.781655 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-3ca28b19-2df4-41f8-9d36-8557c16e82a8 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:44:56.823849 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-9ac7a564-7ccf-425b-8e78-410a0630f4f2 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:44:56.824459 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-9ac7a564-7ccf-425b-8e78-410a0630f4f2 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] [instance: f69fd00d-cf45-4c17-aee5-701e87ebab82] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:44:56.831198 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-9ac7a564-7ccf-425b-8e78-410a0630f4f2 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:44:56.831647 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-9ac7a564-7ccf-425b-8e78-410a0630f4f2 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:44:56.832412 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-9ac7a564-7ccf-425b-8e78-410a0630f4f2 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:44:56.832852 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-9ac7a564-7ccf-425b-8e78-410a0630f4f2 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:44:56.968138 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-3ca28b19-2df4-41f8-9d36-8557c16e82a8 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:44:56.976388 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-3ca28b19-2df4-41f8-9d36-8557c16e82a8 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:44:56.977916 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-3ca28b19-2df4-41f8-9d36-8557c16e82a8 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:44:56.979066 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-3ca28b19-2df4-41f8-9d36-8557c16e82a8 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] 10.222.0.66 "GET /compute/v2.1/servers/3bf41d49-2b84-4f59-a019-a8b1e45891d1" status: 200 len: 1739 microversion: 2.20 time: 0.210199 Aug 04 03:44:56.979625 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 310/619] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 03:44:56 2022] GET /compute/v2.1/servers/3bf41d49-2b84-4f59-a019-a8b1e45891d1 => generated 1739 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 03:44:56.994571 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-9ac7a564-7ccf-425b-8e78-410a0630f4f2 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec8d131a9764028a096314a4ecd58f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9ff6952b014d0a9abb28dcf0b818b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:44:57.003300 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-9ac7a564-7ccf-425b-8e78-410a0630f4f2 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] 10.222.0.66 "GET /compute/v2.1/servers/f69fd00d-cf45-4c17-aee5-701e87ebab82" status: 200 len: 1724 microversion: 2.1 time: 0.183285 Aug 04 03:44:57.003887 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 310/620] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:44:56 2022] GET /compute/v2.1/servers/f69fd00d-cf45-4c17-aee5-701e87ebab82 => generated 1724 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 03:44:58.002233 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-17c30f21-49ef-49c4-bd5a-98a03dd14585 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:44:58.002830 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-17c30f21-49ef-49c4-bd5a-98a03dd14585 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] [instance: 3bf41d49-2b84-4f59-a019-a8b1e45891d1] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:44:58.009411 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-17c30f21-49ef-49c4-bd5a-98a03dd14585 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:44:58.009872 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-17c30f21-49ef-49c4-bd5a-98a03dd14585 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:44:58.010640 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-17c30f21-49ef-49c4-bd5a-98a03dd14585 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:44:58.011080 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-17c30f21-49ef-49c4-bd5a-98a03dd14585 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:44:58.023879 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-bae5d6cd-78f6-4c56-9ba7-d146a83352b8 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:44:58.024875 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-bae5d6cd-78f6-4c56-9ba7-d146a83352b8 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] [instance: f69fd00d-cf45-4c17-aee5-701e87ebab82] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:44:58.032248 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-bae5d6cd-78f6-4c56-9ba7-d146a83352b8 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:44:58.032705 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-bae5d6cd-78f6-4c56-9ba7-d146a83352b8 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:44:58.033631 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-bae5d6cd-78f6-4c56-9ba7-d146a83352b8 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:44:58.034064 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-bae5d6cd-78f6-4c56-9ba7-d146a83352b8 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:44:58.215189 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-17c30f21-49ef-49c4-bd5a-98a03dd14585 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:44:58.224356 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-17c30f21-49ef-49c4-bd5a-98a03dd14585 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:44:58.226008 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-17c30f21-49ef-49c4-bd5a-98a03dd14585 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:44:58.227252 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-17c30f21-49ef-49c4-bd5a-98a03dd14585 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] 10.222.0.66 "GET /compute/v2.1/servers/3bf41d49-2b84-4f59-a019-a8b1e45891d1" status: 200 len: 1721 microversion: 2.20 time: 0.228967 Aug 04 03:44:58.228178 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 311/621] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 03:44:57 2022] GET /compute/v2.1/servers/3bf41d49-2b84-4f59-a019-a8b1e45891d1 => generated 1721 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 03:44:58.233687 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-bae5d6cd-78f6-4c56-9ba7-d146a83352b8 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec8d131a9764028a096314a4ecd58f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9ff6952b014d0a9abb28dcf0b818b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:44:58.241809 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-bae5d6cd-78f6-4c56-9ba7-d146a83352b8 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] 10.222.0.66 "GET /compute/v2.1/servers/f69fd00d-cf45-4c17-aee5-701e87ebab82" status: 200 len: 1730 microversion: 2.1 time: 0.221707 Aug 04 03:44:58.242651 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 311/622] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:44:58 2022] GET /compute/v2.1/servers/f69fd00d-cf45-4c17-aee5-701e87ebab82 => generated 1730 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 03:44:58.261871 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-46ce777f-516a-419c-ac31-f81006421bff tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:44:58.262367 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-46ce777f-516a-419c-ac31-f81006421bff tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] [instance: f69fd00d-cf45-4c17-aee5-701e87ebab82] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:44:58.268892 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-46ce777f-516a-419c-ac31-f81006421bff tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:44:58.269434 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-46ce777f-516a-419c-ac31-f81006421bff tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:44:58.270144 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-46ce777f-516a-419c-ac31-f81006421bff tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:44:58.270579 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-46ce777f-516a-419c-ac31-f81006421bff tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:44:58.287220 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG dbcounter [-] [130263] Writing DB stats nova_cell1:SELECT=100 {{(pid=130263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:44:58.349847 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-46ce777f-516a-419c-ac31-f81006421bff tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] 10.222.0.66 "GET /compute/v2.1/servers/f69fd00d-cf45-4c17-aee5-701e87ebab82/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.091703 Aug 04 03:44:58.350636 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 312/623] 10.222.0.66 () {58 vars in 1275 bytes} [Thu Aug 4 03:44:58 2022] GET /compute/v2.1/servers/f69fd00d-cf45-4c17-aee5-701e87ebab82/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 03:44:59.252877 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-25bc18fc-b90a-45b3-908e-0651222dc436 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:44:59.252877 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-25bc18fc-b90a-45b3-908e-0651222dc436 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] [instance: 3bf41d49-2b84-4f59-a019-a8b1e45891d1] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:44:59.258587 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-25bc18fc-b90a-45b3-908e-0651222dc436 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:44:59.259261 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-25bc18fc-b90a-45b3-908e-0651222dc436 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:44:59.260215 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-25bc18fc-b90a-45b3-908e-0651222dc436 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:44:59.260809 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-25bc18fc-b90a-45b3-908e-0651222dc436 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:44:59.298867 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-13897471-74ea-4adf-8a2b-6d07594952c8 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:44:59.299363 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-13897471-74ea-4adf-8a2b-6d07594952c8 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] [instance: 9307fdad-ca63-449d-bc5c-7e9e167c59f3] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:44:59.305721 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-13897471-74ea-4adf-8a2b-6d07594952c8 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:44:59.306163 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-13897471-74ea-4adf-8a2b-6d07594952c8 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:44:59.306928 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-13897471-74ea-4adf-8a2b-6d07594952c8 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:44:59.307380 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-13897471-74ea-4adf-8a2b-6d07594952c8 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:44:59.370856 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG dbcounter [-] [130262] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:44:59.405729 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-25bc18fc-b90a-45b3-908e-0651222dc436 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:44:59.415335 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-25bc18fc-b90a-45b3-908e-0651222dc436 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:44:59.416886 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-25bc18fc-b90a-45b3-908e-0651222dc436 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:44:59.418203 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-25bc18fc-b90a-45b3-908e-0651222dc436 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] 10.222.0.66 "GET /compute/v2.1/servers/3bf41d49-2b84-4f59-a019-a8b1e45891d1" status: 200 len: 1721 microversion: 2.20 time: 0.171035 Aug 04 03:44:59.419083 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 313/624] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 03:44:59 2022] GET /compute/v2.1/servers/3bf41d49-2b84-4f59-a019-a8b1e45891d1 => generated 1721 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 03:44:59.450544 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.objects.instance [None req-13897471-74ea-4adf-8a2b-6d07594952c8 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lazy-loading 'services' on Instance uuid 9307fdad-ca63-449d-bc5c-7e9e167c59f3 {{(pid=130262) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 03:44:59.495852 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [req-ede9bd0c-9bec-44f9-810e-6992d6499873 req-ed7fc6a8-5868-4523-9679-6f04f76552bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f69fd00d-cf45-4c17-aee5-701e87ebab82", "tag": "792bb385-f4d3-479d-9f3d-2a0bf239cd0d"}]} {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 03:44:59.505743 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [req-ede9bd0c-9bec-44f9-810e-6992d6499873 req-ed7fc6a8-5868-4523-9679-6f04f76552bd service nova] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:44:59.506183 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [req-ede9bd0c-9bec-44f9-810e-6992d6499873 req-ed7fc6a8-5868-4523-9679-6f04f76552bd service nova] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:44:59.518147 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.compute.server_external_events [req-ede9bd0c-9bec-44f9-810e-6992d6499873 req-ed7fc6a8-5868-4523-9679-6f04f76552bd service nova] Creating event network-changed:792bb385-f4d3-479d-9f3d-2a0bf239cd0d for instance f69fd00d-cf45-4c17-aee5-701e87ebab82 on hv-cinder-73306 Aug 04 03:44:59.524049 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [req-ede9bd0c-9bec-44f9-810e-6992d6499873 req-ed7fc6a8-5868-4523-9679-6f04f76552bd service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103822 Aug 04 03:44:59.524919 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 314/625] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 03:44:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 03:44:59.693502 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-13897471-74ea-4adf-8a2b-6d07594952c8 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] 10.222.0.66 "DELETE /compute/v2.1/servers/9307fdad-ca63-449d-bc5c-7e9e167c59f3/os-volume_attachments/ff8d3adf-354f-45f6-a2ff-b14f5d78662f" status: 202 len: 0 microversion: 2.1 time: 0.525537 Aug 04 03:44:59.694026 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 312/626] 10.222.0.66 () {58 vars in 1416 bytes} [Thu Aug 4 03:44:59 2022] DELETE /compute/v2.1/servers/9307fdad-ca63-449d-bc5c-7e9e167c59f3/os-volume_attachments/ff8d3adf-354f-45f6-a2ff-b14f5d78662f => generated 0 bytes in 527 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 03:45:00.134326 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [req-31b20198-d6ef-4b3d-833c-7e167d844788 req-22b330d9-da62-4d9b-9f54-3b168227491c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3bf41d49-2b84-4f59-a019-a8b1e45891d1", "name": "network-vif-unplugged", "status": "completed", "tag": "8144b5cf-3a6c-452a-a3bb-81896a2ba4e0"}]} {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 03:45:00.159115 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [req-31b20198-d6ef-4b3d-833c-7e167d844788 req-22b330d9-da62-4d9b-9f54-3b168227491c service nova] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:45:00.164239 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [req-31b20198-d6ef-4b3d-833c-7e167d844788 req-22b330d9-da62-4d9b-9f54-3b168227491c service nova] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:45:00.184304 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.compute.server_external_events [req-31b20198-d6ef-4b3d-833c-7e167d844788 req-22b330d9-da62-4d9b-9f54-3b168227491c service nova] Creating event network-vif-unplugged:8144b5cf-3a6c-452a-a3bb-81896a2ba4e0 for instance 3bf41d49-2b84-4f59-a019-a8b1e45891d1 on hv-cinder-73306 Aug 04 03:45:00.192574 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [req-31b20198-d6ef-4b3d-833c-7e167d844788 req-22b330d9-da62-4d9b-9f54-3b168227491c service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.167438 Aug 04 03:45:00.193352 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 315/627] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 03:45:00 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 03:45:00.445076 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-2f2664aa-6e5a-474e-a7eb-1cd110cbf9d8 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:45:00.445814 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-2f2664aa-6e5a-474e-a7eb-1cd110cbf9d8 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] [instance: 3bf41d49-2b84-4f59-a019-a8b1e45891d1] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:45:00.452490 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-2f2664aa-6e5a-474e-a7eb-1cd110cbf9d8 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:45:00.453005 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-2f2664aa-6e5a-474e-a7eb-1cd110cbf9d8 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:45:00.453945 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-2f2664aa-6e5a-474e-a7eb-1cd110cbf9d8 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:45:00.454385 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-2f2664aa-6e5a-474e-a7eb-1cd110cbf9d8 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:45:00.581659 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-2f2664aa-6e5a-474e-a7eb-1cd110cbf9d8 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:45:00.589714 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-2f2664aa-6e5a-474e-a7eb-1cd110cbf9d8 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:45:00.591223 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-2f2664aa-6e5a-474e-a7eb-1cd110cbf9d8 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:45:00.592384 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-2f2664aa-6e5a-474e-a7eb-1cd110cbf9d8 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] 10.222.0.66 "GET /compute/v2.1/servers/3bf41d49-2b84-4f59-a019-a8b1e45891d1" status: 200 len: 1721 microversion: 2.20 time: 0.152075 Aug 04 03:45:00.592930 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 313/628] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 03:45:00 2022] GET /compute/v2.1/servers/3bf41d49-2b84-4f59-a019-a8b1e45891d1 => generated 1721 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 03:45:01.540064 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [req-5f0a787a-2d14-4246-ba67-fb19d16b09a3 req-08629cb4-59ad-4d83-8c86-24d1bfb75ce6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f69fd00d-cf45-4c17-aee5-701e87ebab82", "tag": "792bb385-f4d3-479d-9f3d-2a0bf239cd0d"}]} {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 03:45:01.549867 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [req-5f0a787a-2d14-4246-ba67-fb19d16b09a3 req-08629cb4-59ad-4d83-8c86-24d1bfb75ce6 service nova] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:45:01.552754 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [req-5f0a787a-2d14-4246-ba67-fb19d16b09a3 req-08629cb4-59ad-4d83-8c86-24d1bfb75ce6 service nova] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:45:01.560840 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.compute.server_external_events [req-5f0a787a-2d14-4246-ba67-fb19d16b09a3 req-08629cb4-59ad-4d83-8c86-24d1bfb75ce6 service nova] Creating event network-changed:792bb385-f4d3-479d-9f3d-2a0bf239cd0d for instance f69fd00d-cf45-4c17-aee5-701e87ebab82 on hv-cinder-73306 Aug 04 03:45:01.566432 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [req-5f0a787a-2d14-4246-ba67-fb19d16b09a3 req-08629cb4-59ad-4d83-8c86-24d1bfb75ce6 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030832 Aug 04 03:45:01.567078 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 316/629] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 03:45:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 03:45:01.616114 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-59811c5e-920d-42c7-bbce-9c2556f1b01e tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:45:01.616717 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-59811c5e-920d-42c7-bbce-9c2556f1b01e tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] [instance: 3bf41d49-2b84-4f59-a019-a8b1e45891d1] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:45:01.623347 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-59811c5e-920d-42c7-bbce-9c2556f1b01e tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:45:01.623792 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-59811c5e-920d-42c7-bbce-9c2556f1b01e tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:45:01.625053 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-59811c5e-920d-42c7-bbce-9c2556f1b01e tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:45:01.625595 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-59811c5e-920d-42c7-bbce-9c2556f1b01e tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:45:01.758520 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-59811c5e-920d-42c7-bbce-9c2556f1b01e tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:45:01.767214 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-59811c5e-920d-42c7-bbce-9c2556f1b01e tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:45:01.768742 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-59811c5e-920d-42c7-bbce-9c2556f1b01e tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:45:01.769973 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-59811c5e-920d-42c7-bbce-9c2556f1b01e tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] 10.222.0.66 "GET /compute/v2.1/servers/3bf41d49-2b84-4f59-a019-a8b1e45891d1" status: 200 len: 1664 microversion: 2.20 time: 0.158024 Aug 04 03:45:01.770543 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 314/630] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 03:45:01 2022] GET /compute/v2.1/servers/3bf41d49-2b84-4f59-a019-a8b1e45891d1 => generated 1664 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 03:45:01.792672 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-4a2c3e32-377c-46e8-a59f-e23f345da400 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "328f29a4-6989-4599-bb6d-555e7f797c3c"}} {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 03:45:01.795088 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-4a2c3e32-377c-46e8-a59f-e23f345da400 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] [instance: 3bf41d49-2b84-4f59-a019-a8b1e45891d1] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:45:01.801539 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-4a2c3e32-377c-46e8-a59f-e23f345da400 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:45:01.802020 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-4a2c3e32-377c-46e8-a59f-e23f345da400 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:45:01.802787 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-4a2c3e32-377c-46e8-a59f-e23f345da400 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:45:01.803231 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-4a2c3e32-377c-46e8-a59f-e23f345da400 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:45:01.885577 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-ea8bbf76-15dd-4f69-9bc6-229ea38eee09 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 03:45:01.893705 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-ea8bbf76-15dd-4f69-9bc6-229ea38eee09 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:45:01.894216 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-ea8bbf76-15dd-4f69-9bc6-229ea38eee09 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:45:01.917455 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-ea8bbf76-15dd-4f69-9bc6-229ea38eee09 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] [instance: 9307fdad-ca63-449d-bc5c-7e9e167c59f3] Going to try to stop instance {{(pid=130262) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 04 03:45:02.098349 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-ea8bbf76-15dd-4f69-9bc6-229ea38eee09 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] 10.222.0.66 "POST /compute/v2.1/servers/9307fdad-ca63-449d-bc5c-7e9e167c59f3/action" status: 202 len: 0 microversion: 2.1 time: 0.218138 Aug 04 03:45:02.098962 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 315/631] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 03:45:01 2022] POST /compute/v2.1/servers/9307fdad-ca63-449d-bc5c-7e9e167c59f3/action => generated 0 bytes in 220 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 03:45:02.109105 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-37a3d01d-261e-4157-9833-bfc60358ed19 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:45:02.110461 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-37a3d01d-261e-4157-9833-bfc60358ed19 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] [instance: 9307fdad-ca63-449d-bc5c-7e9e167c59f3] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:45:02.117951 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-37a3d01d-261e-4157-9833-bfc60358ed19 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:45:02.118397 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-37a3d01d-261e-4157-9833-bfc60358ed19 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:45:02.119158 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-37a3d01d-261e-4157-9833-bfc60358ed19 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:45:02.119588 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-37a3d01d-261e-4157-9833-bfc60358ed19 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:45:02.255700 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-37a3d01d-261e-4157-9833-bfc60358ed19 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dba436d0a67433f8c8ae7cd40d3f795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46b8dc64007429b805971d4c6f5b471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:45:02.263329 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-37a3d01d-261e-4157-9833-bfc60358ed19 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] 10.222.0.66 "GET /compute/v2.1/servers/9307fdad-ca63-449d-bc5c-7e9e167c59f3" status: 200 len: 1675 microversion: 2.1 time: 0.159976 Aug 04 03:45:02.263895 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 316/632] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:45:02 2022] GET /compute/v2.1/servers/9307fdad-ca63-449d-bc5c-7e9e167c59f3 => generated 1675 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 03:45:02.864990 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-4a2c3e32-377c-46e8-a59f-e23f345da400 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] 10.222.0.66 "POST /compute/v2.1/servers/3bf41d49-2b84-4f59-a019-a8b1e45891d1/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.076557 Aug 04 03:45:02.865704 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 317/633] 10.222.0.66 () {62 vars in 1364 bytes} [Thu Aug 4 03:45:01 2022] POST /compute/v2.1/servers/3bf41d49-2b84-4f59-a019-a8b1e45891d1/os-volume_attachments => generated 188 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 03:45:02.987477 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-4d02b2e8-110b-40d6-b7e5-29a6577df7ea tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 03:45:02.988065 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-4d02b2e8-110b-40d6-b7e5-29a6577df7ea tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] [instance: 3bf41d49-2b84-4f59-a019-a8b1e45891d1] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:45:02.994435 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-4d02b2e8-110b-40d6-b7e5-29a6577df7ea tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:45:02.994883 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-4d02b2e8-110b-40d6-b7e5-29a6577df7ea tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:45:02.995637 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-4d02b2e8-110b-40d6-b7e5-29a6577df7ea tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:45:02.996094 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-4d02b2e8-110b-40d6-b7e5-29a6577df7ea tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:45:03.080397 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-4d02b2e8-110b-40d6-b7e5-29a6577df7ea tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] [instance: 3bf41d49-2b84-4f59-a019-a8b1e45891d1] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=130262) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 04 03:45:03.285706 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-35261081-f54a-45f5-8e0a-e5635b4fd214 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:45:03.286320 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-35261081-f54a-45f5-8e0a-e5635b4fd214 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] [instance: 9307fdad-ca63-449d-bc5c-7e9e167c59f3] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:45:03.292420 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-35261081-f54a-45f5-8e0a-e5635b4fd214 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:45:03.294942 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-35261081-f54a-45f5-8e0a-e5635b4fd214 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:45:03.294942 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-35261081-f54a-45f5-8e0a-e5635b4fd214 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:45:03.294942 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-35261081-f54a-45f5-8e0a-e5635b4fd214 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:45:03.324573 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-4d02b2e8-110b-40d6-b7e5-29a6577df7ea tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] 10.222.0.66 "POST /compute/v2.1/servers/3bf41d49-2b84-4f59-a019-a8b1e45891d1/action" status: 202 len: 0 microversion: 2.20 time: 0.341126 Aug 04 03:45:03.329323 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 317/634] 10.222.0.66 () {62 vars in 1319 bytes} [Thu Aug 4 03:45:02 2022] POST /compute/v2.1/servers/3bf41d49-2b84-4f59-a019-a8b1e45891d1/action => generated 0 bytes in 346 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 04 03:45:03.334298 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-1baa12f9-1aa1-40ac-9b48-01d77e5a64e7 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:45:03.334905 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-1baa12f9-1aa1-40ac-9b48-01d77e5a64e7 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] [instance: 3bf41d49-2b84-4f59-a019-a8b1e45891d1] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:45:03.341051 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-1baa12f9-1aa1-40ac-9b48-01d77e5a64e7 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:45:03.341554 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-1baa12f9-1aa1-40ac-9b48-01d77e5a64e7 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:45:03.342325 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-1baa12f9-1aa1-40ac-9b48-01d77e5a64e7 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:45:03.342760 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-1baa12f9-1aa1-40ac-9b48-01d77e5a64e7 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:45:03.699713 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-35261081-f54a-45f5-8e0a-e5635b4fd214 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dba436d0a67433f8c8ae7cd40d3f795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46b8dc64007429b805971d4c6f5b471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:45:03.708031 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-35261081-f54a-45f5-8e0a-e5635b4fd214 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] 10.222.0.66 "GET /compute/v2.1/servers/9307fdad-ca63-449d-bc5c-7e9e167c59f3" status: 200 len: 1675 microversion: 2.1 time: 0.426081 Aug 04 03:45:03.708599 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 318/635] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:45:03 2022] GET /compute/v2.1/servers/9307fdad-ca63-449d-bc5c-7e9e167c59f3 => generated 1675 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 03:45:03.727309 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-1baa12f9-1aa1-40ac-9b48-01d77e5a64e7 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:45:03.735929 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-1baa12f9-1aa1-40ac-9b48-01d77e5a64e7 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:45:03.737448 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-1baa12f9-1aa1-40ac-9b48-01d77e5a64e7 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:45:03.738601 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-1baa12f9-1aa1-40ac-9b48-01d77e5a64e7 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] 10.222.0.66 "GET /compute/v2.1/servers/3bf41d49-2b84-4f59-a019-a8b1e45891d1" status: 200 len: 1750 microversion: 2.20 time: 0.408290 Aug 04 03:45:03.739151 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 318/636] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 03:45:03 2022] GET /compute/v2.1/servers/3bf41d49-2b84-4f59-a019-a8b1e45891d1 => generated 1750 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 03:45:04.729442 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-1bace031-ff3f-4c7b-a528-21851051282a tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:45:04.730033 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-1bace031-ff3f-4c7b-a528-21851051282a tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] [instance: 9307fdad-ca63-449d-bc5c-7e9e167c59f3] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:45:04.737641 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-1bace031-ff3f-4c7b-a528-21851051282a tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:45:04.738085 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-1bace031-ff3f-4c7b-a528-21851051282a tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:45:04.738834 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-1bace031-ff3f-4c7b-a528-21851051282a tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:45:04.739268 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-1bace031-ff3f-4c7b-a528-21851051282a tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:45:04.761111 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-23b84697-d297-4be7-8b3b-a9be93d4072f tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:45:04.761771 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-23b84697-d297-4be7-8b3b-a9be93d4072f tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] [instance: 3bf41d49-2b84-4f59-a019-a8b1e45891d1] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:45:04.768181 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-23b84697-d297-4be7-8b3b-a9be93d4072f tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:45:04.768629 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-23b84697-d297-4be7-8b3b-a9be93d4072f tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:45:04.769419 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-23b84697-d297-4be7-8b3b-a9be93d4072f tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:45:04.769858 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-23b84697-d297-4be7-8b3b-a9be93d4072f tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:45:04.926098 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-1bace031-ff3f-4c7b-a528-21851051282a tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dba436d0a67433f8c8ae7cd40d3f795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46b8dc64007429b805971d4c6f5b471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:45:04.934640 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-1bace031-ff3f-4c7b-a528-21851051282a tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] 10.222.0.66 "GET /compute/v2.1/servers/9307fdad-ca63-449d-bc5c-7e9e167c59f3" status: 200 len: 1675 microversion: 2.1 time: 0.209155 Aug 04 03:45:04.935207 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 319/637] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:45:04 2022] GET /compute/v2.1/servers/9307fdad-ca63-449d-bc5c-7e9e167c59f3 => generated 1675 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:45:04.952392 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-23b84697-d297-4be7-8b3b-a9be93d4072f tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:45:04.961925 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-23b84697-d297-4be7-8b3b-a9be93d4072f tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:45:04.963405 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-23b84697-d297-4be7-8b3b-a9be93d4072f tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:45:04.964555 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-23b84697-d297-4be7-8b3b-a9be93d4072f tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] 10.222.0.66 "GET /compute/v2.1/servers/3bf41d49-2b84-4f59-a019-a8b1e45891d1" status: 200 len: 1750 microversion: 2.20 time: 0.207304 Aug 04 03:45:04.965098 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 319/638] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 03:45:04 2022] GET /compute/v2.1/servers/3bf41d49-2b84-4f59-a019-a8b1e45891d1 => generated 1750 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 03:45:05.960956 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-ad76abdd-b59a-4d82-a38e-880fcb220482 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:45:05.961591 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-ad76abdd-b59a-4d82-a38e-880fcb220482 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] [instance: 9307fdad-ca63-449d-bc5c-7e9e167c59f3] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:45:05.969295 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-ad76abdd-b59a-4d82-a38e-880fcb220482 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:45:05.969749 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-ad76abdd-b59a-4d82-a38e-880fcb220482 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:45:05.970549 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-ad76abdd-b59a-4d82-a38e-880fcb220482 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:45:05.970987 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-ad76abdd-b59a-4d82-a38e-880fcb220482 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:45:05.991225 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-8e376be6-55e2-4dde-8780-d19bd61a94ae tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:45:05.992101 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-8e376be6-55e2-4dde-8780-d19bd61a94ae tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] [instance: 3bf41d49-2b84-4f59-a019-a8b1e45891d1] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:45:05.999497 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-8e376be6-55e2-4dde-8780-d19bd61a94ae tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:45:06.000652 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-8e376be6-55e2-4dde-8780-d19bd61a94ae tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:45:06.001569 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-8e376be6-55e2-4dde-8780-d19bd61a94ae tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:45:06.002148 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-8e376be6-55e2-4dde-8780-d19bd61a94ae tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:45:06.169226 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-ad76abdd-b59a-4d82-a38e-880fcb220482 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dba436d0a67433f8c8ae7cd40d3f795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46b8dc64007429b805971d4c6f5b471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:45:06.177088 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-ad76abdd-b59a-4d82-a38e-880fcb220482 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] 10.222.0.66 "GET /compute/v2.1/servers/9307fdad-ca63-449d-bc5c-7e9e167c59f3" status: 200 len: 1675 microversion: 2.1 time: 0.219929 Aug 04 03:45:06.177702 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 320/639] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:45:05 2022] GET /compute/v2.1/servers/9307fdad-ca63-449d-bc5c-7e9e167c59f3 => generated 1675 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:45:06.183118 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-8e376be6-55e2-4dde-8780-d19bd61a94ae tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:45:06.192391 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-8e376be6-55e2-4dde-8780-d19bd61a94ae tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:45:06.193942 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-8e376be6-55e2-4dde-8780-d19bd61a94ae tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:45:06.195104 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-8e376be6-55e2-4dde-8780-d19bd61a94ae tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] 10.222.0.66 "GET /compute/v2.1/servers/3bf41d49-2b84-4f59-a019-a8b1e45891d1" status: 200 len: 1752 microversion: 2.20 time: 0.209493 Aug 04 03:45:06.195644 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 320/640] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 03:45:05 2022] GET /compute/v2.1/servers/3bf41d49-2b84-4f59-a019-a8b1e45891d1 => generated 1752 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 03:45:07.199231 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-a7c54434-280e-4ef6-a2ee-7e5f8411d841 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:45:07.199775 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-a7c54434-280e-4ef6-a2ee-7e5f8411d841 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] [instance: 9307fdad-ca63-449d-bc5c-7e9e167c59f3] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:45:07.206780 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-a7c54434-280e-4ef6-a2ee-7e5f8411d841 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:45:07.207259 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-a7c54434-280e-4ef6-a2ee-7e5f8411d841 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:45:07.208024 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-a7c54434-280e-4ef6-a2ee-7e5f8411d841 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:45:07.208458 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-a7c54434-280e-4ef6-a2ee-7e5f8411d841 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:45:07.223684 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-db52bcae-51d9-40f9-af2c-cd63dd838c23 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:45:07.224291 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-db52bcae-51d9-40f9-af2c-cd63dd838c23 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] [instance: 3bf41d49-2b84-4f59-a019-a8b1e45891d1] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:45:07.231794 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-db52bcae-51d9-40f9-af2c-cd63dd838c23 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:45:07.232256 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-db52bcae-51d9-40f9-af2c-cd63dd838c23 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:45:07.233032 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-db52bcae-51d9-40f9-af2c-cd63dd838c23 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:45:07.233908 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-db52bcae-51d9-40f9-af2c-cd63dd838c23 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:45:07.416789 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-a7c54434-280e-4ef6-a2ee-7e5f8411d841 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dba436d0a67433f8c8ae7cd40d3f795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46b8dc64007429b805971d4c6f5b471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:45:07.420767 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-db52bcae-51d9-40f9-af2c-cd63dd838c23 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:45:07.425570 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-a7c54434-280e-4ef6-a2ee-7e5f8411d841 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] 10.222.0.66 "GET /compute/v2.1/servers/9307fdad-ca63-449d-bc5c-7e9e167c59f3" status: 200 len: 1675 microversion: 2.1 time: 0.230362 Aug 04 03:45:07.426411 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 321/641] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:45:07 2022] GET /compute/v2.1/servers/9307fdad-ca63-449d-bc5c-7e9e167c59f3 => generated 1675 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:45:07.429469 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-db52bcae-51d9-40f9-af2c-cd63dd838c23 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:45:07.431210 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-db52bcae-51d9-40f9-af2c-cd63dd838c23 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:45:07.432372 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-db52bcae-51d9-40f9-af2c-cd63dd838c23 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] 10.222.0.66 "GET /compute/v2.1/servers/3bf41d49-2b84-4f59-a019-a8b1e45891d1" status: 200 len: 1808 microversion: 2.20 time: 0.212533 Aug 04 03:45:07.432948 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 321/642] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 03:45:07 2022] GET /compute/v2.1/servers/3bf41d49-2b84-4f59-a019-a8b1e45891d1 => generated 1808 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 03:45:08.446909 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-c406e7d2-dea5-4b48-b4af-c6a012e406d6 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:45:08.447448 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-c406e7d2-dea5-4b48-b4af-c6a012e406d6 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] [instance: 9307fdad-ca63-449d-bc5c-7e9e167c59f3] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:45:08.454071 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-c406e7d2-dea5-4b48-b4af-c6a012e406d6 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:45:08.454524 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-c406e7d2-dea5-4b48-b4af-c6a012e406d6 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:45:08.454704 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-6801fbc4-21bd-48d8-b161-864823c38256 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:45:08.455242 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-6801fbc4-21bd-48d8-b161-864823c38256 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] [instance: 3bf41d49-2b84-4f59-a019-a8b1e45891d1] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:45:08.455355 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-c406e7d2-dea5-4b48-b4af-c6a012e406d6 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:45:08.455715 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-c406e7d2-dea5-4b48-b4af-c6a012e406d6 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:45:08.461557 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-6801fbc4-21bd-48d8-b161-864823c38256 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:45:08.462001 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-6801fbc4-21bd-48d8-b161-864823c38256 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:45:08.462752 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-6801fbc4-21bd-48d8-b161-864823c38256 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:45:08.463179 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-6801fbc4-21bd-48d8-b161-864823c38256 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:45:08.657546 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-6801fbc4-21bd-48d8-b161-864823c38256 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:45:08.666306 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-6801fbc4-21bd-48d8-b161-864823c38256 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:45:08.667785 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-6801fbc4-21bd-48d8-b161-864823c38256 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:45:08.668924 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-6801fbc4-21bd-48d8-b161-864823c38256 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] 10.222.0.66 "GET /compute/v2.1/servers/3bf41d49-2b84-4f59-a019-a8b1e45891d1" status: 200 len: 1808 microversion: 2.20 time: 0.218077 Aug 04 03:45:08.669841 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 322/643] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 03:45:08 2022] GET /compute/v2.1/servers/3bf41d49-2b84-4f59-a019-a8b1e45891d1 => generated 1808 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 03:45:08.679589 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-c406e7d2-dea5-4b48-b4af-c6a012e406d6 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dba436d0a67433f8c8ae7cd40d3f795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46b8dc64007429b805971d4c6f5b471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:45:08.687202 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-c406e7d2-dea5-4b48-b4af-c6a012e406d6 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] 10.222.0.66 "GET /compute/v2.1/servers/9307fdad-ca63-449d-bc5c-7e9e167c59f3" status: 200 len: 1675 microversion: 2.1 time: 0.244377 Aug 04 03:45:08.687822 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 322/644] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:45:08 2022] GET /compute/v2.1/servers/9307fdad-ca63-449d-bc5c-7e9e167c59f3 => generated 1675 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:45:09.695459 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-daea18d3-117c-4721-b054-c055979c41e5 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:45:09.696062 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-daea18d3-117c-4721-b054-c055979c41e5 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] [instance: 3bf41d49-2b84-4f59-a019-a8b1e45891d1] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:45:09.704185 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-daea18d3-117c-4721-b054-c055979c41e5 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:45:09.704649 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-daea18d3-117c-4721-b054-c055979c41e5 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:45:09.705456 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-daea18d3-117c-4721-b054-c055979c41e5 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:45:09.705893 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-daea18d3-117c-4721-b054-c055979c41e5 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:45:09.708058 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-1784cf8a-6200-41ce-bd53-22dfd626be48 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:45:09.708985 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-1784cf8a-6200-41ce-bd53-22dfd626be48 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] [instance: 9307fdad-ca63-449d-bc5c-7e9e167c59f3] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:45:09.716934 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-1784cf8a-6200-41ce-bd53-22dfd626be48 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:45:09.717423 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-1784cf8a-6200-41ce-bd53-22dfd626be48 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:45:09.718204 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-1784cf8a-6200-41ce-bd53-22dfd626be48 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:45:09.718639 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-1784cf8a-6200-41ce-bd53-22dfd626be48 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:45:09.920273 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-daea18d3-117c-4721-b054-c055979c41e5 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:45:09.929311 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-daea18d3-117c-4721-b054-c055979c41e5 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:45:09.930819 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-daea18d3-117c-4721-b054-c055979c41e5 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:45:09.931984 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-daea18d3-117c-4721-b054-c055979c41e5 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] 10.222.0.66 "GET /compute/v2.1/servers/3bf41d49-2b84-4f59-a019-a8b1e45891d1" status: 200 len: 1808 microversion: 2.20 time: 0.242837 Aug 04 03:45:09.932730 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 323/645] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 03:45:09 2022] GET /compute/v2.1/servers/3bf41d49-2b84-4f59-a019-a8b1e45891d1 => generated 1808 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 03:45:09.934353 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-1784cf8a-6200-41ce-bd53-22dfd626be48 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dba436d0a67433f8c8ae7cd40d3f795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46b8dc64007429b805971d4c6f5b471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:45:09.943250 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-1784cf8a-6200-41ce-bd53-22dfd626be48 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] 10.222.0.66 "GET /compute/v2.1/servers/9307fdad-ca63-449d-bc5c-7e9e167c59f3" status: 200 len: 1675 microversion: 2.1 time: 0.239257 Aug 04 03:45:09.944898 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 323/646] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:45:09 2022] GET /compute/v2.1/servers/9307fdad-ca63-449d-bc5c-7e9e167c59f3 => generated 1675 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 03:45:10.955933 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-fc78bbe0-5b73-416b-b058-6a49054d8c8a tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:45:10.956538 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-fc78bbe0-5b73-416b-b058-6a49054d8c8a tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] [instance: 3bf41d49-2b84-4f59-a019-a8b1e45891d1] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:45:10.963662 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-fc78bbe0-5b73-416b-b058-6a49054d8c8a tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:45:10.963832 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-38af14cb-37ea-4fc0-856e-94a90ff5ccb1 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:45:10.964252 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-fc78bbe0-5b73-416b-b058-6a49054d8c8a tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:45:10.964348 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-38af14cb-37ea-4fc0-856e-94a90ff5ccb1 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] [instance: 9307fdad-ca63-449d-bc5c-7e9e167c59f3] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:45:10.964863 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-fc78bbe0-5b73-416b-b058-6a49054d8c8a tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:45:10.965330 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-fc78bbe0-5b73-416b-b058-6a49054d8c8a tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:45:10.973321 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-38af14cb-37ea-4fc0-856e-94a90ff5ccb1 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:45:10.973775 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-38af14cb-37ea-4fc0-856e-94a90ff5ccb1 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:45:10.974602 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-38af14cb-37ea-4fc0-856e-94a90ff5ccb1 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:45:10.974968 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-38af14cb-37ea-4fc0-856e-94a90ff5ccb1 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:45:11.151472 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-fc78bbe0-5b73-416b-b058-6a49054d8c8a tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:45:11.161516 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-fc78bbe0-5b73-416b-b058-6a49054d8c8a tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:45:11.163024 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-fc78bbe0-5b73-416b-b058-6a49054d8c8a tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:45:11.164200 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-fc78bbe0-5b73-416b-b058-6a49054d8c8a tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] 10.222.0.66 "GET /compute/v2.1/servers/3bf41d49-2b84-4f59-a019-a8b1e45891d1" status: 200 len: 1808 microversion: 2.20 time: 0.212655 Aug 04 03:45:11.164751 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 324/647] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 03:45:10 2022] GET /compute/v2.1/servers/3bf41d49-2b84-4f59-a019-a8b1e45891d1 => generated 1808 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 03:45:11.190465 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-38af14cb-37ea-4fc0-856e-94a90ff5ccb1 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dba436d0a67433f8c8ae7cd40d3f795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46b8dc64007429b805971d4c6f5b471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:45:11.197975 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-38af14cb-37ea-4fc0-856e-94a90ff5ccb1 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] 10.222.0.66 "GET /compute/v2.1/servers/9307fdad-ca63-449d-bc5c-7e9e167c59f3" status: 200 len: 1675 microversion: 2.1 time: 0.238121 Aug 04 03:45:11.198539 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 324/648] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:45:10 2022] GET /compute/v2.1/servers/9307fdad-ca63-449d-bc5c-7e9e167c59f3 => generated 1675 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 03:45:12.188503 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-0816d1f7-4bba-4eea-94d3-1fd62718599e tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:45:12.189107 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-0816d1f7-4bba-4eea-94d3-1fd62718599e tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] [instance: 3bf41d49-2b84-4f59-a019-a8b1e45891d1] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:45:12.195667 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-0816d1f7-4bba-4eea-94d3-1fd62718599e tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:45:12.196110 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-0816d1f7-4bba-4eea-94d3-1fd62718599e tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:45:12.196866 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-0816d1f7-4bba-4eea-94d3-1fd62718599e tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:45:12.197320 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-0816d1f7-4bba-4eea-94d3-1fd62718599e tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:45:12.219131 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-919bcddf-d2af-46e3-8bc6-4497ef78a169 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:45:12.219726 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-919bcddf-d2af-46e3-8bc6-4497ef78a169 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] [instance: 9307fdad-ca63-449d-bc5c-7e9e167c59f3] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:45:12.226763 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-919bcddf-d2af-46e3-8bc6-4497ef78a169 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:45:12.227214 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-919bcddf-d2af-46e3-8bc6-4497ef78a169 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:45:12.228066 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-919bcddf-d2af-46e3-8bc6-4497ef78a169 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:45:12.228507 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-919bcddf-d2af-46e3-8bc6-4497ef78a169 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:45:12.404876 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-0816d1f7-4bba-4eea-94d3-1fd62718599e tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:45:12.414073 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-0816d1f7-4bba-4eea-94d3-1fd62718599e tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:45:12.415563 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-0816d1f7-4bba-4eea-94d3-1fd62718599e tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:45:12.416729 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-0816d1f7-4bba-4eea-94d3-1fd62718599e tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] 10.222.0.66 "GET /compute/v2.1/servers/3bf41d49-2b84-4f59-a019-a8b1e45891d1" status: 200 len: 1808 microversion: 2.20 time: 0.232798 Aug 04 03:45:12.417305 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 325/649] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 03:45:12 2022] GET /compute/v2.1/servers/3bf41d49-2b84-4f59-a019-a8b1e45891d1 => generated 1808 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 03:45:12.423108 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-919bcddf-d2af-46e3-8bc6-4497ef78a169 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dba436d0a67433f8c8ae7cd40d3f795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46b8dc64007429b805971d4c6f5b471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:45:12.430913 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-919bcddf-d2af-46e3-8bc6-4497ef78a169 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] 10.222.0.66 "GET /compute/v2.1/servers/9307fdad-ca63-449d-bc5c-7e9e167c59f3" status: 200 len: 1675 microversion: 2.1 time: 0.215865 Aug 04 03:45:12.431409 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 325/650] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:45:12 2022] GET /compute/v2.1/servers/9307fdad-ca63-449d-bc5c-7e9e167c59f3 => generated 1675 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 03:45:13.441048 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-6493ad67-7e78-4be3-807e-67cc68dde96c tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:45:13.441700 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-6493ad67-7e78-4be3-807e-67cc68dde96c tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] [instance: 3bf41d49-2b84-4f59-a019-a8b1e45891d1] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:45:13.448323 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-6493ad67-7e78-4be3-807e-67cc68dde96c tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:45:13.448778 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-6493ad67-7e78-4be3-807e-67cc68dde96c tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:45:13.449574 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-6493ad67-7e78-4be3-807e-67cc68dde96c tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:45:13.450006 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-6493ad67-7e78-4be3-807e-67cc68dde96c tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:45:13.453867 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-5cce2763-07f2-4df8-9286-726de4611045 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:45:13.454695 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-5cce2763-07f2-4df8-9286-726de4611045 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] [instance: 9307fdad-ca63-449d-bc5c-7e9e167c59f3] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:45:13.462432 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-5cce2763-07f2-4df8-9286-726de4611045 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:45:13.463144 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-5cce2763-07f2-4df8-9286-726de4611045 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:45:13.464268 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-5cce2763-07f2-4df8-9286-726de4611045 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:45:13.464875 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-5cce2763-07f2-4df8-9286-726de4611045 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:45:13.475976 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG dbcounter [-] [130262] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=130262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:45:13.689300 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-6493ad67-7e78-4be3-807e-67cc68dde96c tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:45:13.696324 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-5cce2763-07f2-4df8-9286-726de4611045 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dba436d0a67433f8c8ae7cd40d3f795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46b8dc64007429b805971d4c6f5b471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:45:13.698756 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-6493ad67-7e78-4be3-807e-67cc68dde96c tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:45:13.700802 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-6493ad67-7e78-4be3-807e-67cc68dde96c tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:45:13.702060 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-5cce2763-07f2-4df8-9286-726de4611045 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] 10.222.0.66 "GET /compute/v2.1/servers/9307fdad-ca63-449d-bc5c-7e9e167c59f3" status: 200 len: 1675 microversion: 2.1 time: 0.252911 Aug 04 03:45:13.702227 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-6493ad67-7e78-4be3-807e-67cc68dde96c tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] 10.222.0.66 "GET /compute/v2.1/servers/3bf41d49-2b84-4f59-a019-a8b1e45891d1" status: 200 len: 1808 microversion: 2.20 time: 0.265865 Aug 04 03:45:13.702636 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 326/651] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:45:13 2022] GET /compute/v2.1/servers/9307fdad-ca63-449d-bc5c-7e9e167c59f3 => generated 1675 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 03:45:13.702886 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 326/652] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 03:45:13 2022] GET /compute/v2.1/servers/3bf41d49-2b84-4f59-a019-a8b1e45891d1 => generated 1808 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 03:45:14.724082 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-a26f3d10-a57f-4476-a062-14fa7576bc49 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:45:14.724694 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-a26f3d10-a57f-4476-a062-14fa7576bc49 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] [instance: 9307fdad-ca63-449d-bc5c-7e9e167c59f3] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:45:14.731149 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-a26f3d10-a57f-4476-a062-14fa7576bc49 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:45:14.731594 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-a26f3d10-a57f-4476-a062-14fa7576bc49 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:45:14.732348 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-a26f3d10-a57f-4476-a062-14fa7576bc49 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:45:14.732783 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-a26f3d10-a57f-4476-a062-14fa7576bc49 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:45:14.743166 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-9b72f5d2-19c0-4284-870e-8886bc502ae0 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:45:14.743856 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-9b72f5d2-19c0-4284-870e-8886bc502ae0 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] [instance: 3bf41d49-2b84-4f59-a019-a8b1e45891d1] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:45:14.750730 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-9b72f5d2-19c0-4284-870e-8886bc502ae0 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:45:14.751884 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-9b72f5d2-19c0-4284-870e-8886bc502ae0 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:45:14.752076 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-9b72f5d2-19c0-4284-870e-8886bc502ae0 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:45:14.752520 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-9b72f5d2-19c0-4284-870e-8886bc502ae0 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:45:14.956241 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-a26f3d10-a57f-4476-a062-14fa7576bc49 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dba436d0a67433f8c8ae7cd40d3f795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46b8dc64007429b805971d4c6f5b471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:45:14.964116 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-a26f3d10-a57f-4476-a062-14fa7576bc49 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] 10.222.0.66 "GET /compute/v2.1/servers/9307fdad-ca63-449d-bc5c-7e9e167c59f3" status: 200 len: 1675 microversion: 2.1 time: 0.244491 Aug 04 03:45:14.965098 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 327/653] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:45:14 2022] GET /compute/v2.1/servers/9307fdad-ca63-449d-bc5c-7e9e167c59f3 => generated 1675 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:45:14.967251 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-9b72f5d2-19c0-4284-870e-8886bc502ae0 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:45:14.976667 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-9b72f5d2-19c0-4284-870e-8886bc502ae0 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:45:14.978352 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-9b72f5d2-19c0-4284-870e-8886bc502ae0 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:45:14.982618 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-9b72f5d2-19c0-4284-870e-8886bc502ae0 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] 10.222.0.66 "GET /compute/v2.1/servers/3bf41d49-2b84-4f59-a019-a8b1e45891d1" status: 200 len: 1808 microversion: 2.20 time: 0.240635 Aug 04 03:45:14.982618 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 327/654] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 03:45:14 2022] GET /compute/v2.1/servers/3bf41d49-2b84-4f59-a019-a8b1e45891d1 => generated 1808 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 03:45:15.994730 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-c11da7e5-368d-497e-83a6-dfbeefcd6cf2 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:45:15.995366 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-c11da7e5-368d-497e-83a6-dfbeefcd6cf2 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] [instance: 9307fdad-ca63-449d-bc5c-7e9e167c59f3] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:45:16.002320 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-c11da7e5-368d-497e-83a6-dfbeefcd6cf2 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:45:16.004087 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-c11da7e5-368d-497e-83a6-dfbeefcd6cf2 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:45:16.004864 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-c11da7e5-368d-497e-83a6-dfbeefcd6cf2 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:45:16.005329 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-c11da7e5-368d-497e-83a6-dfbeefcd6cf2 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:45:16.008148 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-7d4c9647-6c5e-41ba-a76e-57af427bf18c tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:45:16.008795 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-7d4c9647-6c5e-41ba-a76e-57af427bf18c tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] [instance: 3bf41d49-2b84-4f59-a019-a8b1e45891d1] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:45:16.015832 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-7d4c9647-6c5e-41ba-a76e-57af427bf18c tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:45:16.016360 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-7d4c9647-6c5e-41ba-a76e-57af427bf18c tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:45:16.017236 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-7d4c9647-6c5e-41ba-a76e-57af427bf18c tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:45:16.017753 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-7d4c9647-6c5e-41ba-a76e-57af427bf18c tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:45:16.231073 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-7d4c9647-6c5e-41ba-a76e-57af427bf18c tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:45:16.234420 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-c11da7e5-368d-497e-83a6-dfbeefcd6cf2 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dba436d0a67433f8c8ae7cd40d3f795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46b8dc64007429b805971d4c6f5b471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:45:16.238009 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG dbcounter [-] [130263] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=130263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:45:16.241118 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-7d4c9647-6c5e-41ba-a76e-57af427bf18c tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:45:16.242369 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-c11da7e5-368d-497e-83a6-dfbeefcd6cf2 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] 10.222.0.66 "GET /compute/v2.1/servers/9307fdad-ca63-449d-bc5c-7e9e167c59f3" status: 200 len: 1675 microversion: 2.1 time: 0.251688 Aug 04 03:45:16.242658 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-7d4c9647-6c5e-41ba-a76e-57af427bf18c tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:45:16.242907 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 328/655] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:45:15 2022] GET /compute/v2.1/servers/9307fdad-ca63-449d-bc5c-7e9e167c59f3 => generated 1675 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:45:16.243821 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-7d4c9647-6c5e-41ba-a76e-57af427bf18c tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] 10.222.0.66 "GET /compute/v2.1/servers/3bf41d49-2b84-4f59-a019-a8b1e45891d1" status: 200 len: 1808 microversion: 2.20 time: 0.242051 Aug 04 03:45:16.244371 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 328/656] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 03:45:16 2022] GET /compute/v2.1/servers/3bf41d49-2b84-4f59-a019-a8b1e45891d1 => generated 1808 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 03:45:17.266693 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-6178d4b0-942e-4a8d-bfd7-c9128c39ae53 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:45:17.267824 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-a4bca10b-1117-4fbe-a8fa-568ca29f506a tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:45:17.268226 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-6178d4b0-942e-4a8d-bfd7-c9128c39ae53 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] [instance: 9307fdad-ca63-449d-bc5c-7e9e167c59f3] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:45:17.268518 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-a4bca10b-1117-4fbe-a8fa-568ca29f506a tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] [instance: 3bf41d49-2b84-4f59-a019-a8b1e45891d1] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:45:17.275114 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-6178d4b0-942e-4a8d-bfd7-c9128c39ae53 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:45:17.275564 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-6178d4b0-942e-4a8d-bfd7-c9128c39ae53 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:45:17.275681 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-a4bca10b-1117-4fbe-a8fa-568ca29f506a tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:45:17.276065 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-a4bca10b-1117-4fbe-a8fa-568ca29f506a tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:45:17.276341 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-6178d4b0-942e-4a8d-bfd7-c9128c39ae53 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:45:17.276759 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-6178d4b0-942e-4a8d-bfd7-c9128c39ae53 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:45:17.276890 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-a4bca10b-1117-4fbe-a8fa-568ca29f506a tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:45:17.277274 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-a4bca10b-1117-4fbe-a8fa-568ca29f506a tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:45:17.351928 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 03:45:17.352169 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: Thu Aug 4 03:45:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3bf41d49-2b84-4f59-a019-a8b1e45891d1 (ip 10.222.0.66) !!! Aug 04 03:45:17.484131 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-a4bca10b-1117-4fbe-a8fa-568ca29f506a tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:45:17.491632 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-6178d4b0-942e-4a8d-bfd7-c9128c39ae53 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dba436d0a67433f8c8ae7cd40d3f795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46b8dc64007429b805971d4c6f5b471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:45:17.493400 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-a4bca10b-1117-4fbe-a8fa-568ca29f506a tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:45:17.500283 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-a4bca10b-1117-4fbe-a8fa-568ca29f506a tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:45:17.500283 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-a4bca10b-1117-4fbe-a8fa-568ca29f506a tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] 10.222.0.66 "GET /compute/v2.1/servers/3bf41d49-2b84-4f59-a019-a8b1e45891d1" status: 200 len: 1808 microversion: 2.20 time: 0.232208 Aug 04 03:45:17.500283 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 329/657] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 03:45:17 2022] GET /compute/v2.1/servers/3bf41d49-2b84-4f59-a019-a8b1e45891d1 => generated 1808 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 03:45:17.500579 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-6178d4b0-942e-4a8d-bfd7-c9128c39ae53 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] 10.222.0.66 "GET /compute/v2.1/servers/9307fdad-ca63-449d-bc5c-7e9e167c59f3" status: 200 len: 1675 microversion: 2.1 time: 0.236619 Aug 04 03:45:17.500579 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 329/658] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:45:17 2022] GET /compute/v2.1/servers/9307fdad-ca63-449d-bc5c-7e9e167c59f3 => generated 1675 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:45:18.520659 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-e8cf3bee-6239-4b5a-9c5b-b38a3bbb6164 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:45:18.521248 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-e8cf3bee-6239-4b5a-9c5b-b38a3bbb6164 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] [instance: 9307fdad-ca63-449d-bc5c-7e9e167c59f3] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:45:18.523195 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-06474898-76b4-4377-adb4-7a534ff7c5c4 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:45:18.523797 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-06474898-76b4-4377-adb4-7a534ff7c5c4 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] [instance: 3bf41d49-2b84-4f59-a019-a8b1e45891d1] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:45:18.527719 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-e8cf3bee-6239-4b5a-9c5b-b38a3bbb6164 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:45:18.528164 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-e8cf3bee-6239-4b5a-9c5b-b38a3bbb6164 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:45:18.528921 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-e8cf3bee-6239-4b5a-9c5b-b38a3bbb6164 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:45:18.529387 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-e8cf3bee-6239-4b5a-9c5b-b38a3bbb6164 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:45:18.530247 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-06474898-76b4-4377-adb4-7a534ff7c5c4 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:45:18.530695 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-06474898-76b4-4377-adb4-7a534ff7c5c4 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:45:18.531439 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-06474898-76b4-4377-adb4-7a534ff7c5c4 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:45:18.531871 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-06474898-76b4-4377-adb4-7a534ff7c5c4 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:45:18.728692 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-e8cf3bee-6239-4b5a-9c5b-b38a3bbb6164 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dba436d0a67433f8c8ae7cd40d3f795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46b8dc64007429b805971d4c6f5b471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:45:18.736713 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-e8cf3bee-6239-4b5a-9c5b-b38a3bbb6164 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] 10.222.0.66 "GET /compute/v2.1/servers/9307fdad-ca63-449d-bc5c-7e9e167c59f3" status: 200 len: 1675 microversion: 2.1 time: 0.220082 Aug 04 03:45:18.737328 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 330/659] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:45:18 2022] GET /compute/v2.1/servers/9307fdad-ca63-449d-bc5c-7e9e167c59f3 => generated 1675 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:45:18.755350 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-06474898-76b4-4377-adb4-7a534ff7c5c4 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:45:18.763900 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-06474898-76b4-4377-adb4-7a534ff7c5c4 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:45:18.765534 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-06474898-76b4-4377-adb4-7a534ff7c5c4 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:45:18.766720 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-06474898-76b4-4377-adb4-7a534ff7c5c4 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] 10.222.0.66 "GET /compute/v2.1/servers/3bf41d49-2b84-4f59-a019-a8b1e45891d1" status: 200 len: 1808 microversion: 2.20 time: 0.247286 Aug 04 03:45:18.767273 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 330/660] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 03:45:18 2022] GET /compute/v2.1/servers/3bf41d49-2b84-4f59-a019-a8b1e45891d1 => generated 1808 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 03:45:19.757993 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-29c6e56f-d205-4e12-b08f-ebddca1198c8 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:45:19.758584 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-29c6e56f-d205-4e12-b08f-ebddca1198c8 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] [instance: 9307fdad-ca63-449d-bc5c-7e9e167c59f3] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:45:19.766513 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-29c6e56f-d205-4e12-b08f-ebddca1198c8 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:45:19.767625 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-29c6e56f-d205-4e12-b08f-ebddca1198c8 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:45:19.770016 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-29c6e56f-d205-4e12-b08f-ebddca1198c8 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:45:19.771003 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-29c6e56f-d205-4e12-b08f-ebddca1198c8 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:45:19.791800 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-ef30fd97-abd0-4009-a5df-7cf5dd9589e5 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:45:19.792474 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-ef30fd97-abd0-4009-a5df-7cf5dd9589e5 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] [instance: 3bf41d49-2b84-4f59-a019-a8b1e45891d1] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:45:19.798921 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-ef30fd97-abd0-4009-a5df-7cf5dd9589e5 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:45:19.799686 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-ef30fd97-abd0-4009-a5df-7cf5dd9589e5 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:45:19.807745 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-ef30fd97-abd0-4009-a5df-7cf5dd9589e5 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:45:19.813961 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-ef30fd97-abd0-4009-a5df-7cf5dd9589e5 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:45:19.968856 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-29c6e56f-d205-4e12-b08f-ebddca1198c8 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dba436d0a67433f8c8ae7cd40d3f795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46b8dc64007429b805971d4c6f5b471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:45:19.976401 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-29c6e56f-d205-4e12-b08f-ebddca1198c8 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] 10.222.0.66 "GET /compute/v2.1/servers/9307fdad-ca63-449d-bc5c-7e9e167c59f3" status: 200 len: 1675 microversion: 2.1 time: 0.221874 Aug 04 03:45:19.977534 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 331/661] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:45:19 2022] GET /compute/v2.1/servers/9307fdad-ca63-449d-bc5c-7e9e167c59f3 => generated 1675 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:45:19.998438 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-ef30fd97-abd0-4009-a5df-7cf5dd9589e5 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:45:20.016121 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-ef30fd97-abd0-4009-a5df-7cf5dd9589e5 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:45:20.017592 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-ef30fd97-abd0-4009-a5df-7cf5dd9589e5 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:45:20.019402 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-ef30fd97-abd0-4009-a5df-7cf5dd9589e5 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] 10.222.0.66 "GET /compute/v2.1/servers/3bf41d49-2b84-4f59-a019-a8b1e45891d1" status: 200 len: 1808 microversion: 2.20 time: 0.231451 Aug 04 03:45:20.035752 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 331/662] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 03:45:19 2022] GET /compute/v2.1/servers/3bf41d49-2b84-4f59-a019-a8b1e45891d1 => generated 1808 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 03:45:20.998913 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-e4265884-a159-4a05-a8f6-59823d2a78f9 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:45:20.999726 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-e4265884-a159-4a05-a8f6-59823d2a78f9 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] [instance: 9307fdad-ca63-449d-bc5c-7e9e167c59f3] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:45:21.009393 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-e4265884-a159-4a05-a8f6-59823d2a78f9 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:45:21.010007 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-e4265884-a159-4a05-a8f6-59823d2a78f9 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:45:21.010977 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-e4265884-a159-4a05-a8f6-59823d2a78f9 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:45:21.011418 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-e4265884-a159-4a05-a8f6-59823d2a78f9 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:45:21.043768 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-47c746dc-4eeb-4eed-83a2-492f6ae9ece5 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:45:21.059470 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-47c746dc-4eeb-4eed-83a2-492f6ae9ece5 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] [instance: 3bf41d49-2b84-4f59-a019-a8b1e45891d1] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:45:21.059470 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-47c746dc-4eeb-4eed-83a2-492f6ae9ece5 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:45:21.059470 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-47c746dc-4eeb-4eed-83a2-492f6ae9ece5 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:45:21.059470 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-47c746dc-4eeb-4eed-83a2-492f6ae9ece5 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:45:21.059905 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-47c746dc-4eeb-4eed-83a2-492f6ae9ece5 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:45:21.215845 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-e4265884-a159-4a05-a8f6-59823d2a78f9 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dba436d0a67433f8c8ae7cd40d3f795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46b8dc64007429b805971d4c6f5b471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:45:21.224471 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-e4265884-a159-4a05-a8f6-59823d2a78f9 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] 10.222.0.66 "GET /compute/v2.1/servers/9307fdad-ca63-449d-bc5c-7e9e167c59f3" status: 200 len: 1675 microversion: 2.1 time: 0.229901 Aug 04 03:45:21.224471 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 332/663] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:45:20 2022] GET /compute/v2.1/servers/9307fdad-ca63-449d-bc5c-7e9e167c59f3 => generated 1675 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:45:21.245888 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-47c746dc-4eeb-4eed-83a2-492f6ae9ece5 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:45:21.254480 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-47c746dc-4eeb-4eed-83a2-492f6ae9ece5 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:45:21.256775 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-47c746dc-4eeb-4eed-83a2-492f6ae9ece5 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:45:21.257980 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-47c746dc-4eeb-4eed-83a2-492f6ae9ece5 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] 10.222.0.66 "GET /compute/v2.1/servers/3bf41d49-2b84-4f59-a019-a8b1e45891d1" status: 200 len: 1808 microversion: 2.20 time: 0.218079 Aug 04 03:45:21.258538 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 332/664] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 03:45:21 2022] GET /compute/v2.1/servers/3bf41d49-2b84-4f59-a019-a8b1e45891d1 => generated 1808 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 03:45:21.340940 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-49689dca-ce21-4815-91aa-f4ccbd574837 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 03:45:21.343355 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-49689dca-ce21-4815-91aa-f4ccbd574837 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] [instance: bd510bcc-33c6-4299-8a14-018dce8ee011] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:45:21.349877 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-49689dca-ce21-4815-91aa-f4ccbd574837 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:45:21.350317 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-49689dca-ce21-4815-91aa-f4ccbd574837 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:45:21.351065 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-49689dca-ce21-4815-91aa-f4ccbd574837 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:45:21.351495 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-49689dca-ce21-4815-91aa-f4ccbd574837 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:45:21.674374 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-49689dca-ce21-4815-91aa-f4ccbd574837 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] 10.222.0.66 "POST /compute/v2.1/servers/bd510bcc-33c6-4299-8a14-018dce8ee011/action" status: 202 len: 0 microversion: 2.1 time: 0.337575 Aug 04 03:45:21.675060 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 333/665] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 03:45:21 2022] POST /compute/v2.1/servers/bd510bcc-33c6-4299-8a14-018dce8ee011/action => generated 0 bytes in 339 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 03:45:21.683740 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-d4ae0c61-376a-4f87-8cba-9dbbb7ad4dab tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:45:21.685381 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-d4ae0c61-376a-4f87-8cba-9dbbb7ad4dab tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] [instance: bd510bcc-33c6-4299-8a14-018dce8ee011] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:45:21.690389 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-d4ae0c61-376a-4f87-8cba-9dbbb7ad4dab tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:45:21.690840 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-d4ae0c61-376a-4f87-8cba-9dbbb7ad4dab tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:45:21.691602 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-d4ae0c61-376a-4f87-8cba-9dbbb7ad4dab tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:45:21.692036 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-d4ae0c61-376a-4f87-8cba-9dbbb7ad4dab tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:45:21.836861 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-d4ae0c61-376a-4f87-8cba-9dbbb7ad4dab tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd245c731eb58483bb635a7e70542b892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2049d7705d5c4afe94c22a6f1284327b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:45:21.844698 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-d4ae0c61-376a-4f87-8cba-9dbbb7ad4dab tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] 10.222.0.66 "GET /compute/v2.1/servers/bd510bcc-33c6-4299-8a14-018dce8ee011" status: 200 len: 1749 microversion: 2.1 time: 0.164879 Aug 04 03:45:21.845276 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 333/666] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:45:21 2022] GET /compute/v2.1/servers/bd510bcc-33c6-4299-8a14-018dce8ee011 => generated 1749 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:45:22.252783 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-40ce456c-c737-4e5b-818e-a879b12fc2eb tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:45:22.253524 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-40ce456c-c737-4e5b-818e-a879b12fc2eb tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] [instance: 9307fdad-ca63-449d-bc5c-7e9e167c59f3] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:45:22.259920 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-40ce456c-c737-4e5b-818e-a879b12fc2eb tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:45:22.260367 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-40ce456c-c737-4e5b-818e-a879b12fc2eb tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:45:22.261128 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-40ce456c-c737-4e5b-818e-a879b12fc2eb tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:45:22.261590 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-40ce456c-c737-4e5b-818e-a879b12fc2eb tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:45:22.280293 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-3e3261be-ded6-4b22-a1f3-7c718b8a5400 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:45:22.281007 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-3e3261be-ded6-4b22-a1f3-7c718b8a5400 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] [instance: 3bf41d49-2b84-4f59-a019-a8b1e45891d1] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:45:22.288318 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-3e3261be-ded6-4b22-a1f3-7c718b8a5400 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:45:22.288774 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-3e3261be-ded6-4b22-a1f3-7c718b8a5400 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:45:22.289571 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-3e3261be-ded6-4b22-a1f3-7c718b8a5400 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:45:22.290010 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-3e3261be-ded6-4b22-a1f3-7c718b8a5400 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:45:22.468198 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-40ce456c-c737-4e5b-818e-a879b12fc2eb tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dba436d0a67433f8c8ae7cd40d3f795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46b8dc64007429b805971d4c6f5b471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:45:22.472231 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-3e3261be-ded6-4b22-a1f3-7c718b8a5400 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:45:22.475790 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-40ce456c-c737-4e5b-818e-a879b12fc2eb tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] 10.222.0.66 "GET /compute/v2.1/servers/9307fdad-ca63-449d-bc5c-7e9e167c59f3" status: 200 len: 1675 microversion: 2.1 time: 0.227871 Aug 04 03:45:22.476352 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 334/667] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:45:22 2022] GET /compute/v2.1/servers/9307fdad-ca63-449d-bc5c-7e9e167c59f3 => generated 1675 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:45:22.481312 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-3e3261be-ded6-4b22-a1f3-7c718b8a5400 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:45:22.482856 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-3e3261be-ded6-4b22-a1f3-7c718b8a5400 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:45:22.484334 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-3e3261be-ded6-4b22-a1f3-7c718b8a5400 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] 10.222.0.66 "GET /compute/v2.1/servers/3bf41d49-2b84-4f59-a019-a8b1e45891d1" status: 200 len: 1808 microversion: 2.20 time: 0.208104 Aug 04 03:45:22.484888 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 334/668] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 03:45:22 2022] GET /compute/v2.1/servers/3bf41d49-2b84-4f59-a019-a8b1e45891d1 => generated 1808 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 03:45:22.866349 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-d680f194-2c1d-435a-8dd4-5b2624bea890 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:45:22.866956 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-d680f194-2c1d-435a-8dd4-5b2624bea890 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] [instance: bd510bcc-33c6-4299-8a14-018dce8ee011] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:45:22.872898 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-d680f194-2c1d-435a-8dd4-5b2624bea890 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:45:22.873410 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-d680f194-2c1d-435a-8dd4-5b2624bea890 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:45:22.874154 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-d680f194-2c1d-435a-8dd4-5b2624bea890 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:45:22.874593 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-d680f194-2c1d-435a-8dd4-5b2624bea890 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:45:23.014379 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-d680f194-2c1d-435a-8dd4-5b2624bea890 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd245c731eb58483bb635a7e70542b892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2049d7705d5c4afe94c22a6f1284327b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:45:23.022291 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-d680f194-2c1d-435a-8dd4-5b2624bea890 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] 10.222.0.66 "GET /compute/v2.1/servers/bd510bcc-33c6-4299-8a14-018dce8ee011" status: 200 len: 1749 microversion: 2.1 time: 0.160316 Aug 04 03:45:23.023054 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 335/669] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:45:22 2022] GET /compute/v2.1/servers/bd510bcc-33c6-4299-8a14-018dce8ee011 => generated 1749 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:45:23.496806 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-6b7f2ae8-fb32-4f71-994e-ca64154bf4c8 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:45:23.497391 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-6b7f2ae8-fb32-4f71-994e-ca64154bf4c8 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] [instance: 9307fdad-ca63-449d-bc5c-7e9e167c59f3] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:45:23.499655 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG dbcounter [-] [130263] Writing DB stats nova_api:SELECT=58 {{(pid=130263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:45:23.504504 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-6b7f2ae8-fb32-4f71-994e-ca64154bf4c8 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:45:23.504956 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-6b7f2ae8-fb32-4f71-994e-ca64154bf4c8 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:45:23.505754 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-6b7f2ae8-fb32-4f71-994e-ca64154bf4c8 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:45:23.506186 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-6b7f2ae8-fb32-4f71-994e-ca64154bf4c8 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:45:23.511025 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-d7d89a73-cb32-44c1-9840-403a263f4dba tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:45:23.511025 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-d7d89a73-cb32-44c1-9840-403a263f4dba tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] [instance: 3bf41d49-2b84-4f59-a019-a8b1e45891d1] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:45:23.511025 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG dbcounter [-] [130262] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=1 {{(pid=130262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:45:23.515441 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-d7d89a73-cb32-44c1-9840-403a263f4dba tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:45:23.515898 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-d7d89a73-cb32-44c1-9840-403a263f4dba tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:45:23.516689 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-d7d89a73-cb32-44c1-9840-403a263f4dba tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:45:23.517184 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-d7d89a73-cb32-44c1-9840-403a263f4dba tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:45:23.705373 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-6b7f2ae8-fb32-4f71-994e-ca64154bf4c8 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dba436d0a67433f8c8ae7cd40d3f795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46b8dc64007429b805971d4c6f5b471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:45:23.710072 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-d7d89a73-cb32-44c1-9840-403a263f4dba tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:45:23.713869 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-6b7f2ae8-fb32-4f71-994e-ca64154bf4c8 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] 10.222.0.66 "GET /compute/v2.1/servers/9307fdad-ca63-449d-bc5c-7e9e167c59f3" status: 200 len: 1675 microversion: 2.1 time: 0.220925 Aug 04 03:45:23.714644 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 335/670] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:45:23 2022] GET /compute/v2.1/servers/9307fdad-ca63-449d-bc5c-7e9e167c59f3 => generated 1675 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:45:23.718684 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-d7d89a73-cb32-44c1-9840-403a263f4dba tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:45:23.720175 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-d7d89a73-cb32-44c1-9840-403a263f4dba tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:45:23.721346 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-d7d89a73-cb32-44c1-9840-403a263f4dba tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] 10.222.0.66 "GET /compute/v2.1/servers/3bf41d49-2b84-4f59-a019-a8b1e45891d1" status: 200 len: 1808 microversion: 2.20 time: 0.217795 Aug 04 03:45:23.721880 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 336/671] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 03:45:23 2022] GET /compute/v2.1/servers/3bf41d49-2b84-4f59-a019-a8b1e45891d1 => generated 1808 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 03:45:24.042120 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-a6894392-3a97-487c-928c-7d5a2cdd34bb tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:45:24.042649 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-a6894392-3a97-487c-928c-7d5a2cdd34bb tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] [instance: bd510bcc-33c6-4299-8a14-018dce8ee011] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:45:24.048805 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-a6894392-3a97-487c-928c-7d5a2cdd34bb tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:45:24.049296 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-a6894392-3a97-487c-928c-7d5a2cdd34bb tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:45:24.050062 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-a6894392-3a97-487c-928c-7d5a2cdd34bb tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:45:24.050501 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-a6894392-3a97-487c-928c-7d5a2cdd34bb tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:45:24.203764 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-a6894392-3a97-487c-928c-7d5a2cdd34bb tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd245c731eb58483bb635a7e70542b892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2049d7705d5c4afe94c22a6f1284327b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:45:24.212333 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-a6894392-3a97-487c-928c-7d5a2cdd34bb tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] 10.222.0.66 "GET /compute/v2.1/servers/bd510bcc-33c6-4299-8a14-018dce8ee011" status: 200 len: 1749 microversion: 2.1 time: 0.174173 Aug 04 03:45:24.213282 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 336/672] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:45:24 2022] GET /compute/v2.1/servers/bd510bcc-33c6-4299-8a14-018dce8ee011 => generated 1749 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:45:24.735231 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-705bf5af-d816-4fc6-9143-a1d6ed302225 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:45:24.735858 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-705bf5af-d816-4fc6-9143-a1d6ed302225 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] [instance: 9307fdad-ca63-449d-bc5c-7e9e167c59f3] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:45:24.743018 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-705bf5af-d816-4fc6-9143-a1d6ed302225 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:45:24.743457 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-705bf5af-d816-4fc6-9143-a1d6ed302225 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:45:24.744166 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-f73a9a86-bbf0-4912-bc7b-ec20a5bf8278 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:45:24.744906 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-705bf5af-d816-4fc6-9143-a1d6ed302225 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:45:24.744906 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-705bf5af-d816-4fc6-9143-a1d6ed302225 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:45:24.745177 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-f73a9a86-bbf0-4912-bc7b-ec20a5bf8278 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] [instance: 3bf41d49-2b84-4f59-a019-a8b1e45891d1] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:45:24.751199 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-f73a9a86-bbf0-4912-bc7b-ec20a5bf8278 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:45:24.755056 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-f73a9a86-bbf0-4912-bc7b-ec20a5bf8278 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:45:24.755056 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-f73a9a86-bbf0-4912-bc7b-ec20a5bf8278 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:45:24.755056 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-f73a9a86-bbf0-4912-bc7b-ec20a5bf8278 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:45:24.939730 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-705bf5af-d816-4fc6-9143-a1d6ed302225 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dba436d0a67433f8c8ae7cd40d3f795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46b8dc64007429b805971d4c6f5b471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:45:24.943632 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-f73a9a86-bbf0-4912-bc7b-ec20a5bf8278 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:45:24.947867 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-705bf5af-d816-4fc6-9143-a1d6ed302225 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] 10.222.0.66 "GET /compute/v2.1/servers/9307fdad-ca63-449d-bc5c-7e9e167c59f3" status: 200 len: 1652 microversion: 2.1 time: 0.216755 Aug 04 03:45:24.948433 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 337/673] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:45:24 2022] GET /compute/v2.1/servers/9307fdad-ca63-449d-bc5c-7e9e167c59f3 => generated 1652 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:45:24.952241 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-f73a9a86-bbf0-4912-bc7b-ec20a5bf8278 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:45:24.953753 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-f73a9a86-bbf0-4912-bc7b-ec20a5bf8278 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:45:24.954888 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-f73a9a86-bbf0-4912-bc7b-ec20a5bf8278 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] 10.222.0.66 "GET /compute/v2.1/servers/3bf41d49-2b84-4f59-a019-a8b1e45891d1" status: 200 len: 1808 microversion: 2.20 time: 0.214922 Aug 04 03:45:24.955619 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 337/674] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 03:45:24 2022] GET /compute/v2.1/servers/3bf41d49-2b84-4f59-a019-a8b1e45891d1 => generated 1808 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 03:45:24.968230 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-2f0fbe3a-7c0e-4e50-9fe3-393ba2a4ecfc tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 03:45:24.974601 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-2f0fbe3a-7c0e-4e50-9fe3-393ba2a4ecfc tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:45:24.975058 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-2f0fbe3a-7c0e-4e50-9fe3-393ba2a4ecfc tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:45:24.997587 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-2f0fbe3a-7c0e-4e50-9fe3-393ba2a4ecfc tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] [instance: 9307fdad-ca63-449d-bc5c-7e9e167c59f3] Going to try to start instance {{(pid=130262) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 04 03:45:25.165945 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-2f0fbe3a-7c0e-4e50-9fe3-393ba2a4ecfc tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] 10.222.0.66 "POST /compute/v2.1/servers/9307fdad-ca63-449d-bc5c-7e9e167c59f3/action" status: 202 len: 0 microversion: 2.1 time: 0.201237 Aug 04 03:45:25.166550 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 338/675] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 03:45:24 2022] POST /compute/v2.1/servers/9307fdad-ca63-449d-bc5c-7e9e167c59f3/action => generated 0 bytes in 203 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 03:45:25.174438 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-2a0505a2-2d3f-4298-b827-b9997cf13351 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:45:25.175091 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-2a0505a2-2d3f-4298-b827-b9997cf13351 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] [instance: 9307fdad-ca63-449d-bc5c-7e9e167c59f3] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:45:25.181951 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-2a0505a2-2d3f-4298-b827-b9997cf13351 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:45:25.182438 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-2a0505a2-2d3f-4298-b827-b9997cf13351 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:45:25.183202 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-2a0505a2-2d3f-4298-b827-b9997cf13351 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:45:25.183660 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-2a0505a2-2d3f-4298-b827-b9997cf13351 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:45:25.234319 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-777be301-bff8-4f0c-8d66-b62be36e15d9 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:45:25.234991 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-777be301-bff8-4f0c-8d66-b62be36e15d9 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] [instance: bd510bcc-33c6-4299-8a14-018dce8ee011] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:45:25.241853 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-777be301-bff8-4f0c-8d66-b62be36e15d9 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:45:25.242302 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-777be301-bff8-4f0c-8d66-b62be36e15d9 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:45:25.243243 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-777be301-bff8-4f0c-8d66-b62be36e15d9 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:45:25.243672 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-777be301-bff8-4f0c-8d66-b62be36e15d9 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:45:25.356739 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-2a0505a2-2d3f-4298-b827-b9997cf13351 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dba436d0a67433f8c8ae7cd40d3f795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46b8dc64007429b805971d4c6f5b471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:45:25.364630 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-2a0505a2-2d3f-4298-b827-b9997cf13351 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] 10.222.0.66 "GET /compute/v2.1/servers/9307fdad-ca63-449d-bc5c-7e9e167c59f3" status: 200 len: 1661 microversion: 2.1 time: 0.193956 Aug 04 03:45:25.365473 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 338/676] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:45:25 2022] GET /compute/v2.1/servers/9307fdad-ca63-449d-bc5c-7e9e167c59f3 => generated 1661 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:45:25.414112 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-777be301-bff8-4f0c-8d66-b62be36e15d9 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd245c731eb58483bb635a7e70542b892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2049d7705d5c4afe94c22a6f1284327b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:45:25.422052 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-777be301-bff8-4f0c-8d66-b62be36e15d9 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] 10.222.0.66 "GET /compute/v2.1/servers/bd510bcc-33c6-4299-8a14-018dce8ee011" status: 200 len: 1749 microversion: 2.1 time: 0.192259 Aug 04 03:45:25.422557 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 339/677] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:45:25 2022] GET /compute/v2.1/servers/bd510bcc-33c6-4299-8a14-018dce8ee011 => generated 1749 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 03:45:25.979403 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-58286ff1-8f79-4f67-b144-55b0d85056c2 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:45:25.980663 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-58286ff1-8f79-4f67-b144-55b0d85056c2 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] [instance: 3bf41d49-2b84-4f59-a019-a8b1e45891d1] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:45:25.987883 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-58286ff1-8f79-4f67-b144-55b0d85056c2 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:45:25.988443 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-58286ff1-8f79-4f67-b144-55b0d85056c2 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:45:25.989232 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-58286ff1-8f79-4f67-b144-55b0d85056c2 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:45:25.989659 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-58286ff1-8f79-4f67-b144-55b0d85056c2 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:45:26.223904 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-58286ff1-8f79-4f67-b144-55b0d85056c2 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:45:26.236808 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-58286ff1-8f79-4f67-b144-55b0d85056c2 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:45:26.246091 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-58286ff1-8f79-4f67-b144-55b0d85056c2 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:45:26.246091 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-58286ff1-8f79-4f67-b144-55b0d85056c2 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] 10.222.0.66 "GET /compute/v2.1/servers/3bf41d49-2b84-4f59-a019-a8b1e45891d1" status: 200 len: 1808 microversion: 2.20 time: 0.266447 Aug 04 03:45:26.246091 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 339/678] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 03:45:25 2022] GET /compute/v2.1/servers/3bf41d49-2b84-4f59-a019-a8b1e45891d1 => generated 1808 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 03:45:26.388976 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-7a6c3962-843f-4a3b-8ccb-c046b3a5af63 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:45:26.389621 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-7a6c3962-843f-4a3b-8ccb-c046b3a5af63 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] [instance: 9307fdad-ca63-449d-bc5c-7e9e167c59f3] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:45:26.395784 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-7a6c3962-843f-4a3b-8ccb-c046b3a5af63 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:45:26.400851 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-7a6c3962-843f-4a3b-8ccb-c046b3a5af63 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:45:26.400851 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-7a6c3962-843f-4a3b-8ccb-c046b3a5af63 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:45:26.400851 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-7a6c3962-843f-4a3b-8ccb-c046b3a5af63 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:45:26.443208 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-08982ab6-de04-453e-996b-4cedb84a41e1 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:45:26.443828 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-08982ab6-de04-453e-996b-4cedb84a41e1 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] [instance: bd510bcc-33c6-4299-8a14-018dce8ee011] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:45:26.450683 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-08982ab6-de04-453e-996b-4cedb84a41e1 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:45:26.451189 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-08982ab6-de04-453e-996b-4cedb84a41e1 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:45:26.452018 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-08982ab6-de04-453e-996b-4cedb84a41e1 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:45:26.452456 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-08982ab6-de04-453e-996b-4cedb84a41e1 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:45:26.586806 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-7a6c3962-843f-4a3b-8ccb-c046b3a5af63 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dba436d0a67433f8c8ae7cd40d3f795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46b8dc64007429b805971d4c6f5b471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:45:26.594971 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-7a6c3962-843f-4a3b-8ccb-c046b3a5af63 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] 10.222.0.66 "GET /compute/v2.1/servers/9307fdad-ca63-449d-bc5c-7e9e167c59f3" status: 200 len: 1661 microversion: 2.1 time: 0.211823 Aug 04 03:45:26.595740 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 340/679] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:45:26 2022] GET /compute/v2.1/servers/9307fdad-ca63-449d-bc5c-7e9e167c59f3 => generated 1661 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:45:26.628393 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-08982ab6-de04-453e-996b-4cedb84a41e1 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd245c731eb58483bb635a7e70542b892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2049d7705d5c4afe94c22a6f1284327b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:45:26.637048 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-08982ab6-de04-453e-996b-4cedb84a41e1 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] 10.222.0.66 "GET /compute/v2.1/servers/bd510bcc-33c6-4299-8a14-018dce8ee011" status: 200 len: 1749 microversion: 2.1 time: 0.198014 Aug 04 03:45:26.637653 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 340/680] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:45:26 2022] GET /compute/v2.1/servers/bd510bcc-33c6-4299-8a14-018dce8ee011 => generated 1749 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 03:45:27.264374 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-1ccebbaa-f4e5-488f-bda2-75a686e2e815 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:45:27.264979 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-1ccebbaa-f4e5-488f-bda2-75a686e2e815 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] [instance: 3bf41d49-2b84-4f59-a019-a8b1e45891d1] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:45:27.270983 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-1ccebbaa-f4e5-488f-bda2-75a686e2e815 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:45:27.271429 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-1ccebbaa-f4e5-488f-bda2-75a686e2e815 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:45:27.272183 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-1ccebbaa-f4e5-488f-bda2-75a686e2e815 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:45:27.272804 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-1ccebbaa-f4e5-488f-bda2-75a686e2e815 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:45:27.276813 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG dbcounter [-] [130262] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=130262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:45:27.402369 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-1ccebbaa-f4e5-488f-bda2-75a686e2e815 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:45:27.410678 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-1ccebbaa-f4e5-488f-bda2-75a686e2e815 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:45:27.412177 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-1ccebbaa-f4e5-488f-bda2-75a686e2e815 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:45:27.413966 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-1ccebbaa-f4e5-488f-bda2-75a686e2e815 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] 10.222.0.66 "GET /compute/v2.1/servers/3bf41d49-2b84-4f59-a019-a8b1e45891d1" status: 200 len: 1808 microversion: 2.20 time: 0.153529 Aug 04 03:45:27.414516 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 341/681] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 03:45:27 2022] GET /compute/v2.1/servers/3bf41d49-2b84-4f59-a019-a8b1e45891d1 => generated 1808 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 03:45:27.616760 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-dbb3ca93-a16d-4c27-b018-7590961f4193 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:45:27.617450 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-dbb3ca93-a16d-4c27-b018-7590961f4193 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] [instance: 9307fdad-ca63-449d-bc5c-7e9e167c59f3] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:45:27.624055 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-dbb3ca93-a16d-4c27-b018-7590961f4193 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:45:27.627829 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-dbb3ca93-a16d-4c27-b018-7590961f4193 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:45:27.627829 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-dbb3ca93-a16d-4c27-b018-7590961f4193 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:45:27.627829 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-dbb3ca93-a16d-4c27-b018-7590961f4193 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:45:27.658989 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-71d67843-2ef0-42e2-ba96-56a14b19d617 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:45:27.659604 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-71d67843-2ef0-42e2-ba96-56a14b19d617 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] [instance: bd510bcc-33c6-4299-8a14-018dce8ee011] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:45:27.666335 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-71d67843-2ef0-42e2-ba96-56a14b19d617 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:45:27.666793 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-71d67843-2ef0-42e2-ba96-56a14b19d617 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:45:27.667566 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-71d67843-2ef0-42e2-ba96-56a14b19d617 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:45:27.668008 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-71d67843-2ef0-42e2-ba96-56a14b19d617 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:45:27.806306 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-dbb3ca93-a16d-4c27-b018-7590961f4193 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dba436d0a67433f8c8ae7cd40d3f795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46b8dc64007429b805971d4c6f5b471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:45:27.813826 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-dbb3ca93-a16d-4c27-b018-7590961f4193 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] 10.222.0.66 "GET /compute/v2.1/servers/9307fdad-ca63-449d-bc5c-7e9e167c59f3" status: 200 len: 1665 microversion: 2.1 time: 0.201575 Aug 04 03:45:27.814580 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 341/682] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:45:27 2022] GET /compute/v2.1/servers/9307fdad-ca63-449d-bc5c-7e9e167c59f3 => generated 1665 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:45:27.848076 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-71d67843-2ef0-42e2-ba96-56a14b19d617 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd245c731eb58483bb635a7e70542b892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2049d7705d5c4afe94c22a6f1284327b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:45:27.858386 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-71d67843-2ef0-42e2-ba96-56a14b19d617 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] 10.222.0.66 "GET /compute/v2.1/servers/bd510bcc-33c6-4299-8a14-018dce8ee011" status: 200 len: 1754 microversion: 2.1 time: 0.203027 Aug 04 03:45:27.859689 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 342/683] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:45:27 2022] GET /compute/v2.1/servers/bd510bcc-33c6-4299-8a14-018dce8ee011 => generated 1754 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:45:28.437792 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-4b5a2e6d-b266-4459-a3e6-4c2078cbe811 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:45:28.438326 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-4b5a2e6d-b266-4459-a3e6-4c2078cbe811 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] [instance: 3bf41d49-2b84-4f59-a019-a8b1e45891d1] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:45:28.444383 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-4b5a2e6d-b266-4459-a3e6-4c2078cbe811 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:45:28.444963 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-4b5a2e6d-b266-4459-a3e6-4c2078cbe811 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:45:28.445759 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-4b5a2e6d-b266-4459-a3e6-4c2078cbe811 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:45:28.446203 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-4b5a2e6d-b266-4459-a3e6-4c2078cbe811 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:45:28.574083 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-4b5a2e6d-b266-4459-a3e6-4c2078cbe811 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:45:28.582427 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-4b5a2e6d-b266-4459-a3e6-4c2078cbe811 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:45:28.583930 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-4b5a2e6d-b266-4459-a3e6-4c2078cbe811 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:45:28.585821 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-4b5a2e6d-b266-4459-a3e6-4c2078cbe811 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] 10.222.0.66 "GET /compute/v2.1/servers/3bf41d49-2b84-4f59-a019-a8b1e45891d1" status: 200 len: 1808 microversion: 2.20 time: 0.151316 Aug 04 03:45:28.586400 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 342/684] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 03:45:28 2022] GET /compute/v2.1/servers/3bf41d49-2b84-4f59-a019-a8b1e45891d1 => generated 1808 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 03:45:28.879908 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-05a0705b-eee3-4481-a8b2-d08e0f39c4f5 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:45:28.880520 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-05a0705b-eee3-4481-a8b2-d08e0f39c4f5 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] [instance: bd510bcc-33c6-4299-8a14-018dce8ee011] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:45:28.887018 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-05a0705b-eee3-4481-a8b2-d08e0f39c4f5 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:45:28.887472 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-05a0705b-eee3-4481-a8b2-d08e0f39c4f5 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:45:28.888233 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-05a0705b-eee3-4481-a8b2-d08e0f39c4f5 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:45:28.888703 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-05a0705b-eee3-4481-a8b2-d08e0f39c4f5 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:45:29.031776 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-05a0705b-eee3-4481-a8b2-d08e0f39c4f5 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd245c731eb58483bb635a7e70542b892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2049d7705d5c4afe94c22a6f1284327b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:45:29.040023 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-05a0705b-eee3-4481-a8b2-d08e0f39c4f5 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] 10.222.0.66 "GET /compute/v2.1/servers/bd510bcc-33c6-4299-8a14-018dce8ee011" status: 200 len: 1754 microversion: 2.1 time: 0.163956 Aug 04 03:45:29.040591 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 343/685] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:45:28 2022] GET /compute/v2.1/servers/bd510bcc-33c6-4299-8a14-018dce8ee011 => generated 1754 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:45:29.610119 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-741740ef-11ef-4b2e-95eb-b32008eb1af4 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:45:29.610726 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-741740ef-11ef-4b2e-95eb-b32008eb1af4 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] [instance: 3bf41d49-2b84-4f59-a019-a8b1e45891d1] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:45:29.618108 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-741740ef-11ef-4b2e-95eb-b32008eb1af4 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:45:29.618554 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-741740ef-11ef-4b2e-95eb-b32008eb1af4 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:45:29.619309 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-741740ef-11ef-4b2e-95eb-b32008eb1af4 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:45:29.619746 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-741740ef-11ef-4b2e-95eb-b32008eb1af4 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:45:29.747419 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-741740ef-11ef-4b2e-95eb-b32008eb1af4 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:45:29.756085 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-741740ef-11ef-4b2e-95eb-b32008eb1af4 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:45:29.757925 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-741740ef-11ef-4b2e-95eb-b32008eb1af4 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:45:29.759078 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-741740ef-11ef-4b2e-95eb-b32008eb1af4 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] 10.222.0.66 "GET /compute/v2.1/servers/3bf41d49-2b84-4f59-a019-a8b1e45891d1" status: 200 len: 1808 microversion: 2.20 time: 0.153153 Aug 04 03:45:29.759629 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 343/686] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 03:45:29 2022] GET /compute/v2.1/servers/3bf41d49-2b84-4f59-a019-a8b1e45891d1 => generated 1808 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 03:45:30.060777 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-4ef23a67-573e-4fff-ac5e-998ff373510f tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:45:30.061437 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-4ef23a67-573e-4fff-ac5e-998ff373510f tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] [instance: bd510bcc-33c6-4299-8a14-018dce8ee011] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:45:30.068525 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-4ef23a67-573e-4fff-ac5e-998ff373510f tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:45:30.069002 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-4ef23a67-573e-4fff-ac5e-998ff373510f tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:45:30.069859 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-4ef23a67-573e-4fff-ac5e-998ff373510f tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:45:30.070261 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-4ef23a67-573e-4fff-ac5e-998ff373510f tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:45:30.211127 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-4ef23a67-573e-4fff-ac5e-998ff373510f tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd245c731eb58483bb635a7e70542b892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2049d7705d5c4afe94c22a6f1284327b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:45:30.219057 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-4ef23a67-573e-4fff-ac5e-998ff373510f tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] 10.222.0.66 "GET /compute/v2.1/servers/bd510bcc-33c6-4299-8a14-018dce8ee011" status: 200 len: 1754 microversion: 2.1 time: 0.162161 Aug 04 03:45:30.219617 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 344/687] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:45:30 2022] GET /compute/v2.1/servers/bd510bcc-33c6-4299-8a14-018dce8ee011 => generated 1754 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:45:30.781949 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-180fc7cf-f2a7-444a-891f-e8f541090bd2 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:45:30.782557 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-180fc7cf-f2a7-444a-891f-e8f541090bd2 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] [instance: 3bf41d49-2b84-4f59-a019-a8b1e45891d1] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:45:30.790237 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-180fc7cf-f2a7-444a-891f-e8f541090bd2 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:45:30.790685 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-180fc7cf-f2a7-444a-891f-e8f541090bd2 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:45:30.791432 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-180fc7cf-f2a7-444a-891f-e8f541090bd2 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:45:30.791862 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-180fc7cf-f2a7-444a-891f-e8f541090bd2 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:45:30.924446 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-180fc7cf-f2a7-444a-891f-e8f541090bd2 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:45:30.933226 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-180fc7cf-f2a7-444a-891f-e8f541090bd2 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:45:30.934738 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-180fc7cf-f2a7-444a-891f-e8f541090bd2 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:45:30.935893 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-180fc7cf-f2a7-444a-891f-e8f541090bd2 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] 10.222.0.66 "GET /compute/v2.1/servers/3bf41d49-2b84-4f59-a019-a8b1e45891d1" status: 200 len: 1808 microversion: 2.20 time: 0.157811 Aug 04 03:45:30.936849 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 344/688] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 03:45:30 2022] GET /compute/v2.1/servers/3bf41d49-2b84-4f59-a019-a8b1e45891d1 => generated 1808 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 03:45:31.239857 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-9e0d42d5-e411-4271-8d35-ba3ddf35337b tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:45:31.240471 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-9e0d42d5-e411-4271-8d35-ba3ddf35337b tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] [instance: bd510bcc-33c6-4299-8a14-018dce8ee011] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:45:31.247255 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-9e0d42d5-e411-4271-8d35-ba3ddf35337b tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:45:31.247704 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-9e0d42d5-e411-4271-8d35-ba3ddf35337b tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:45:31.248463 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-9e0d42d5-e411-4271-8d35-ba3ddf35337b tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:45:31.248922 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-9e0d42d5-e411-4271-8d35-ba3ddf35337b tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:45:31.390491 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-9e0d42d5-e411-4271-8d35-ba3ddf35337b tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd245c731eb58483bb635a7e70542b892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2049d7705d5c4afe94c22a6f1284327b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:45:31.398965 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-9e0d42d5-e411-4271-8d35-ba3ddf35337b tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] 10.222.0.66 "GET /compute/v2.1/servers/bd510bcc-33c6-4299-8a14-018dce8ee011" status: 200 len: 1754 microversion: 2.1 time: 0.162930 Aug 04 03:45:31.399524 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 345/689] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:45:31 2022] GET /compute/v2.1/servers/bd510bcc-33c6-4299-8a14-018dce8ee011 => generated 1754 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 03:45:31.959033 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-0b3f4aea-1734-4a68-9ea0-b3ec89b40f37 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:45:31.959655 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-0b3f4aea-1734-4a68-9ea0-b3ec89b40f37 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] [instance: 3bf41d49-2b84-4f59-a019-a8b1e45891d1] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:45:31.966707 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-0b3f4aea-1734-4a68-9ea0-b3ec89b40f37 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:45:31.967156 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-0b3f4aea-1734-4a68-9ea0-b3ec89b40f37 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:45:31.967911 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-0b3f4aea-1734-4a68-9ea0-b3ec89b40f37 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:45:31.968348 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-0b3f4aea-1734-4a68-9ea0-b3ec89b40f37 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:45:31.987838 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG dbcounter [-] [130263] Writing DB stats nova_cell1:SELECT=100 {{(pid=130263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:45:32.102304 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-0b3f4aea-1734-4a68-9ea0-b3ec89b40f37 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:45:32.110916 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-0b3f4aea-1734-4a68-9ea0-b3ec89b40f37 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:45:32.112415 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-0b3f4aea-1734-4a68-9ea0-b3ec89b40f37 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:45:32.113598 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-0b3f4aea-1734-4a68-9ea0-b3ec89b40f37 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] 10.222.0.66 "GET /compute/v2.1/servers/3bf41d49-2b84-4f59-a019-a8b1e45891d1" status: 200 len: 1808 microversion: 2.20 time: 0.158434 Aug 04 03:45:32.114356 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 345/690] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 03:45:31 2022] GET /compute/v2.1/servers/3bf41d49-2b84-4f59-a019-a8b1e45891d1 => generated 1808 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 03:45:32.419765 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-10648f16-2246-4a35-95a9-e7237836aca8 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:45:32.420393 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-10648f16-2246-4a35-95a9-e7237836aca8 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] [instance: bd510bcc-33c6-4299-8a14-018dce8ee011] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:45:32.426872 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-10648f16-2246-4a35-95a9-e7237836aca8 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:45:32.427261 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-10648f16-2246-4a35-95a9-e7237836aca8 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:45:32.428008 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-10648f16-2246-4a35-95a9-e7237836aca8 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:45:32.429335 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-10648f16-2246-4a35-95a9-e7237836aca8 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:45:32.572848 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-10648f16-2246-4a35-95a9-e7237836aca8 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd245c731eb58483bb635a7e70542b892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2049d7705d5c4afe94c22a6f1284327b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:45:32.580643 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-10648f16-2246-4a35-95a9-e7237836aca8 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] 10.222.0.66 "GET /compute/v2.1/servers/bd510bcc-33c6-4299-8a14-018dce8ee011" status: 200 len: 1754 microversion: 2.1 time: 0.164765 Aug 04 03:45:32.581228 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 346/691] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:45:32 2022] GET /compute/v2.1/servers/bd510bcc-33c6-4299-8a14-018dce8ee011 => generated 1754 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:45:33.137782 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-881a2cd8-6af3-4ad5-a244-54a50909112a tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:45:33.138389 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-881a2cd8-6af3-4ad5-a244-54a50909112a tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] [instance: 3bf41d49-2b84-4f59-a019-a8b1e45891d1] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:45:33.144962 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-881a2cd8-6af3-4ad5-a244-54a50909112a tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:45:33.145439 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-881a2cd8-6af3-4ad5-a244-54a50909112a tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:45:33.146198 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-881a2cd8-6af3-4ad5-a244-54a50909112a tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:45:33.146632 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-881a2cd8-6af3-4ad5-a244-54a50909112a tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:45:33.277159 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-881a2cd8-6af3-4ad5-a244-54a50909112a tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:45:33.285530 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-881a2cd8-6af3-4ad5-a244-54a50909112a tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:45:33.287037 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-881a2cd8-6af3-4ad5-a244-54a50909112a tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:45:33.288882 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-881a2cd8-6af3-4ad5-a244-54a50909112a tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] 10.222.0.66 "GET /compute/v2.1/servers/3bf41d49-2b84-4f59-a019-a8b1e45891d1" status: 200 len: 1808 microversion: 2.20 time: 0.154889 Aug 04 03:45:33.289468 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 346/692] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 03:45:33 2022] GET /compute/v2.1/servers/3bf41d49-2b84-4f59-a019-a8b1e45891d1 => generated 1808 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 03:45:33.602346 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-7fba7d9a-7f6d-46e4-9a1c-5098409bb818 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:45:33.602989 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-7fba7d9a-7f6d-46e4-9a1c-5098409bb818 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] [instance: bd510bcc-33c6-4299-8a14-018dce8ee011] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:45:33.609783 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-7fba7d9a-7f6d-46e4-9a1c-5098409bb818 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:45:33.610231 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-7fba7d9a-7f6d-46e4-9a1c-5098409bb818 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:45:33.610989 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-7fba7d9a-7f6d-46e4-9a1c-5098409bb818 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:45:33.611424 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-7fba7d9a-7f6d-46e4-9a1c-5098409bb818 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:45:33.751100 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-7fba7d9a-7f6d-46e4-9a1c-5098409bb818 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd245c731eb58483bb635a7e70542b892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2049d7705d5c4afe94c22a6f1284327b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:45:33.759212 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-7fba7d9a-7f6d-46e4-9a1c-5098409bb818 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] 10.222.0.66 "GET /compute/v2.1/servers/bd510bcc-33c6-4299-8a14-018dce8ee011" status: 200 len: 1754 microversion: 2.1 time: 0.161423 Aug 04 03:45:33.759799 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 347/693] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:45:33 2022] GET /compute/v2.1/servers/bd510bcc-33c6-4299-8a14-018dce8ee011 => generated 1754 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:45:34.311970 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-9a5fdbf2-084a-40bc-b55c-f9919e65cb9f tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:45:34.312708 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-9a5fdbf2-084a-40bc-b55c-f9919e65cb9f tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] [instance: 3bf41d49-2b84-4f59-a019-a8b1e45891d1] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:45:34.320914 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-9a5fdbf2-084a-40bc-b55c-f9919e65cb9f tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:45:34.321501 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-9a5fdbf2-084a-40bc-b55c-f9919e65cb9f tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:45:34.322282 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-9a5fdbf2-084a-40bc-b55c-f9919e65cb9f tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:45:34.322724 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-9a5fdbf2-084a-40bc-b55c-f9919e65cb9f tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:45:34.454609 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-9a5fdbf2-084a-40bc-b55c-f9919e65cb9f tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:45:34.463587 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-9a5fdbf2-084a-40bc-b55c-f9919e65cb9f tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:45:34.465115 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-9a5fdbf2-084a-40bc-b55c-f9919e65cb9f tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:45:34.466296 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-9a5fdbf2-084a-40bc-b55c-f9919e65cb9f tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] 10.222.0.66 "GET /compute/v2.1/servers/3bf41d49-2b84-4f59-a019-a8b1e45891d1" status: 200 len: 1808 microversion: 2.20 time: 0.158271 Aug 04 03:45:34.466849 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 347/694] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 03:45:34 2022] GET /compute/v2.1/servers/3bf41d49-2b84-4f59-a019-a8b1e45891d1 => generated 1808 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 03:45:34.779935 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-179ef2de-f224-4724-942d-e84d195cfa3a tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:45:34.780552 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-179ef2de-f224-4724-942d-e84d195cfa3a tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] [instance: bd510bcc-33c6-4299-8a14-018dce8ee011] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:45:34.787066 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-179ef2de-f224-4724-942d-e84d195cfa3a tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:45:34.787760 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-179ef2de-f224-4724-942d-e84d195cfa3a tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:45:34.788576 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-179ef2de-f224-4724-942d-e84d195cfa3a tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:45:34.789124 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-179ef2de-f224-4724-942d-e84d195cfa3a tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:45:34.930937 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-179ef2de-f224-4724-942d-e84d195cfa3a tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd245c731eb58483bb635a7e70542b892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2049d7705d5c4afe94c22a6f1284327b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:45:34.939323 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-179ef2de-f224-4724-942d-e84d195cfa3a tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] 10.222.0.66 "GET /compute/v2.1/servers/bd510bcc-33c6-4299-8a14-018dce8ee011" status: 200 len: 1754 microversion: 2.1 time: 0.163244 Aug 04 03:45:34.939914 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 348/695] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:45:34 2022] GET /compute/v2.1/servers/bd510bcc-33c6-4299-8a14-018dce8ee011 => generated 1754 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:45:35.489468 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-8e09da2b-fbd1-4980-9bcd-3c30d65a0a09 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:45:35.489994 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-8e09da2b-fbd1-4980-9bcd-3c30d65a0a09 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] [instance: 3bf41d49-2b84-4f59-a019-a8b1e45891d1] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:45:35.496586 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-8e09da2b-fbd1-4980-9bcd-3c30d65a0a09 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:45:35.497036 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-8e09da2b-fbd1-4980-9bcd-3c30d65a0a09 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:45:35.497836 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-8e09da2b-fbd1-4980-9bcd-3c30d65a0a09 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:45:35.498281 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-8e09da2b-fbd1-4980-9bcd-3c30d65a0a09 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:45:35.625596 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-8e09da2b-fbd1-4980-9bcd-3c30d65a0a09 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:45:35.634488 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-8e09da2b-fbd1-4980-9bcd-3c30d65a0a09 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:45:35.636015 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-8e09da2b-fbd1-4980-9bcd-3c30d65a0a09 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:45:35.637157 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-8e09da2b-fbd1-4980-9bcd-3c30d65a0a09 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] 10.222.0.66 "GET /compute/v2.1/servers/3bf41d49-2b84-4f59-a019-a8b1e45891d1" status: 200 len: 1808 microversion: 2.20 time: 0.151725 Aug 04 03:45:35.637745 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 348/696] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 03:45:35 2022] GET /compute/v2.1/servers/3bf41d49-2b84-4f59-a019-a8b1e45891d1 => generated 1808 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 03:45:35.960357 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-4c0e2a28-0826-4289-9b57-e8f26dcc0585 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:45:35.960959 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-4c0e2a28-0826-4289-9b57-e8f26dcc0585 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] [instance: bd510bcc-33c6-4299-8a14-018dce8ee011] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:45:35.967859 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-4c0e2a28-0826-4289-9b57-e8f26dcc0585 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:45:35.968306 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-4c0e2a28-0826-4289-9b57-e8f26dcc0585 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:45:35.969065 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-4c0e2a28-0826-4289-9b57-e8f26dcc0585 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:45:35.969523 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-4c0e2a28-0826-4289-9b57-e8f26dcc0585 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:45:36.117919 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-4c0e2a28-0826-4289-9b57-e8f26dcc0585 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd245c731eb58483bb635a7e70542b892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2049d7705d5c4afe94c22a6f1284327b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:45:36.126014 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-4c0e2a28-0826-4289-9b57-e8f26dcc0585 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] 10.222.0.66 "GET /compute/v2.1/servers/bd510bcc-33c6-4299-8a14-018dce8ee011" status: 200 len: 1754 microversion: 2.1 time: 0.169466 Aug 04 03:45:36.126596 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 349/697] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:45:35 2022] GET /compute/v2.1/servers/bd510bcc-33c6-4299-8a14-018dce8ee011 => generated 1754 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:45:36.304730 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [req-73c773df-6c34-4368-a1f4-07f683043ed4 req-e0e29939-7c2a-47a0-bba6-cf2068c60e6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3bf41d49-2b84-4f59-a019-a8b1e45891d1", "name": "network-vif-plugged", "status": "completed", "tag": "8144b5cf-3a6c-452a-a3bb-81896a2ba4e0"}]} {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 03:45:36.314218 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [req-73c773df-6c34-4368-a1f4-07f683043ed4 req-e0e29939-7c2a-47a0-bba6-cf2068c60e6a service nova] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:45:36.314670 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [req-73c773df-6c34-4368-a1f4-07f683043ed4 req-e0e29939-7c2a-47a0-bba6-cf2068c60e6a service nova] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:45:36.325279 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.compute.server_external_events [req-73c773df-6c34-4368-a1f4-07f683043ed4 req-e0e29939-7c2a-47a0-bba6-cf2068c60e6a service nova] Creating event network-vif-plugged:8144b5cf-3a6c-452a-a3bb-81896a2ba4e0 for instance 3bf41d49-2b84-4f59-a019-a8b1e45891d1 on hv-cinder-73306 Aug 04 03:45:36.330235 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [req-73c773df-6c34-4368-a1f4-07f683043ed4 req-e0e29939-7c2a-47a0-bba6-cf2068c60e6a service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029975 Aug 04 03:45:36.330982 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 349/698] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 03:45:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 03:45:36.659871 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-e3cc1b2b-fd83-4119-92ae-0166fa07f618 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:45:36.660462 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-e3cc1b2b-fd83-4119-92ae-0166fa07f618 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] [instance: 3bf41d49-2b84-4f59-a019-a8b1e45891d1] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:45:36.667187 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-e3cc1b2b-fd83-4119-92ae-0166fa07f618 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:45:36.667626 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-e3cc1b2b-fd83-4119-92ae-0166fa07f618 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:45:36.668382 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-e3cc1b2b-fd83-4119-92ae-0166fa07f618 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:45:36.668807 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-e3cc1b2b-fd83-4119-92ae-0166fa07f618 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:45:36.798810 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-e3cc1b2b-fd83-4119-92ae-0166fa07f618 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:45:36.808266 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-e3cc1b2b-fd83-4119-92ae-0166fa07f618 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:45:36.809785 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-e3cc1b2b-fd83-4119-92ae-0166fa07f618 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:45:36.810926 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-e3cc1b2b-fd83-4119-92ae-0166fa07f618 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] 10.222.0.66 "GET /compute/v2.1/servers/3bf41d49-2b84-4f59-a019-a8b1e45891d1" status: 200 len: 1808 microversion: 2.20 time: 0.154945 Aug 04 03:45:36.811482 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 350/699] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 03:45:36 2022] GET /compute/v2.1/servers/3bf41d49-2b84-4f59-a019-a8b1e45891d1 => generated 1808 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 03:45:37.148969 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-3799dd06-f771-4cd4-bf22-67b6fea2478a tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:45:37.149773 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-3799dd06-f771-4cd4-bf22-67b6fea2478a tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] [instance: bd510bcc-33c6-4299-8a14-018dce8ee011] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:45:37.156107 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-3799dd06-f771-4cd4-bf22-67b6fea2478a tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:45:37.156559 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-3799dd06-f771-4cd4-bf22-67b6fea2478a tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:45:37.157367 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-3799dd06-f771-4cd4-bf22-67b6fea2478a tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:45:37.157809 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-3799dd06-f771-4cd4-bf22-67b6fea2478a tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:45:37.304348 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-3799dd06-f771-4cd4-bf22-67b6fea2478a tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd245c731eb58483bb635a7e70542b892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2049d7705d5c4afe94c22a6f1284327b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:45:37.312912 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-3799dd06-f771-4cd4-bf22-67b6fea2478a tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] 10.222.0.66 "GET /compute/v2.1/servers/bd510bcc-33c6-4299-8a14-018dce8ee011" status: 200 len: 1754 microversion: 2.1 time: 0.168744 Aug 04 03:45:37.313556 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 350/700] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:45:37 2022] GET /compute/v2.1/servers/bd510bcc-33c6-4299-8a14-018dce8ee011 => generated 1754 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:45:37.836374 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-c35abab2-95ac-4929-a8bc-9e61c849123a tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:45:37.836980 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-c35abab2-95ac-4929-a8bc-9e61c849123a tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] [instance: 3bf41d49-2b84-4f59-a019-a8b1e45891d1] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:45:37.843416 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-c35abab2-95ac-4929-a8bc-9e61c849123a tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:45:37.843855 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-c35abab2-95ac-4929-a8bc-9e61c849123a tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:45:37.844629 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-c35abab2-95ac-4929-a8bc-9e61c849123a tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:45:37.845061 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-c35abab2-95ac-4929-a8bc-9e61c849123a tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:45:37.863774 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-b309aa5a-0b20-4f3c-aeaa-89eebf26cd3f tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 03:45:37.864299 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-b309aa5a-0b20-4f3c-aeaa-89eebf26cd3f tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] [instance: d097d81a-1bae-45f2-a34f-444776c8e1cb] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:45:37.870925 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-b309aa5a-0b20-4f3c-aeaa-89eebf26cd3f tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:45:37.871367 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-b309aa5a-0b20-4f3c-aeaa-89eebf26cd3f tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:45:37.872117 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-b309aa5a-0b20-4f3c-aeaa-89eebf26cd3f tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:45:37.872549 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-b309aa5a-0b20-4f3c-aeaa-89eebf26cd3f tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:45:37.896032 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.objects.instance [None req-b309aa5a-0b20-4f3c-aeaa-89eebf26cd3f tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lazy-loading 'flavor' on Instance uuid d097d81a-1bae-45f2-a34f-444776c8e1cb {{(pid=130263) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 03:45:37.978656 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-c35abab2-95ac-4929-a8bc-9e61c849123a tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:45:37.987247 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-c35abab2-95ac-4929-a8bc-9e61c849123a tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:45:37.988780 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-c35abab2-95ac-4929-a8bc-9e61c849123a tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:45:37.989944 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-c35abab2-95ac-4929-a8bc-9e61c849123a tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] 10.222.0.66 "GET /compute/v2.1/servers/3bf41d49-2b84-4f59-a019-a8b1e45891d1" status: 200 len: 1808 microversion: 2.20 time: 0.158084 Aug 04 03:45:37.990495 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 351/701] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 03:45:37 2022] GET /compute/v2.1/servers/3bf41d49-2b84-4f59-a019-a8b1e45891d1 => generated 1808 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 03:45:38.113887 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-b309aa5a-0b20-4f3c-aeaa-89eebf26cd3f tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] 10.222.0.66 "POST /compute/v2.1/servers/d097d81a-1bae-45f2-a34f-444776c8e1cb/action" status: 202 len: 0 microversion: 2.1 time: 0.253721 Aug 04 03:45:38.114513 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 351/702] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 03:45:37 2022] POST /compute/v2.1/servers/d097d81a-1bae-45f2-a34f-444776c8e1cb/action => generated 0 bytes in 255 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 04 03:45:38.122716 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-fc96d2ee-fe06-4f51-a0b7-80cd91651f84 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:45:38.123326 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-fc96d2ee-fe06-4f51-a0b7-80cd91651f84 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] [instance: d097d81a-1bae-45f2-a34f-444776c8e1cb] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:45:38.129334 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-fc96d2ee-fe06-4f51-a0b7-80cd91651f84 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:45:38.129778 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-fc96d2ee-fe06-4f51-a0b7-80cd91651f84 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:45:38.130535 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-fc96d2ee-fe06-4f51-a0b7-80cd91651f84 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:45:38.130966 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-fc96d2ee-fe06-4f51-a0b7-80cd91651f84 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:45:38.274991 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-fc96d2ee-fe06-4f51-a0b7-80cd91651f84 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc12077b11448a3b1ec2e7dbf2707ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf95e3e43d0e482ba4d27b769fb48628', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:45:38.282372 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-fc96d2ee-fe06-4f51-a0b7-80cd91651f84 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] 10.222.0.66 "GET /compute/v2.1/servers/d097d81a-1bae-45f2-a34f-444776c8e1cb" status: 200 len: 1566 microversion: 2.1 time: 0.163461 Aug 04 03:45:38.282928 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 352/703] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:45:38 2022] GET /compute/v2.1/servers/d097d81a-1bae-45f2-a34f-444776c8e1cb => generated 1566 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:45:38.334505 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-7c3da087-acc3-41fe-88b1-fe7a0be01900 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:45:38.335208 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-7c3da087-acc3-41fe-88b1-fe7a0be01900 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] [instance: bd510bcc-33c6-4299-8a14-018dce8ee011] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:45:38.342020 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-7c3da087-acc3-41fe-88b1-fe7a0be01900 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:45:38.342458 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-7c3da087-acc3-41fe-88b1-fe7a0be01900 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:45:38.343250 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-7c3da087-acc3-41fe-88b1-fe7a0be01900 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:45:38.343689 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-7c3da087-acc3-41fe-88b1-fe7a0be01900 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:45:38.699953 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-7c3da087-acc3-41fe-88b1-fe7a0be01900 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd245c731eb58483bb635a7e70542b892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2049d7705d5c4afe94c22a6f1284327b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:45:38.708267 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-7c3da087-acc3-41fe-88b1-fe7a0be01900 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] 10.222.0.66 "GET /compute/v2.1/servers/bd510bcc-33c6-4299-8a14-018dce8ee011" status: 200 len: 1757 microversion: 2.1 time: 0.378394 Aug 04 03:45:38.708825 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 352/704] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:45:38 2022] GET /compute/v2.1/servers/bd510bcc-33c6-4299-8a14-018dce8ee011 => generated 1757 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:45:39.014616 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-7027aa11-fa9d-43ca-8ede-72832062e8c1 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:45:39.016919 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-7027aa11-fa9d-43ca-8ede-72832062e8c1 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] [instance: 3bf41d49-2b84-4f59-a019-a8b1e45891d1] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:45:39.022656 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-7027aa11-fa9d-43ca-8ede-72832062e8c1 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:45:39.023958 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-7027aa11-fa9d-43ca-8ede-72832062e8c1 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:45:39.024824 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-7027aa11-fa9d-43ca-8ede-72832062e8c1 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:45:39.025319 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-7027aa11-fa9d-43ca-8ede-72832062e8c1 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:45:39.155530 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-7027aa11-fa9d-43ca-8ede-72832062e8c1 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:45:39.165069 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-7027aa11-fa9d-43ca-8ede-72832062e8c1 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:45:39.166670 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-7027aa11-fa9d-43ca-8ede-72832062e8c1 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:45:39.167878 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-7027aa11-fa9d-43ca-8ede-72832062e8c1 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] 10.222.0.66 "GET /compute/v2.1/servers/3bf41d49-2b84-4f59-a019-a8b1e45891d1" status: 200 len: 1808 microversion: 2.20 time: 0.158000 Aug 04 03:45:39.168436 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 353/705] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 03:45:39 2022] GET /compute/v2.1/servers/3bf41d49-2b84-4f59-a019-a8b1e45891d1 => generated 1808 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 03:45:39.303946 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-6dee8dbc-e99f-40a4-b2a0-e5cf855320af tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:45:39.304677 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-6dee8dbc-e99f-40a4-b2a0-e5cf855320af tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] [instance: d097d81a-1bae-45f2-a34f-444776c8e1cb] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:45:39.310740 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-6dee8dbc-e99f-40a4-b2a0-e5cf855320af tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:45:39.311190 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-6dee8dbc-e99f-40a4-b2a0-e5cf855320af tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:45:39.311948 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-6dee8dbc-e99f-40a4-b2a0-e5cf855320af tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:45:39.312387 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-6dee8dbc-e99f-40a4-b2a0-e5cf855320af tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:45:39.449165 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-6dee8dbc-e99f-40a4-b2a0-e5cf855320af tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc12077b11448a3b1ec2e7dbf2707ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf95e3e43d0e482ba4d27b769fb48628', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:45:39.456513 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-6dee8dbc-e99f-40a4-b2a0-e5cf855320af tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] 10.222.0.66 "GET /compute/v2.1/servers/d097d81a-1bae-45f2-a34f-444776c8e1cb" status: 200 len: 1566 microversion: 2.1 time: 0.156412 Aug 04 03:45:39.457067 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 353/706] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:45:39 2022] GET /compute/v2.1/servers/d097d81a-1bae-45f2-a34f-444776c8e1cb => generated 1566 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:45:40.190891 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-a576f521-33c1-49c1-8dd7-fadb34d9229a tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:45:40.191523 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-a576f521-33c1-49c1-8dd7-fadb34d9229a tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] [instance: 3bf41d49-2b84-4f59-a019-a8b1e45891d1] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:45:40.198536 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-a576f521-33c1-49c1-8dd7-fadb34d9229a tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:45:40.198980 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-a576f521-33c1-49c1-8dd7-fadb34d9229a tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:45:40.199734 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-a576f521-33c1-49c1-8dd7-fadb34d9229a tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:45:40.200179 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-a576f521-33c1-49c1-8dd7-fadb34d9229a tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:45:40.329512 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-a576f521-33c1-49c1-8dd7-fadb34d9229a tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:45:40.338764 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-a576f521-33c1-49c1-8dd7-fadb34d9229a tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:45:40.340272 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-a576f521-33c1-49c1-8dd7-fadb34d9229a tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:45:40.341446 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-a576f521-33c1-49c1-8dd7-fadb34d9229a tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] 10.222.0.66 "GET /compute/v2.1/servers/3bf41d49-2b84-4f59-a019-a8b1e45891d1" status: 200 len: 1795 microversion: 2.20 time: 0.154378 Aug 04 03:45:40.341992 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 354/707] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 03:45:40 2022] GET /compute/v2.1/servers/3bf41d49-2b84-4f59-a019-a8b1e45891d1 => generated 1795 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 03:45:40.477570 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-3e8a8138-18ba-463e-bd1f-1c174a3980b6 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:45:40.478111 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-3e8a8138-18ba-463e-bd1f-1c174a3980b6 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] [instance: d097d81a-1bae-45f2-a34f-444776c8e1cb] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:45:40.484869 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-3e8a8138-18ba-463e-bd1f-1c174a3980b6 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:45:40.485366 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-3e8a8138-18ba-463e-bd1f-1c174a3980b6 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:45:40.486145 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-3e8a8138-18ba-463e-bd1f-1c174a3980b6 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:45:40.486588 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-3e8a8138-18ba-463e-bd1f-1c174a3980b6 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:45:40.619427 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-3e8a8138-18ba-463e-bd1f-1c174a3980b6 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc12077b11448a3b1ec2e7dbf2707ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf95e3e43d0e482ba4d27b769fb48628', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:45:40.626929 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-3e8a8138-18ba-463e-bd1f-1c174a3980b6 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] 10.222.0.66 "GET /compute/v2.1/servers/d097d81a-1bae-45f2-a34f-444776c8e1cb" status: 200 len: 1566 microversion: 2.1 time: 0.153903 Aug 04 03:45:40.627530 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 354/708] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:45:40 2022] GET /compute/v2.1/servers/d097d81a-1bae-45f2-a34f-444776c8e1cb => generated 1566 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:45:41.649867 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-3b7209f5-ee8f-46ac-8e39-9b049329c4ab tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:45:41.650476 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-3b7209f5-ee8f-46ac-8e39-9b049329c4ab tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] [instance: d097d81a-1bae-45f2-a34f-444776c8e1cb] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:45:41.656867 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-3b7209f5-ee8f-46ac-8e39-9b049329c4ab tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:45:41.657341 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-3b7209f5-ee8f-46ac-8e39-9b049329c4ab tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:45:41.658097 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-3b7209f5-ee8f-46ac-8e39-9b049329c4ab tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:45:41.658529 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-3b7209f5-ee8f-46ac-8e39-9b049329c4ab tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:45:41.790540 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-3b7209f5-ee8f-46ac-8e39-9b049329c4ab tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc12077b11448a3b1ec2e7dbf2707ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf95e3e43d0e482ba4d27b769fb48628', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:45:41.798243 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-3b7209f5-ee8f-46ac-8e39-9b049329c4ab tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] 10.222.0.66 "GET /compute/v2.1/servers/d097d81a-1bae-45f2-a34f-444776c8e1cb" status: 200 len: 1566 microversion: 2.1 time: 0.153342 Aug 04 03:45:41.798799 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 355/709] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:45:41 2022] GET /compute/v2.1/servers/d097d81a-1bae-45f2-a34f-444776c8e1cb => generated 1566 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:45:42.819239 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-cbc95c58-18ab-4fe7-8abf-9b40a8662c37 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:45:42.819887 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-cbc95c58-18ab-4fe7-8abf-9b40a8662c37 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] [instance: d097d81a-1bae-45f2-a34f-444776c8e1cb] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:45:42.826669 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-cbc95c58-18ab-4fe7-8abf-9b40a8662c37 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:45:42.827111 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-cbc95c58-18ab-4fe7-8abf-9b40a8662c37 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:45:42.827862 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-cbc95c58-18ab-4fe7-8abf-9b40a8662c37 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:45:42.828295 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-cbc95c58-18ab-4fe7-8abf-9b40a8662c37 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:45:42.958068 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-cbc95c58-18ab-4fe7-8abf-9b40a8662c37 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc12077b11448a3b1ec2e7dbf2707ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf95e3e43d0e482ba4d27b769fb48628', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:45:42.966247 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-cbc95c58-18ab-4fe7-8abf-9b40a8662c37 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] 10.222.0.66 "GET /compute/v2.1/servers/d097d81a-1bae-45f2-a34f-444776c8e1cb" status: 200 len: 1566 microversion: 2.1 time: 0.150809 Aug 04 03:45:42.966807 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 355/710] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:45:42 2022] GET /compute/v2.1/servers/d097d81a-1bae-45f2-a34f-444776c8e1cb => generated 1566 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:45:43.986812 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-e37e0e04-6a82-4f96-b1ee-b075b4a970ac tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:45:43.987454 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-e37e0e04-6a82-4f96-b1ee-b075b4a970ac tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] [instance: d097d81a-1bae-45f2-a34f-444776c8e1cb] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:45:43.994349 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-e37e0e04-6a82-4f96-b1ee-b075b4a970ac tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:45:43.994855 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-e37e0e04-6a82-4f96-b1ee-b075b4a970ac tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:45:43.995570 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-e37e0e04-6a82-4f96-b1ee-b075b4a970ac tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:45:43.996001 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-e37e0e04-6a82-4f96-b1ee-b075b4a970ac tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:45:44.132208 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-e37e0e04-6a82-4f96-b1ee-b075b4a970ac tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc12077b11448a3b1ec2e7dbf2707ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf95e3e43d0e482ba4d27b769fb48628', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:45:44.140341 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-e37e0e04-6a82-4f96-b1ee-b075b4a970ac tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] 10.222.0.66 "GET /compute/v2.1/servers/d097d81a-1bae-45f2-a34f-444776c8e1cb" status: 200 len: 1566 microversion: 2.1 time: 0.157608 Aug 04 03:45:44.140898 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 356/711] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:45:43 2022] GET /compute/v2.1/servers/d097d81a-1bae-45f2-a34f-444776c8e1cb => generated 1566 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:45:45.161456 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-bf6f057f-b766-4418-8db9-108f921853e7 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:45:45.162071 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-bf6f057f-b766-4418-8db9-108f921853e7 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] [instance: d097d81a-1bae-45f2-a34f-444776c8e1cb] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:45:45.168689 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-bf6f057f-b766-4418-8db9-108f921853e7 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:45:45.169136 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-bf6f057f-b766-4418-8db9-108f921853e7 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:45:45.169934 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-bf6f057f-b766-4418-8db9-108f921853e7 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:45:45.170373 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-bf6f057f-b766-4418-8db9-108f921853e7 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:45:45.300162 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-bf6f057f-b766-4418-8db9-108f921853e7 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc12077b11448a3b1ec2e7dbf2707ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf95e3e43d0e482ba4d27b769fb48628', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:45:45.308260 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-bf6f057f-b766-4418-8db9-108f921853e7 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] 10.222.0.66 "GET /compute/v2.1/servers/d097d81a-1bae-45f2-a34f-444776c8e1cb" status: 200 len: 1566 microversion: 2.1 time: 0.150716 Aug 04 03:45:45.308825 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 356/712] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:45:45 2022] GET /compute/v2.1/servers/d097d81a-1bae-45f2-a34f-444776c8e1cb => generated 1566 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:45:46.328526 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-bc9ecdc1-c563-40d4-809f-fa11034e5bce tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:45:46.329163 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-bc9ecdc1-c563-40d4-809f-fa11034e5bce tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] [instance: d097d81a-1bae-45f2-a34f-444776c8e1cb] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:45:46.336346 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-bc9ecdc1-c563-40d4-809f-fa11034e5bce tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:45:46.336803 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-bc9ecdc1-c563-40d4-809f-fa11034e5bce tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:45:46.337588 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-bc9ecdc1-c563-40d4-809f-fa11034e5bce tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:45:46.338024 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-bc9ecdc1-c563-40d4-809f-fa11034e5bce tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:45:46.483620 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-bc9ecdc1-c563-40d4-809f-fa11034e5bce tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc12077b11448a3b1ec2e7dbf2707ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf95e3e43d0e482ba4d27b769fb48628', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:45:46.487013 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG dbcounter [-] [130262] Writing DB stats nova_cell1:SELECT=100 {{(pid=130262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:45:46.491374 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-bc9ecdc1-c563-40d4-809f-fa11034e5bce tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] 10.222.0.66 "GET /compute/v2.1/servers/d097d81a-1bae-45f2-a34f-444776c8e1cb" status: 200 len: 1566 microversion: 2.1 time: 0.166704 Aug 04 03:45:46.492500 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 357/713] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:45:46 2022] GET /compute/v2.1/servers/d097d81a-1bae-45f2-a34f-444776c8e1cb => generated 1566 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:45:47.513565 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-3a8b2352-4e77-4395-8f6a-1dacfff96627 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:45:47.514175 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-3a8b2352-4e77-4395-8f6a-1dacfff96627 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] [instance: d097d81a-1bae-45f2-a34f-444776c8e1cb] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:45:47.520691 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-3a8b2352-4e77-4395-8f6a-1dacfff96627 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:45:47.521142 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-3a8b2352-4e77-4395-8f6a-1dacfff96627 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:45:47.521933 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-3a8b2352-4e77-4395-8f6a-1dacfff96627 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:45:47.522367 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-3a8b2352-4e77-4395-8f6a-1dacfff96627 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:45:47.653131 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-3a8b2352-4e77-4395-8f6a-1dacfff96627 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc12077b11448a3b1ec2e7dbf2707ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf95e3e43d0e482ba4d27b769fb48628', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:45:47.660664 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-3a8b2352-4e77-4395-8f6a-1dacfff96627 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] 10.222.0.66 "GET /compute/v2.1/servers/d097d81a-1bae-45f2-a34f-444776c8e1cb" status: 200 len: 1566 microversion: 2.1 time: 0.151058 Aug 04 03:45:47.661239 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 357/714] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:45:47 2022] GET /compute/v2.1/servers/d097d81a-1bae-45f2-a34f-444776c8e1cb => generated 1566 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:45:48.681400 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-af22f3cd-7bde-418a-9616-b7e7289f277e tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:45:48.682043 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-af22f3cd-7bde-418a-9616-b7e7289f277e tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] [instance: d097d81a-1bae-45f2-a34f-444776c8e1cb] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:45:48.689064 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-af22f3cd-7bde-418a-9616-b7e7289f277e tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:45:48.689567 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-af22f3cd-7bde-418a-9616-b7e7289f277e tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:45:48.690322 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-af22f3cd-7bde-418a-9616-b7e7289f277e tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:45:48.690754 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-af22f3cd-7bde-418a-9616-b7e7289f277e tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:45:48.821157 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-af22f3cd-7bde-418a-9616-b7e7289f277e tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc12077b11448a3b1ec2e7dbf2707ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf95e3e43d0e482ba4d27b769fb48628', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:45:48.828527 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-af22f3cd-7bde-418a-9616-b7e7289f277e tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] 10.222.0.66 "GET /compute/v2.1/servers/d097d81a-1bae-45f2-a34f-444776c8e1cb" status: 200 len: 1566 microversion: 2.1 time: 0.151648 Aug 04 03:45:48.829086 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 358/715] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:45:48 2022] GET /compute/v2.1/servers/d097d81a-1bae-45f2-a34f-444776c8e1cb => generated 1566 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:45:49.849277 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-dc58659a-087b-4c56-a937-6b436add9a36 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:45:49.849844 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-dc58659a-087b-4c56-a937-6b436add9a36 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] [instance: d097d81a-1bae-45f2-a34f-444776c8e1cb] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:45:49.858474 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-dc58659a-087b-4c56-a937-6b436add9a36 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:45:49.858924 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-dc58659a-087b-4c56-a937-6b436add9a36 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:45:49.859683 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-dc58659a-087b-4c56-a937-6b436add9a36 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:45:49.860118 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-dc58659a-087b-4c56-a937-6b436add9a36 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:45:49.993954 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-dc58659a-087b-4c56-a937-6b436add9a36 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc12077b11448a3b1ec2e7dbf2707ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf95e3e43d0e482ba4d27b769fb48628', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:45:50.001449 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-dc58659a-087b-4c56-a937-6b436add9a36 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] 10.222.0.66 "GET /compute/v2.1/servers/d097d81a-1bae-45f2-a34f-444776c8e1cb" status: 200 len: 1566 microversion: 2.1 time: 0.156072 Aug 04 03:45:50.002021 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 358/716] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:45:49 2022] GET /compute/v2.1/servers/d097d81a-1bae-45f2-a34f-444776c8e1cb => generated 1566 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:45:51.022397 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-ed4ed7d8-fe83-4ef6-ae6d-451aa0c70257 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:45:51.023071 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-ed4ed7d8-fe83-4ef6-ae6d-451aa0c70257 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] [instance: d097d81a-1bae-45f2-a34f-444776c8e1cb] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:45:51.029684 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-ed4ed7d8-fe83-4ef6-ae6d-451aa0c70257 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:45:51.030126 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-ed4ed7d8-fe83-4ef6-ae6d-451aa0c70257 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:45:51.030874 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-ed4ed7d8-fe83-4ef6-ae6d-451aa0c70257 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:45:51.031305 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-ed4ed7d8-fe83-4ef6-ae6d-451aa0c70257 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:45:51.161760 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-ed4ed7d8-fe83-4ef6-ae6d-451aa0c70257 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc12077b11448a3b1ec2e7dbf2707ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf95e3e43d0e482ba4d27b769fb48628', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:45:51.169431 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-ed4ed7d8-fe83-4ef6-ae6d-451aa0c70257 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] 10.222.0.66 "GET /compute/v2.1/servers/d097d81a-1bae-45f2-a34f-444776c8e1cb" status: 200 len: 1566 microversion: 2.1 time: 0.150855 Aug 04 03:45:51.170001 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 359/717] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:45:51 2022] GET /compute/v2.1/servers/d097d81a-1bae-45f2-a34f-444776c8e1cb => generated 1566 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:45:52.190543 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-2eb6a03d-cb4b-451a-871c-12f4bb73f17e tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:45:52.191151 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-2eb6a03d-cb4b-451a-871c-12f4bb73f17e tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] [instance: d097d81a-1bae-45f2-a34f-444776c8e1cb] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:45:52.197711 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-2eb6a03d-cb4b-451a-871c-12f4bb73f17e tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:45:52.198158 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-2eb6a03d-cb4b-451a-871c-12f4bb73f17e tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:45:52.198919 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-2eb6a03d-cb4b-451a-871c-12f4bb73f17e tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:45:52.199353 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-2eb6a03d-cb4b-451a-871c-12f4bb73f17e tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:45:52.336376 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-2eb6a03d-cb4b-451a-871c-12f4bb73f17e tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc12077b11448a3b1ec2e7dbf2707ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf95e3e43d0e482ba4d27b769fb48628', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:45:52.343795 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-2eb6a03d-cb4b-451a-871c-12f4bb73f17e tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] 10.222.0.66 "GET /compute/v2.1/servers/d097d81a-1bae-45f2-a34f-444776c8e1cb" status: 200 len: 1566 microversion: 2.1 time: 0.157163 Aug 04 03:45:52.344351 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 359/718] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:45:52 2022] GET /compute/v2.1/servers/d097d81a-1bae-45f2-a34f-444776c8e1cb => generated 1566 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:45:53.366992 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-2e085d75-00f9-4935-bbf4-839762faf935 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:45:53.367763 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-2e085d75-00f9-4935-bbf4-839762faf935 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] [instance: d097d81a-1bae-45f2-a34f-444776c8e1cb] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:45:53.374538 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-2e085d75-00f9-4935-bbf4-839762faf935 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:45:53.374987 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-2e085d75-00f9-4935-bbf4-839762faf935 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:45:53.375744 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-2e085d75-00f9-4935-bbf4-839762faf935 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:45:53.376271 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-2e085d75-00f9-4935-bbf4-839762faf935 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:45:53.505036 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-2e085d75-00f9-4935-bbf4-839762faf935 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc12077b11448a3b1ec2e7dbf2707ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf95e3e43d0e482ba4d27b769fb48628', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:45:53.513018 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-2e085d75-00f9-4935-bbf4-839762faf935 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] 10.222.0.66 "GET /compute/v2.1/servers/d097d81a-1bae-45f2-a34f-444776c8e1cb" status: 200 len: 1566 microversion: 2.1 time: 0.150234 Aug 04 03:45:53.513620 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 360/719] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:45:53 2022] GET /compute/v2.1/servers/d097d81a-1bae-45f2-a34f-444776c8e1cb => generated 1566 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:45:54.534171 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-044cde51-d0ea-49ef-ae00-c500fc3c3a2c tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:45:54.534715 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-044cde51-d0ea-49ef-ae00-c500fc3c3a2c tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] [instance: d097d81a-1bae-45f2-a34f-444776c8e1cb] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:45:54.537306 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG dbcounter [-] [130263] Writing DB stats nova_api:SELECT=50 {{(pid=130263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:45:54.542792 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-044cde51-d0ea-49ef-ae00-c500fc3c3a2c tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:45:54.543249 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-044cde51-d0ea-49ef-ae00-c500fc3c3a2c tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:45:54.549706 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-044cde51-d0ea-49ef-ae00-c500fc3c3a2c tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:45:54.549706 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-044cde51-d0ea-49ef-ae00-c500fc3c3a2c tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:45:54.682151 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-044cde51-d0ea-49ef-ae00-c500fc3c3a2c tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc12077b11448a3b1ec2e7dbf2707ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf95e3e43d0e482ba4d27b769fb48628', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:45:54.687847 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG dbcounter [-] [130263] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=130263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:45:54.690660 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-044cde51-d0ea-49ef-ae00-c500fc3c3a2c tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] 10.222.0.66 "GET /compute/v2.1/servers/d097d81a-1bae-45f2-a34f-444776c8e1cb" status: 200 len: 1566 microversion: 2.1 time: 0.160557 Aug 04 03:45:54.691417 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 360/720] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:45:54 2022] GET /compute/v2.1/servers/d097d81a-1bae-45f2-a34f-444776c8e1cb => generated 1566 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:45:55.711799 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-b9876b7a-e8aa-40d7-8783-39438aa40e9b tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:45:55.712399 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-b9876b7a-e8aa-40d7-8783-39438aa40e9b tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] [instance: d097d81a-1bae-45f2-a34f-444776c8e1cb] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:45:55.714918 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG dbcounter [-] [130262] Writing DB stats nova_api:SELECT=50 {{(pid=130262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:45:55.719597 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-b9876b7a-e8aa-40d7-8783-39438aa40e9b tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:45:55.720039 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-b9876b7a-e8aa-40d7-8783-39438aa40e9b tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:45:55.720789 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-b9876b7a-e8aa-40d7-8783-39438aa40e9b tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:45:55.721234 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-b9876b7a-e8aa-40d7-8783-39438aa40e9b tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:45:55.851266 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-b9876b7a-e8aa-40d7-8783-39438aa40e9b tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc12077b11448a3b1ec2e7dbf2707ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf95e3e43d0e482ba4d27b769fb48628', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:45:55.859441 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-b9876b7a-e8aa-40d7-8783-39438aa40e9b tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] 10.222.0.66 "GET /compute/v2.1/servers/d097d81a-1bae-45f2-a34f-444776c8e1cb" status: 200 len: 1566 microversion: 2.1 time: 0.151553 Aug 04 03:45:55.859995 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 361/721] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:45:55 2022] GET /compute/v2.1/servers/d097d81a-1bae-45f2-a34f-444776c8e1cb => generated 1566 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:45:56.771931 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 03:45:56.772465 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Thu Aug 4 03:45:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 03:45:56.881359 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-547a2486-e388-4c82-8268-2d41c255e321 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:45:56.881971 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-547a2486-e388-4c82-8268-2d41c255e321 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] [instance: d097d81a-1bae-45f2-a34f-444776c8e1cb] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:45:56.890196 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-547a2486-e388-4c82-8268-2d41c255e321 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:45:56.892796 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-547a2486-e388-4c82-8268-2d41c255e321 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:45:56.892796 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-547a2486-e388-4c82-8268-2d41c255e321 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:45:56.892796 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-547a2486-e388-4c82-8268-2d41c255e321 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:45:57.022471 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-547a2486-e388-4c82-8268-2d41c255e321 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc12077b11448a3b1ec2e7dbf2707ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf95e3e43d0e482ba4d27b769fb48628', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:45:57.030067 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-547a2486-e388-4c82-8268-2d41c255e321 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] 10.222.0.66 "GET /compute/v2.1/servers/d097d81a-1bae-45f2-a34f-444776c8e1cb" status: 200 len: 1566 microversion: 2.1 time: 0.152621 Aug 04 03:45:57.030689 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 361/722] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:45:56 2022] GET /compute/v2.1/servers/d097d81a-1bae-45f2-a34f-444776c8e1cb => generated 1566 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:45:58.050975 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-a5f6ae99-5bd5-4a26-a453-c6914f8ccbd7 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:45:58.051580 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-a5f6ae99-5bd5-4a26-a453-c6914f8ccbd7 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] [instance: d097d81a-1bae-45f2-a34f-444776c8e1cb] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:45:58.058666 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-a5f6ae99-5bd5-4a26-a453-c6914f8ccbd7 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:45:58.059106 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-a5f6ae99-5bd5-4a26-a453-c6914f8ccbd7 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:45:58.059855 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-a5f6ae99-5bd5-4a26-a453-c6914f8ccbd7 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:45:58.060286 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-a5f6ae99-5bd5-4a26-a453-c6914f8ccbd7 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:45:58.193763 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-a5f6ae99-5bd5-4a26-a453-c6914f8ccbd7 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc12077b11448a3b1ec2e7dbf2707ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf95e3e43d0e482ba4d27b769fb48628', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:45:58.201038 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-a5f6ae99-5bd5-4a26-a453-c6914f8ccbd7 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] 10.222.0.66 "GET /compute/v2.1/servers/d097d81a-1bae-45f2-a34f-444776c8e1cb" status: 200 len: 1507 microversion: 2.1 time: 0.153885 Aug 04 03:45:58.201621 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 362/723] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:45:58 2022] GET /compute/v2.1/servers/d097d81a-1bae-45f2-a34f-444776c8e1cb => generated 1507 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:45:58.221126 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-0e85d556-8757-49ae-81e0-f9f6dc932589 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 03:45:58.221751 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-0e85d556-8757-49ae-81e0-f9f6dc932589 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] [instance: d097d81a-1bae-45f2-a34f-444776c8e1cb] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:45:58.228852 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-0e85d556-8757-49ae-81e0-f9f6dc932589 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:45:58.229328 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-0e85d556-8757-49ae-81e0-f9f6dc932589 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:45:58.230092 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-0e85d556-8757-49ae-81e0-f9f6dc932589 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:45:58.230533 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-0e85d556-8757-49ae-81e0-f9f6dc932589 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:45:58.317187 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-0e85d556-8757-49ae-81e0-f9f6dc932589 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] [instance: d097d81a-1bae-45f2-a34f-444776c8e1cb] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=130263) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 04 03:45:58.597423 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-0e85d556-8757-49ae-81e0-f9f6dc932589 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] 10.222.0.66 "POST /compute/v2.1/servers/d097d81a-1bae-45f2-a34f-444776c8e1cb/action" status: 202 len: 0 microversion: 2.1 time: 0.379912 Aug 04 03:45:58.597955 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 362/724] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 03:45:58 2022] POST /compute/v2.1/servers/d097d81a-1bae-45f2-a34f-444776c8e1cb/action => generated 0 bytes in 381 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 03:45:58.607164 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-873b148d-68f3-486b-8f61-0f122ff1c27c tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:45:58.608063 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-873b148d-68f3-486b-8f61-0f122ff1c27c tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] [instance: d097d81a-1bae-45f2-a34f-444776c8e1cb] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:45:58.614006 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-873b148d-68f3-486b-8f61-0f122ff1c27c tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:45:58.614449 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-873b148d-68f3-486b-8f61-0f122ff1c27c tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:45:58.615201 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-873b148d-68f3-486b-8f61-0f122ff1c27c tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:45:58.615628 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-873b148d-68f3-486b-8f61-0f122ff1c27c tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:45:58.749673 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-873b148d-68f3-486b-8f61-0f122ff1c27c tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc12077b11448a3b1ec2e7dbf2707ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf95e3e43d0e482ba4d27b769fb48628', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:45:58.757333 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-873b148d-68f3-486b-8f61-0f122ff1c27c tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] 10.222.0.66 "GET /compute/v2.1/servers/d097d81a-1bae-45f2-a34f-444776c8e1cb" status: 200 len: 1515 microversion: 2.1 time: 0.153940 Aug 04 03:45:58.758409 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 363/725] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:45:58 2022] GET /compute/v2.1/servers/d097d81a-1bae-45f2-a34f-444776c8e1cb => generated 1515 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:45:59.779132 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-233718a1-67d6-4016-9d3a-d383d527830e tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:45:59.779665 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-233718a1-67d6-4016-9d3a-d383d527830e tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] [instance: d097d81a-1bae-45f2-a34f-444776c8e1cb] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:45:59.787019 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-233718a1-67d6-4016-9d3a-d383d527830e tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:45:59.787467 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-233718a1-67d6-4016-9d3a-d383d527830e tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:45:59.788223 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-233718a1-67d6-4016-9d3a-d383d527830e tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:45:59.788660 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-233718a1-67d6-4016-9d3a-d383d527830e tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:45:59.917708 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-233718a1-67d6-4016-9d3a-d383d527830e tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc12077b11448a3b1ec2e7dbf2707ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf95e3e43d0e482ba4d27b769fb48628', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:45:59.925307 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-233718a1-67d6-4016-9d3a-d383d527830e tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] 10.222.0.66 "GET /compute/v2.1/servers/d097d81a-1bae-45f2-a34f-444776c8e1cb" status: 200 len: 1515 microversion: 2.1 time: 0.150162 Aug 04 03:45:59.925869 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 363/726] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:45:59 2022] GET /compute/v2.1/servers/d097d81a-1bae-45f2-a34f-444776c8e1cb => generated 1515 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:46:00.226480 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [req-f03f0303-ea73-4efe-b1dd-d85ff01e276f req-9f43fd25-f15b-4433-8d4d-b17d2eff1efb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d097d81a-1bae-45f2-a34f-444776c8e1cb", "name": "network-vif-unplugged", "status": "completed", "tag": "118548b5-15c3-4cd8-ab62-4c3490efe26d"}]} {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 03:46:00.236870 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [req-f03f0303-ea73-4efe-b1dd-d85ff01e276f req-9f43fd25-f15b-4433-8d4d-b17d2eff1efb service nova] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:00.242072 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [req-f03f0303-ea73-4efe-b1dd-d85ff01e276f req-9f43fd25-f15b-4433-8d4d-b17d2eff1efb service nova] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:00.248545 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.compute.server_external_events [req-f03f0303-ea73-4efe-b1dd-d85ff01e276f req-9f43fd25-f15b-4433-8d4d-b17d2eff1efb service nova] Unable to find a host for instance d097d81a-1bae-45f2-a34f-444776c8e1cb. Dropping event network-vif-unplugged {{(pid=130262) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 04 03:46:00.249438 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [req-f03f0303-ea73-4efe-b1dd-d85ff01e276f req-9f43fd25-f15b-4433-8d4d-b17d2eff1efb service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.026786 Aug 04 03:46:00.250002 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 364/727] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 03:46:00 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 28 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 04 03:46:00.948108 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-9027afa5-0dd4-4bd5-b86c-d371ede919c7 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:46:00.948649 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-9027afa5-0dd4-4bd5-b86c-d371ede919c7 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] [instance: d097d81a-1bae-45f2-a34f-444776c8e1cb] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:46:00.959765 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-9027afa5-0dd4-4bd5-b86c-d371ede919c7 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:00.959765 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-9027afa5-0dd4-4bd5-b86c-d371ede919c7 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:00.959765 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-9027afa5-0dd4-4bd5-b86c-d371ede919c7 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:00.959765 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-9027afa5-0dd4-4bd5-b86c-d371ede919c7 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:01.092269 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-9027afa5-0dd4-4bd5-b86c-d371ede919c7 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc12077b11448a3b1ec2e7dbf2707ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf95e3e43d0e482ba4d27b769fb48628', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:46:01.099651 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-9027afa5-0dd4-4bd5-b86c-d371ede919c7 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] 10.222.0.66 "GET /compute/v2.1/servers/d097d81a-1bae-45f2-a34f-444776c8e1cb" status: 200 len: 1517 microversion: 2.1 time: 0.156589 Aug 04 03:46:01.100204 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 364/728] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:46:00 2022] GET /compute/v2.1/servers/d097d81a-1bae-45f2-a34f-444776c8e1cb => generated 1517 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:46:02.121857 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-187b46ba-8c6a-4eb4-83f8-14fa774bc767 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:46:02.122454 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-187b46ba-8c6a-4eb4-83f8-14fa774bc767 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] [instance: d097d81a-1bae-45f2-a34f-444776c8e1cb] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:46:02.128892 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-187b46ba-8c6a-4eb4-83f8-14fa774bc767 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:02.129382 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-187b46ba-8c6a-4eb4-83f8-14fa774bc767 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:02.130178 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-187b46ba-8c6a-4eb4-83f8-14fa774bc767 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:02.130610 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-187b46ba-8c6a-4eb4-83f8-14fa774bc767 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:02.268899 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-187b46ba-8c6a-4eb4-83f8-14fa774bc767 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc12077b11448a3b1ec2e7dbf2707ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf95e3e43d0e482ba4d27b769fb48628', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:46:02.276754 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-187b46ba-8c6a-4eb4-83f8-14fa774bc767 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] 10.222.0.66 "GET /compute/v2.1/servers/d097d81a-1bae-45f2-a34f-444776c8e1cb" status: 200 len: 1517 microversion: 2.1 time: 0.159462 Aug 04 03:46:02.277348 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 365/729] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:46:02 2022] GET /compute/v2.1/servers/d097d81a-1bae-45f2-a34f-444776c8e1cb => generated 1517 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:46:03.297892 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-ddb71dbb-022f-4ba3-8942-248046d494e8 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:46:03.298510 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-ddb71dbb-022f-4ba3-8942-248046d494e8 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] [instance: d097d81a-1bae-45f2-a34f-444776c8e1cb] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:46:03.305329 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-ddb71dbb-022f-4ba3-8942-248046d494e8 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:03.305865 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-ddb71dbb-022f-4ba3-8942-248046d494e8 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:03.307263 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-ddb71dbb-022f-4ba3-8942-248046d494e8 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:03.307756 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-ddb71dbb-022f-4ba3-8942-248046d494e8 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:03.444852 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-ddb71dbb-022f-4ba3-8942-248046d494e8 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc12077b11448a3b1ec2e7dbf2707ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf95e3e43d0e482ba4d27b769fb48628', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:46:03.452481 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-ddb71dbb-022f-4ba3-8942-248046d494e8 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] 10.222.0.66 "GET /compute/v2.1/servers/d097d81a-1bae-45f2-a34f-444776c8e1cb" status: 200 len: 1573 microversion: 2.1 time: 0.158543 Aug 04 03:46:03.453059 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 365/730] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:46:03 2022] GET /compute/v2.1/servers/d097d81a-1bae-45f2-a34f-444776c8e1cb => generated 1573 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:46:04.473652 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-40656a72-34bf-4dae-a8f7-986799f8ed1f tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:46:04.474192 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-40656a72-34bf-4dae-a8f7-986799f8ed1f tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] [instance: d097d81a-1bae-45f2-a34f-444776c8e1cb] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:46:04.481421 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-40656a72-34bf-4dae-a8f7-986799f8ed1f tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:04.483914 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-40656a72-34bf-4dae-a8f7-986799f8ed1f tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:04.483914 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-40656a72-34bf-4dae-a8f7-986799f8ed1f tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:04.483914 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-40656a72-34bf-4dae-a8f7-986799f8ed1f tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:04.621435 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-40656a72-34bf-4dae-a8f7-986799f8ed1f tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc12077b11448a3b1ec2e7dbf2707ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf95e3e43d0e482ba4d27b769fb48628', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:46:04.627110 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-40656a72-34bf-4dae-a8f7-986799f8ed1f tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] 10.222.0.66 "GET /compute/v2.1/servers/d097d81a-1bae-45f2-a34f-444776c8e1cb" status: 200 len: 1573 microversion: 2.1 time: 0.157580 Aug 04 03:46:04.627763 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 366/731] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:46:04 2022] GET /compute/v2.1/servers/d097d81a-1bae-45f2-a34f-444776c8e1cb => generated 1573 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:46:05.649949 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-59d93b91-63be-4a74-8935-6b45e22b6e01 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:46:05.650494 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-59d93b91-63be-4a74-8935-6b45e22b6e01 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] [instance: d097d81a-1bae-45f2-a34f-444776c8e1cb] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:46:05.657025 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-59d93b91-63be-4a74-8935-6b45e22b6e01 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:05.657514 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-59d93b91-63be-4a74-8935-6b45e22b6e01 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:05.658273 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-59d93b91-63be-4a74-8935-6b45e22b6e01 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:05.658720 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-59d93b91-63be-4a74-8935-6b45e22b6e01 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:05.787880 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-59d93b91-63be-4a74-8935-6b45e22b6e01 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc12077b11448a3b1ec2e7dbf2707ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf95e3e43d0e482ba4d27b769fb48628', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:46:05.795426 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-59d93b91-63be-4a74-8935-6b45e22b6e01 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] 10.222.0.66 "GET /compute/v2.1/servers/d097d81a-1bae-45f2-a34f-444776c8e1cb" status: 200 len: 1573 microversion: 2.1 time: 0.150001 Aug 04 03:46:05.795981 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 366/732] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:46:05 2022] GET /compute/v2.1/servers/d097d81a-1bae-45f2-a34f-444776c8e1cb => generated 1573 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:46:05.926192 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-6c816a0e-96d0-4286-8a0a-c455f04a3e63 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:46:05.926679 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-6c816a0e-96d0-4286-8a0a-c455f04a3e63 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] [instance: f69fd00d-cf45-4c17-aee5-701e87ebab82] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:46:05.933180 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-6c816a0e-96d0-4286-8a0a-c455f04a3e63 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:05.933663 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-6c816a0e-96d0-4286-8a0a-c455f04a3e63 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:05.934429 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-6c816a0e-96d0-4286-8a0a-c455f04a3e63 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:05.934864 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-6c816a0e-96d0-4286-8a0a-c455f04a3e63 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:06.015532 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.objects.instance [None req-6c816a0e-96d0-4286-8a0a-c455f04a3e63 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lazy-loading 'services' on Instance uuid f69fd00d-cf45-4c17-aee5-701e87ebab82 {{(pid=130262) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 03:46:06.224099 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-6c816a0e-96d0-4286-8a0a-c455f04a3e63 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] 10.222.0.66 "DELETE /compute/v2.1/servers/f69fd00d-cf45-4c17-aee5-701e87ebab82/os-volume_attachments/b94cd936-978d-4beb-a0db-308b6c06ce5d" status: 202 len: 0 microversion: 2.1 time: 0.301391 Aug 04 03:46:06.224722 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 367/733] 10.222.0.66 () {58 vars in 1416 bytes} [Thu Aug 4 03:46:05 2022] DELETE /compute/v2.1/servers/f69fd00d-cf45-4c17-aee5-701e87ebab82/os-volume_attachments/b94cd936-978d-4beb-a0db-308b6c06ce5d => generated 0 bytes in 303 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 03:46:06.233456 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-51e9f70d-25cf-4dd0-8793-29fbf3485697 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:46:06.235685 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-51e9f70d-25cf-4dd0-8793-29fbf3485697 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] [instance: f69fd00d-cf45-4c17-aee5-701e87ebab82] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:46:06.241666 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-51e9f70d-25cf-4dd0-8793-29fbf3485697 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:06.242111 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-51e9f70d-25cf-4dd0-8793-29fbf3485697 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:06.245712 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-51e9f70d-25cf-4dd0-8793-29fbf3485697 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:06.246185 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-51e9f70d-25cf-4dd0-8793-29fbf3485697 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:06.276721 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-51e9f70d-25cf-4dd0-8793-29fbf3485697 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] 10.222.0.66 "GET /compute/v2.1/servers/f69fd00d-cf45-4c17-aee5-701e87ebab82/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047414 Aug 04 03:46:06.277296 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 367/734] 10.222.0.66 () {58 vars in 1302 bytes} [Thu Aug 4 03:46:06 2022] GET /compute/v2.1/servers/f69fd00d-cf45-4c17-aee5-701e87ebab82/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 03:46:06.816917 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-feb94d67-2848-4086-84de-25199aa7ce2f tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:46:06.817687 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-feb94d67-2848-4086-84de-25199aa7ce2f tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] [instance: d097d81a-1bae-45f2-a34f-444776c8e1cb] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:46:06.824045 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-feb94d67-2848-4086-84de-25199aa7ce2f tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:06.824499 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-feb94d67-2848-4086-84de-25199aa7ce2f tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:06.825292 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-feb94d67-2848-4086-84de-25199aa7ce2f tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:06.825729 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-feb94d67-2848-4086-84de-25199aa7ce2f tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:06.969652 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-feb94d67-2848-4086-84de-25199aa7ce2f tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc12077b11448a3b1ec2e7dbf2707ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf95e3e43d0e482ba4d27b769fb48628', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:46:06.977545 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-feb94d67-2848-4086-84de-25199aa7ce2f tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] 10.222.0.66 "GET /compute/v2.1/servers/d097d81a-1bae-45f2-a34f-444776c8e1cb" status: 200 len: 1573 microversion: 2.1 time: 0.164500 Aug 04 03:46:06.978115 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 368/735] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:46:06 2022] GET /compute/v2.1/servers/d097d81a-1bae-45f2-a34f-444776c8e1cb => generated 1573 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:46:07.288990 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-cf382fcd-40f0-48be-b000-9eecf83384f2 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:46:07.291191 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-cf382fcd-40f0-48be-b000-9eecf83384f2 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] [instance: f69fd00d-cf45-4c17-aee5-701e87ebab82] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:46:07.298487 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-cf382fcd-40f0-48be-b000-9eecf83384f2 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:07.298932 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-cf382fcd-40f0-48be-b000-9eecf83384f2 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:07.299697 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-cf382fcd-40f0-48be-b000-9eecf83384f2 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:07.300127 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-cf382fcd-40f0-48be-b000-9eecf83384f2 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:07.330859 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-cf382fcd-40f0-48be-b000-9eecf83384f2 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] 10.222.0.66 "GET /compute/v2.1/servers/f69fd00d-cf45-4c17-aee5-701e87ebab82/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045987 Aug 04 03:46:07.331409 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 368/736] 10.222.0.66 () {58 vars in 1302 bytes} [Thu Aug 4 03:46:07 2022] GET /compute/v2.1/servers/f69fd00d-cf45-4c17-aee5-701e87ebab82/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 03:46:08.001523 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-998434c6-e974-4734-9d4e-565ec324f986 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:46:08.002139 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-998434c6-e974-4734-9d4e-565ec324f986 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] [instance: d097d81a-1bae-45f2-a34f-444776c8e1cb] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:46:08.008544 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-998434c6-e974-4734-9d4e-565ec324f986 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:08.008994 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-998434c6-e974-4734-9d4e-565ec324f986 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:08.009794 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-998434c6-e974-4734-9d4e-565ec324f986 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:08.010238 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-998434c6-e974-4734-9d4e-565ec324f986 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:08.141552 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-998434c6-e974-4734-9d4e-565ec324f986 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc12077b11448a3b1ec2e7dbf2707ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf95e3e43d0e482ba4d27b769fb48628', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:46:08.148824 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-998434c6-e974-4734-9d4e-565ec324f986 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] 10.222.0.66 "GET /compute/v2.1/servers/d097d81a-1bae-45f2-a34f-444776c8e1cb" status: 200 len: 1573 microversion: 2.1 time: 0.152303 Aug 04 03:46:08.149611 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 369/737] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:46:07 2022] GET /compute/v2.1/servers/d097d81a-1bae-45f2-a34f-444776c8e1cb => generated 1573 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:46:08.344607 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-8405d599-522b-4f0f-8bc7-7e9770fdd5bc tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:46:08.345845 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-8405d599-522b-4f0f-8bc7-7e9770fdd5bc tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] [instance: f69fd00d-cf45-4c17-aee5-701e87ebab82] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:46:08.352345 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-8405d599-522b-4f0f-8bc7-7e9770fdd5bc tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:08.352799 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-8405d599-522b-4f0f-8bc7-7e9770fdd5bc tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:08.353642 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-8405d599-522b-4f0f-8bc7-7e9770fdd5bc tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:08.354652 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-8405d599-522b-4f0f-8bc7-7e9770fdd5bc tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:08.382791 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-8405d599-522b-4f0f-8bc7-7e9770fdd5bc tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] 10.222.0.66 "GET /compute/v2.1/servers/f69fd00d-cf45-4c17-aee5-701e87ebab82/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043244 Aug 04 03:46:08.383374 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 369/738] 10.222.0.66 () {58 vars in 1302 bytes} [Thu Aug 4 03:46:08 2022] GET /compute/v2.1/servers/f69fd00d-cf45-4c17-aee5-701e87ebab82/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 03:46:08.459823 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-ab9deddd-c0b2-4ae6-9046-a19eb9b07009 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:46:08.460320 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-ab9deddd-c0b2-4ae6-9046-a19eb9b07009 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] [instance: f69fd00d-cf45-4c17-aee5-701e87ebab82] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:46:08.466906 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-ab9deddd-c0b2-4ae6-9046-a19eb9b07009 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:08.467351 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-ab9deddd-c0b2-4ae6-9046-a19eb9b07009 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:08.468106 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-ab9deddd-c0b2-4ae6-9046-a19eb9b07009 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:08.468537 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-ab9deddd-c0b2-4ae6-9046-a19eb9b07009 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:08.492433 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-ab9deddd-c0b2-4ae6-9046-a19eb9b07009 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] [instance: f69fd00d-cf45-4c17-aee5-701e87ebab82] Going to try to terminate instance {{(pid=130262) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 03:46:08.703877 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-ab9deddd-c0b2-4ae6-9046-a19eb9b07009 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] 10.222.0.66 "DELETE /compute/v2.1/servers/f69fd00d-cf45-4c17-aee5-701e87ebab82" status: 204 len: 0 microversion: 2.1 time: 0.247549 Aug 04 03:46:08.704524 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 370/739] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 03:46:08 2022] DELETE /compute/v2.1/servers/f69fd00d-cf45-4c17-aee5-701e87ebab82 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 03:46:08.712358 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-b4afffee-c439-4035-b8d8-d8aa11604cfb tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:46:08.714706 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-b4afffee-c439-4035-b8d8-d8aa11604cfb tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] [instance: f69fd00d-cf45-4c17-aee5-701e87ebab82] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:46:08.719829 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-b4afffee-c439-4035-b8d8-d8aa11604cfb tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:08.720318 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-b4afffee-c439-4035-b8d8-d8aa11604cfb tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:08.721102 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-b4afffee-c439-4035-b8d8-d8aa11604cfb tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:08.721573 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-b4afffee-c439-4035-b8d8-d8aa11604cfb tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:08.848339 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-b4afffee-c439-4035-b8d8-d8aa11604cfb tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec8d131a9764028a096314a4ecd58f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9ff6952b014d0a9abb28dcf0b818b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:46:08.855925 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-b4afffee-c439-4035-b8d8-d8aa11604cfb tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] 10.222.0.66 "GET /compute/v2.1/servers/f69fd00d-cf45-4c17-aee5-701e87ebab82" status: 200 len: 1690 microversion: 2.1 time: 0.147359 Aug 04 03:46:08.856490 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 370/740] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:46:08 2022] GET /compute/v2.1/servers/f69fd00d-cf45-4c17-aee5-701e87ebab82 => generated 1690 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:46:09.171584 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-3260ba63-93e0-4933-961d-2cf668323f09 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:46:09.172208 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-3260ba63-93e0-4933-961d-2cf668323f09 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] [instance: d097d81a-1bae-45f2-a34f-444776c8e1cb] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:46:09.178758 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-3260ba63-93e0-4933-961d-2cf668323f09 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:09.179206 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-3260ba63-93e0-4933-961d-2cf668323f09 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:09.179965 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-3260ba63-93e0-4933-961d-2cf668323f09 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:09.180396 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-3260ba63-93e0-4933-961d-2cf668323f09 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:09.313250 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-3260ba63-93e0-4933-961d-2cf668323f09 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc12077b11448a3b1ec2e7dbf2707ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf95e3e43d0e482ba4d27b769fb48628', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:46:09.320712 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-3260ba63-93e0-4933-961d-2cf668323f09 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] 10.222.0.66 "GET /compute/v2.1/servers/d097d81a-1bae-45f2-a34f-444776c8e1cb" status: 200 len: 1573 microversion: 2.1 time: 0.153497 Aug 04 03:46:09.321286 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 371/741] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:46:09 2022] GET /compute/v2.1/servers/d097d81a-1bae-45f2-a34f-444776c8e1cb => generated 1573 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:46:09.877535 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-7f81a7a0-2e6d-4bc5-baaa-79c3e4874e68 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:46:09.878131 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-7f81a7a0-2e6d-4bc5-baaa-79c3e4874e68 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] [instance: f69fd00d-cf45-4c17-aee5-701e87ebab82] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:46:09.884369 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-7f81a7a0-2e6d-4bc5-baaa-79c3e4874e68 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:09.884824 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-7f81a7a0-2e6d-4bc5-baaa-79c3e4874e68 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:09.886377 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-7f81a7a0-2e6d-4bc5-baaa-79c3e4874e68 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:09.886814 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-7f81a7a0-2e6d-4bc5-baaa-79c3e4874e68 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:10.015612 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-7f81a7a0-2e6d-4bc5-baaa-79c3e4874e68 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec8d131a9764028a096314a4ecd58f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9ff6952b014d0a9abb28dcf0b818b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:46:10.023045 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-7f81a7a0-2e6d-4bc5-baaa-79c3e4874e68 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] 10.222.0.66 "GET /compute/v2.1/servers/f69fd00d-cf45-4c17-aee5-701e87ebab82" status: 200 len: 1690 microversion: 2.1 time: 0.149422 Aug 04 03:46:10.023604 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 371/742] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:46:09 2022] GET /compute/v2.1/servers/f69fd00d-cf45-4c17-aee5-701e87ebab82 => generated 1690 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:46:10.341676 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-680444ab-84ce-4ba3-a547-5085a104d4d7 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:46:10.342289 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-680444ab-84ce-4ba3-a547-5085a104d4d7 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] [instance: d097d81a-1bae-45f2-a34f-444776c8e1cb] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:46:10.348852 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-680444ab-84ce-4ba3-a547-5085a104d4d7 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:10.349351 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-680444ab-84ce-4ba3-a547-5085a104d4d7 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:10.350119 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-680444ab-84ce-4ba3-a547-5085a104d4d7 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:10.350560 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-680444ab-84ce-4ba3-a547-5085a104d4d7 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:10.484400 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-680444ab-84ce-4ba3-a547-5085a104d4d7 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc12077b11448a3b1ec2e7dbf2707ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf95e3e43d0e482ba4d27b769fb48628', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:46:10.487910 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG dbcounter [-] [130262] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=130262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:46:10.492239 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-680444ab-84ce-4ba3-a547-5085a104d4d7 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] 10.222.0.66 "GET /compute/v2.1/servers/d097d81a-1bae-45f2-a34f-444776c8e1cb" status: 200 len: 1573 microversion: 2.1 time: 0.154967 Aug 04 03:46:10.492794 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 372/743] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:46:10 2022] GET /compute/v2.1/servers/d097d81a-1bae-45f2-a34f-444776c8e1cb => generated 1573 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:46:11.044808 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-153da290-8ef0-4a34-b5bf-6dc4026cd94f tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:46:11.045450 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-153da290-8ef0-4a34-b5bf-6dc4026cd94f tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] [instance: f69fd00d-cf45-4c17-aee5-701e87ebab82] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:46:11.051959 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-153da290-8ef0-4a34-b5bf-6dc4026cd94f tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:11.052402 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-153da290-8ef0-4a34-b5bf-6dc4026cd94f tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:11.053160 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-153da290-8ef0-4a34-b5bf-6dc4026cd94f tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:11.053617 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-153da290-8ef0-4a34-b5bf-6dc4026cd94f tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:11.182771 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-153da290-8ef0-4a34-b5bf-6dc4026cd94f tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec8d131a9764028a096314a4ecd58f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9ff6952b014d0a9abb28dcf0b818b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:46:11.190197 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-153da290-8ef0-4a34-b5bf-6dc4026cd94f tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] 10.222.0.66 "GET /compute/v2.1/servers/f69fd00d-cf45-4c17-aee5-701e87ebab82" status: 200 len: 1690 microversion: 2.1 time: 0.150126 Aug 04 03:46:11.190753 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 372/744] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:46:11 2022] GET /compute/v2.1/servers/f69fd00d-cf45-4c17-aee5-701e87ebab82 => generated 1690 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:46:11.514229 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-c34b03e8-fbcc-4e5c-b5fa-529ddc6d207a tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:46:11.514829 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-c34b03e8-fbcc-4e5c-b5fa-529ddc6d207a tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] [instance: d097d81a-1bae-45f2-a34f-444776c8e1cb] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:46:11.521816 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-c34b03e8-fbcc-4e5c-b5fa-529ddc6d207a tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:11.522257 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-c34b03e8-fbcc-4e5c-b5fa-529ddc6d207a tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:11.523003 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-c34b03e8-fbcc-4e5c-b5fa-529ddc6d207a tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:11.523429 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-c34b03e8-fbcc-4e5c-b5fa-529ddc6d207a tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:11.658061 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-c34b03e8-fbcc-4e5c-b5fa-529ddc6d207a tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc12077b11448a3b1ec2e7dbf2707ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf95e3e43d0e482ba4d27b769fb48628', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:46:11.665494 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-c34b03e8-fbcc-4e5c-b5fa-529ddc6d207a tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] 10.222.0.66 "GET /compute/v2.1/servers/d097d81a-1bae-45f2-a34f-444776c8e1cb" status: 200 len: 1573 microversion: 2.1 time: 0.156064 Aug 04 03:46:11.666055 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 373/745] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:46:11 2022] GET /compute/v2.1/servers/d097d81a-1bae-45f2-a34f-444776c8e1cb => generated 1573 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:46:12.211760 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-350d271e-eeee-4839-8014-416d72dd7398 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:46:12.212366 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-350d271e-eeee-4839-8014-416d72dd7398 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] [instance: f69fd00d-cf45-4c17-aee5-701e87ebab82] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:46:12.219040 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-350d271e-eeee-4839-8014-416d72dd7398 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:12.219434 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-350d271e-eeee-4839-8014-416d72dd7398 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:12.220169 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-350d271e-eeee-4839-8014-416d72dd7398 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:12.220600 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-350d271e-eeee-4839-8014-416d72dd7398 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:12.348123 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-350d271e-eeee-4839-8014-416d72dd7398 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec8d131a9764028a096314a4ecd58f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9ff6952b014d0a9abb28dcf0b818b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:46:12.356606 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-350d271e-eeee-4839-8014-416d72dd7398 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] 10.222.0.66 "GET /compute/v2.1/servers/f69fd00d-cf45-4c17-aee5-701e87ebab82" status: 200 len: 1690 microversion: 2.1 time: 0.148737 Aug 04 03:46:12.357170 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 373/746] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:46:12 2022] GET /compute/v2.1/servers/f69fd00d-cf45-4c17-aee5-701e87ebab82 => generated 1690 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:46:12.686356 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-c8b637fb-4d55-4528-8ee3-a9be3409d1fa tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:46:12.686996 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-c8b637fb-4d55-4528-8ee3-a9be3409d1fa tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] [instance: d097d81a-1bae-45f2-a34f-444776c8e1cb] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:46:12.693486 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-c8b637fb-4d55-4528-8ee3-a9be3409d1fa tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:12.693937 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-c8b637fb-4d55-4528-8ee3-a9be3409d1fa tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:12.694689 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-c8b637fb-4d55-4528-8ee3-a9be3409d1fa tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:12.695130 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-c8b637fb-4d55-4528-8ee3-a9be3409d1fa tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:12.824090 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-c8b637fb-4d55-4528-8ee3-a9be3409d1fa tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc12077b11448a3b1ec2e7dbf2707ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf95e3e43d0e482ba4d27b769fb48628', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:46:12.831586 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-c8b637fb-4d55-4528-8ee3-a9be3409d1fa tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] 10.222.0.66 "GET /compute/v2.1/servers/d097d81a-1bae-45f2-a34f-444776c8e1cb" status: 200 len: 1573 microversion: 2.1 time: 0.149258 Aug 04 03:46:12.832136 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 374/747] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:46:12 2022] GET /compute/v2.1/servers/d097d81a-1bae-45f2-a34f-444776c8e1cb => generated 1573 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:46:13.378304 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-73331ac8-180c-4fab-979f-8191eae89b41 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:46:13.378918 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-73331ac8-180c-4fab-979f-8191eae89b41 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] [instance: f69fd00d-cf45-4c17-aee5-701e87ebab82] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:46:13.385652 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-73331ac8-180c-4fab-979f-8191eae89b41 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:13.386123 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-73331ac8-180c-4fab-979f-8191eae89b41 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:13.386935 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-73331ac8-180c-4fab-979f-8191eae89b41 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:13.387415 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-73331ac8-180c-4fab-979f-8191eae89b41 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:13.521458 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-73331ac8-180c-4fab-979f-8191eae89b41 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec8d131a9764028a096314a4ecd58f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9ff6952b014d0a9abb28dcf0b818b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:46:13.529687 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-73331ac8-180c-4fab-979f-8191eae89b41 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] 10.222.0.66 "GET /compute/v2.1/servers/f69fd00d-cf45-4c17-aee5-701e87ebab82" status: 200 len: 1690 microversion: 2.1 time: 0.155323 Aug 04 03:46:13.530261 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 374/748] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:46:13 2022] GET /compute/v2.1/servers/f69fd00d-cf45-4c17-aee5-701e87ebab82 => generated 1690 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:46:13.852601 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-3bb67c98-535b-474a-9671-a447e66625dc tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:46:13.853189 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-3bb67c98-535b-474a-9671-a447e66625dc tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] [instance: d097d81a-1bae-45f2-a34f-444776c8e1cb] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:46:13.860324 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-3bb67c98-535b-474a-9671-a447e66625dc tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:13.860766 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-3bb67c98-535b-474a-9671-a447e66625dc tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:13.861543 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-3bb67c98-535b-474a-9671-a447e66625dc tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:13.861971 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-3bb67c98-535b-474a-9671-a447e66625dc tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:13.993739 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-3bb67c98-535b-474a-9671-a447e66625dc tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc12077b11448a3b1ec2e7dbf2707ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf95e3e43d0e482ba4d27b769fb48628', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:46:14.002157 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-3bb67c98-535b-474a-9671-a447e66625dc tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] 10.222.0.66 "GET /compute/v2.1/servers/d097d81a-1bae-45f2-a34f-444776c8e1cb" status: 200 len: 1573 microversion: 2.1 time: 0.153397 Aug 04 03:46:14.002912 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 375/749] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:46:13 2022] GET /compute/v2.1/servers/d097d81a-1bae-45f2-a34f-444776c8e1cb => generated 1573 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:46:14.379806 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [req-1356ca9a-03c5-4e71-8b34-1e55fbc62a36 req-3d1d44db-b67f-4fae-89d5-b21ad1663ea1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f69fd00d-cf45-4c17-aee5-701e87ebab82", "name": "network-vif-deleted", "tag": "792bb385-f4d3-479d-9f3d-2a0bf239cd0d"}]} {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 03:46:14.390560 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [req-1356ca9a-03c5-4e71-8b34-1e55fbc62a36 req-3d1d44db-b67f-4fae-89d5-b21ad1663ea1 service nova] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:14.391324 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [req-1356ca9a-03c5-4e71-8b34-1e55fbc62a36 req-3d1d44db-b67f-4fae-89d5-b21ad1663ea1 service nova] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:14.404093 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.compute.server_external_events [req-1356ca9a-03c5-4e71-8b34-1e55fbc62a36 req-3d1d44db-b67f-4fae-89d5-b21ad1663ea1 service nova] Creating event network-vif-deleted:792bb385-f4d3-479d-9f3d-2a0bf239cd0d for instance f69fd00d-cf45-4c17-aee5-701e87ebab82 on hv-cinder-73306 Aug 04 03:46:14.409630 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [req-1356ca9a-03c5-4e71-8b34-1e55fbc62a36 req-3d1d44db-b67f-4fae-89d5-b21ad1663ea1 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098525 Aug 04 03:46:14.411481 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 375/750] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 03:46:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 03:46:14.551187 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-8c2a7ebb-da80-4656-b579-2fcfba9a392d tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:46:14.551799 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-8c2a7ebb-da80-4656-b579-2fcfba9a392d tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] [instance: f69fd00d-cf45-4c17-aee5-701e87ebab82] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:46:14.563377 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-8c2a7ebb-da80-4656-b579-2fcfba9a392d tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:14.564155 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-8c2a7ebb-da80-4656-b579-2fcfba9a392d tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:14.570106 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-8c2a7ebb-da80-4656-b579-2fcfba9a392d tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:14.570795 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-8c2a7ebb-da80-4656-b579-2fcfba9a392d tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:14.645155 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-8c2a7ebb-da80-4656-b579-2fcfba9a392d tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec8d131a9764028a096314a4ecd58f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9ff6952b014d0a9abb28dcf0b818b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:46:14.653348 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-8c2a7ebb-da80-4656-b579-2fcfba9a392d tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] 10.222.0.66 "GET /compute/v2.1/servers/f69fd00d-cf45-4c17-aee5-701e87ebab82" status: 200 len: 1331 microversion: 2.1 time: 0.105993 Aug 04 03:46:14.661450 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 376/751] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:46:14 2022] GET /compute/v2.1/servers/f69fd00d-cf45-4c17-aee5-701e87ebab82 => generated 1331 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:46:15.023167 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-f2941379-da44-4c05-a84b-8f37234e53b0 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:46:15.025977 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-f2941379-da44-4c05-a84b-8f37234e53b0 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] [instance: d097d81a-1bae-45f2-a34f-444776c8e1cb] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:46:15.031467 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-f2941379-da44-4c05-a84b-8f37234e53b0 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:15.032169 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-f2941379-da44-4c05-a84b-8f37234e53b0 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:15.032943 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-f2941379-da44-4c05-a84b-8f37234e53b0 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:15.033434 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-f2941379-da44-4c05-a84b-8f37234e53b0 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:15.201412 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-f2941379-da44-4c05-a84b-8f37234e53b0 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc12077b11448a3b1ec2e7dbf2707ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf95e3e43d0e482ba4d27b769fb48628', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:46:15.211689 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-f2941379-da44-4c05-a84b-8f37234e53b0 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] 10.222.0.66 "GET /compute/v2.1/servers/d097d81a-1bae-45f2-a34f-444776c8e1cb" status: 200 len: 1573 microversion: 2.1 time: 0.192671 Aug 04 03:46:15.212266 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 376/752] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:46:15 2022] GET /compute/v2.1/servers/d097d81a-1bae-45f2-a34f-444776c8e1cb => generated 1573 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:46:15.673579 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-b45e1afd-22b2-46ed-84f0-cee28f2c69fb tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:46:15.674190 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-b45e1afd-22b2-46ed-84f0-cee28f2c69fb tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] [instance: f69fd00d-cf45-4c17-aee5-701e87ebab82] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:46:15.680630 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-b45e1afd-22b2-46ed-84f0-cee28f2c69fb tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:15.681058 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-b45e1afd-22b2-46ed-84f0-cee28f2c69fb tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:15.682557 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-b45e1afd-22b2-46ed-84f0-cee28f2c69fb tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:15.683264 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-b45e1afd-22b2-46ed-84f0-cee28f2c69fb tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:15.696686 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.wsgi [None req-b45e1afd-22b2-46ed-84f0-cee28f2c69fb tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] HTTP exception thrown: Instance f69fd00d-cf45-4c17-aee5-701e87ebab82 could not be found. Aug 04 03:46:15.699242 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-b45e1afd-22b2-46ed-84f0-cee28f2c69fb tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Request method failure captured: Aug 04 03:46:15.699242 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: request: GET /compute/v2.1/servers/f69fd00d-cf45-4c17-aee5-701e87ebab82 HTTP/1.1 Aug 04 03:46:15.699242 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: Accept: application/json Aug 04 03:46:15.699242 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: Accept-Encoding: identity Aug 04 03:46:15.699242 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: Connection: close Aug 04 03:46:15.699242 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: Content-Length: 0 Aug 04 03:46:15.699242 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: Content-Type: application/json Aug 04 03:46:15.699242 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: Host: 10.222.0.66 Aug 04 03:46:15.699242 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: Openstack-System-Scope: None Aug 04 03:46:15.699242 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: User-Agent: python-urllib3/1.26.11 Aug 04 03:46:15.699242 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Auth-Token: gAAAAABi6z9iJGtDuNMkQNRzXKMLfYH03ewA3atDGoFpPxtvts1QZtyCLQeJxJ5xZv4Jb-yIauhBf4zpbsK162-B4YQFxwTxCIkCQ6jvB-tFo8yRaZBs3m8Flt5Gurg1Uwbts57F5uW3TIfvRnRvF-jH58mlrMbD9VNKLxPPHo2uIUs41P8tL24 Aug 04 03:46:15.699242 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Domain-Id: None Aug 04 03:46:15.699242 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Domain-Name: None Aug 04 03:46:15.699242 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Identity-Status: Confirmed Aug 04 03:46:15.699242 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Is-Admin-Project: True Aug 04 03:46:15.699242 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Project-Domain-Id: default Aug 04 03:46:15.699242 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Project-Domain-Name: Default Aug 04 03:46:15.699242 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Project-Id: 7d9ff6952b014d0a9abb28dcf0b818b0 Aug 04 03:46:15.699242 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-603950778 Aug 04 03:46:15.699242 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Role: member,reader Aug 04 03:46:15.699242 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Roles: member,reader Aug 04 03:46:15.700646 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/7d9ff6952b014d0a9abb28dcf0b818b0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/7d9ff6952b014d0a9abb28dcf0b818b0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/7d9ff6952b014d0a9abb28dcf0b818b0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_7d9ff6952b014d0a9abb28dcf0b818b0"}]}] Aug 04 03:46:15.700646 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Tenant: tempest-ServerRescueNegativeTestJSON-603950778 Aug 04 03:46:15.700646 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Tenant-Id: 7d9ff6952b014d0a9abb28dcf0b818b0 Aug 04 03:46:15.700646 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-603950778 Aug 04 03:46:15.700646 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-User: tempest-ServerRescueNegativeTestJSON-603950778-project Aug 04 03:46:15.700646 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-User-Domain-Id: default Aug 04 03:46:15.700646 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-User-Domain-Name: Default Aug 04 03:46:15.700646 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-User-Id: 3ec8d131a9764028a096314a4ecd58f9 Aug 04 03:46:15.700646 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-User-Name: tempest-ServerRescueNegativeTestJSON-603950778-project Aug 04 03:46:15.700646 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: method: > Aug 04 03:46:15.700646 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: exception: Instance f69fd00d-cf45-4c17-aee5-701e87ebab82 could not be found. Aug 04 03:46:15.700646 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: action_args: {'id': 'f69fd00d-cf45-4c17-aee5-701e87ebab82'} Aug 04 03:46:15.701468 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 03:46:15.701468 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 03:46:15.701468 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 03:46:15.701468 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 03:46:15.701468 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 03:46:15.701468 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 03:46:15.701468 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 03:46:15.701468 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 03:46:15.701468 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 03:46:15.701468 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 03:46:15.701468 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f69fd00d-cf45-4c17-aee5-701e87ebab82 could not be found. Aug 04 03:46:15.701468 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi Aug 04 03:46:15.701468 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 03:46:15.701468 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi Aug 04 03:46:15.701468 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 03:46:15.701468 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 03:46:15.701468 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 03:46:15.701468 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 03:46:15.701468 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 03:46:15.701468 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 03:46:15.702785 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 03:46:15.702785 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 03:46:15.702785 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 03:46:15.702785 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 03:46:15.702785 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 03:46:15.702785 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 03:46:15.702785 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 03:46:15.702785 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f69fd00d-cf45-4c17-aee5-701e87ebab82 could not be found. Aug 04 03:46:15.702785 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi Aug 04 03:46:15.702785 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 03:46:15.702785 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi Aug 04 03:46:15.702785 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 03:46:15.702785 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 03:46:15.702785 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 03:46:15.702785 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 03:46:15.702785 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 03:46:15.702785 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f69fd00d-cf45-4c17-aee5-701e87ebab82 could not be found. Aug 04 03:46:15.702785 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi Aug 04 03:46:15.703903 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-b45e1afd-22b2-46ed-84f0-cee28f2c69fb tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Returning 404 to user: Instance f69fd00d-cf45-4c17-aee5-701e87ebab82 could not be found. {{(pid=130262) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 03:46:15.703903 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-b45e1afd-22b2-46ed-84f0-cee28f2c69fb tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] 10.222.0.66 "GET /compute/v2.1/servers/f69fd00d-cf45-4c17-aee5-701e87ebab82" status: 404 len: 111 microversion: 2.1 time: 0.031071 Aug 04 03:46:15.703903 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 377/753] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:46:15 2022] GET /compute/v2.1/servers/f69fd00d-cf45-4c17-aee5-701e87ebab82 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 03:46:15.709764 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-71993505-ce15-4559-bcda-25c6ca6a5610 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Calling method '.version_select at 0x7f72e2f26670>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:46:15.768024 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-71993505-ce15-4559-bcda-25c6ca6a5610 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1363533838" status: 202 len: 0 microversion: 2.1 time: 0.062228 Aug 04 03:46:15.768604 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 377/754] 10.222.0.66 () {58 vars in 1221 bytes} [Thu Aug 4 03:46:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1363533838 => generated 0 bytes in 63 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 03:46:16.236260 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-1be13c77-6961-4dc5-9ca9-134210488bd7 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:46:16.237573 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-1be13c77-6961-4dc5-9ca9-134210488bd7 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] [instance: d097d81a-1bae-45f2-a34f-444776c8e1cb] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:46:16.249624 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-1be13c77-6961-4dc5-9ca9-134210488bd7 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:16.251304 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-1be13c77-6961-4dc5-9ca9-134210488bd7 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:16.251881 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-1be13c77-6961-4dc5-9ca9-134210488bd7 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:16.253409 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-1be13c77-6961-4dc5-9ca9-134210488bd7 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:16.408516 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [req-e810c481-e7cb-4656-8aa3-d9f665b44394 req-1c6bbd12-236d-4d49-ac04-841c660eb179 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d097d81a-1bae-45f2-a34f-444776c8e1cb", "name": "network-vif-plugged", "status": "completed", "tag": "118548b5-15c3-4cd8-ab62-4c3490efe26d"}]} {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 03:46:16.420679 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [req-e810c481-e7cb-4656-8aa3-d9f665b44394 req-1c6bbd12-236d-4d49-ac04-841c660eb179 service nova] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:16.421114 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [req-e810c481-e7cb-4656-8aa3-d9f665b44394 req-1c6bbd12-236d-4d49-ac04-841c660eb179 service nova] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:16.425418 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG dbcounter [-] [130263] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:46:16.429724 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-1be13c77-6961-4dc5-9ca9-134210488bd7 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc12077b11448a3b1ec2e7dbf2707ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf95e3e43d0e482ba4d27b769fb48628', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:46:16.433870 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.compute.server_external_events [req-e810c481-e7cb-4656-8aa3-d9f665b44394 req-1c6bbd12-236d-4d49-ac04-841c660eb179 service nova] Creating event network-vif-plugged:118548b5-15c3-4cd8-ab62-4c3490efe26d for instance d097d81a-1bae-45f2-a34f-444776c8e1cb on hv-cinder-73306 Aug 04 03:46:16.438730 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-1be13c77-6961-4dc5-9ca9-134210488bd7 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] 10.222.0.66 "GET /compute/v2.1/servers/d097d81a-1bae-45f2-a34f-444776c8e1cb" status: 200 len: 1573 microversion: 2.1 time: 0.209686 Aug 04 03:46:16.439650 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 378/755] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:46:16 2022] GET /compute/v2.1/servers/d097d81a-1bae-45f2-a34f-444776c8e1cb => generated 1573 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:46:16.441358 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [req-e810c481-e7cb-4656-8aa3-d9f665b44394 req-1c6bbd12-236d-4d49-ac04-841c660eb179 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035215 Aug 04 03:46:16.441358 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 378/756] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 03:46:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 03:46:17.460361 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-256e4a4e-afe0-4d61-802a-725822e6ad18 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:46:17.461056 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-256e4a4e-afe0-4d61-802a-725822e6ad18 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] [instance: d097d81a-1bae-45f2-a34f-444776c8e1cb] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:46:17.468181 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-256e4a4e-afe0-4d61-802a-725822e6ad18 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:17.468626 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-256e4a4e-afe0-4d61-802a-725822e6ad18 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:17.469420 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-256e4a4e-afe0-4d61-802a-725822e6ad18 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:17.469854 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-256e4a4e-afe0-4d61-802a-725822e6ad18 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:17.602901 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-256e4a4e-afe0-4d61-802a-725822e6ad18 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc12077b11448a3b1ec2e7dbf2707ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf95e3e43d0e482ba4d27b769fb48628', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:46:17.610810 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-256e4a4e-afe0-4d61-802a-725822e6ad18 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] 10.222.0.66 "GET /compute/v2.1/servers/d097d81a-1bae-45f2-a34f-444776c8e1cb" status: 200 len: 1573 microversion: 2.1 time: 0.154337 Aug 04 03:46:17.611471 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 379/757] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:46:17 2022] GET /compute/v2.1/servers/d097d81a-1bae-45f2-a34f-444776c8e1cb => generated 1573 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:46:18.633251 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-cfa59647-1be0-40c7-836f-b1ae197b2342 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:46:18.633976 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-cfa59647-1be0-40c7-836f-b1ae197b2342 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] [instance: d097d81a-1bae-45f2-a34f-444776c8e1cb] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:46:18.641957 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-cfa59647-1be0-40c7-836f-b1ae197b2342 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:18.642403 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-cfa59647-1be0-40c7-836f-b1ae197b2342 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:18.643157 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-cfa59647-1be0-40c7-836f-b1ae197b2342 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:18.643590 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-cfa59647-1be0-40c7-836f-b1ae197b2342 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:18.780071 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-cfa59647-1be0-40c7-836f-b1ae197b2342 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc12077b11448a3b1ec2e7dbf2707ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf95e3e43d0e482ba4d27b769fb48628', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:46:18.787876 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-cfa59647-1be0-40c7-836f-b1ae197b2342 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] 10.222.0.66 "GET /compute/v2.1/servers/d097d81a-1bae-45f2-a34f-444776c8e1cb" status: 200 len: 1560 microversion: 2.1 time: 0.159429 Aug 04 03:46:18.788441 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 379/758] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:46:18 2022] GET /compute/v2.1/servers/d097d81a-1bae-45f2-a34f-444776c8e1cb => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:46:19.203747 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-b32a3fc1-73ad-4dc2-926b-2d93eb49431e tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:46:19.204350 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-b32a3fc1-73ad-4dc2-926b-2d93eb49431e tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] [instance: 60273216-f2ed-46cf-8836-1d85335d8920] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:46:19.211023 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-b32a3fc1-73ad-4dc2-926b-2d93eb49431e tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:19.211467 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-b32a3fc1-73ad-4dc2-926b-2d93eb49431e tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:19.212224 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-b32a3fc1-73ad-4dc2-926b-2d93eb49431e tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:19.212653 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-b32a3fc1-73ad-4dc2-926b-2d93eb49431e tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:19.237543 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-b32a3fc1-73ad-4dc2-926b-2d93eb49431e tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] [instance: 60273216-f2ed-46cf-8836-1d85335d8920] Going to try to terminate instance {{(pid=130262) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 03:46:19.549506 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-b32a3fc1-73ad-4dc2-926b-2d93eb49431e tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] 10.222.0.66 "DELETE /compute/v2.1/servers/60273216-f2ed-46cf-8836-1d85335d8920" status: 204 len: 0 microversion: 2.1 time: 0.349161 Aug 04 03:46:19.550012 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 380/759] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 03:46:19 2022] DELETE /compute/v2.1/servers/60273216-f2ed-46cf-8836-1d85335d8920 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 03:46:19.558833 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-ce0a35d7-1daf-40ab-a1f7-15d4785316bc tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:46:19.559478 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-ce0a35d7-1daf-40ab-a1f7-15d4785316bc tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] [instance: 60273216-f2ed-46cf-8836-1d85335d8920] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:46:19.565620 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-ce0a35d7-1daf-40ab-a1f7-15d4785316bc tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:19.566076 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-ce0a35d7-1daf-40ab-a1f7-15d4785316bc tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:19.566837 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-ce0a35d7-1daf-40ab-a1f7-15d4785316bc tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:19.567273 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-ce0a35d7-1daf-40ab-a1f7-15d4785316bc tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:19.696569 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-ce0a35d7-1daf-40ab-a1f7-15d4785316bc tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec8d131a9764028a096314a4ecd58f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9ff6952b014d0a9abb28dcf0b818b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:46:19.704032 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-ce0a35d7-1daf-40ab-a1f7-15d4785316bc tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] 10.222.0.66 "GET /compute/v2.1/servers/60273216-f2ed-46cf-8836-1d85335d8920" status: 200 len: 1507 microversion: 2.1 time: 0.149647 Aug 04 03:46:19.704601 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 380/760] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:46:19 2022] GET /compute/v2.1/servers/60273216-f2ed-46cf-8836-1d85335d8920 => generated 1507 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:46:20.724611 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-ef7708bb-54d3-4b48-b935-b31c53eddc78 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:46:20.725361 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-ef7708bb-54d3-4b48-b935-b31c53eddc78 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] [instance: 60273216-f2ed-46cf-8836-1d85335d8920] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:46:20.733048 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-ef7708bb-54d3-4b48-b935-b31c53eddc78 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:20.733547 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-ef7708bb-54d3-4b48-b935-b31c53eddc78 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:20.734306 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-ef7708bb-54d3-4b48-b935-b31c53eddc78 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:20.734736 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-ef7708bb-54d3-4b48-b935-b31c53eddc78 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:20.879041 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-ef7708bb-54d3-4b48-b935-b31c53eddc78 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec8d131a9764028a096314a4ecd58f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9ff6952b014d0a9abb28dcf0b818b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:46:20.887596 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-ef7708bb-54d3-4b48-b935-b31c53eddc78 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] 10.222.0.66 "GET /compute/v2.1/servers/60273216-f2ed-46cf-8836-1d85335d8920" status: 200 len: 1507 microversion: 2.1 time: 0.167318 Aug 04 03:46:20.895316 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 381/761] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:46:20 2022] GET /compute/v2.1/servers/60273216-f2ed-46cf-8836-1d85335d8920 => generated 1507 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:46:20.895538 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [req-5b445a4b-47c9-4547-adc9-ccccb0a7bfd3 req-033664de-7efa-4b08-a466-0306992b1c9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60273216-f2ed-46cf-8836-1d85335d8920", "name": "network-vif-deleted", "tag": "6d9d0195-e01f-4042-aa96-3a5af9c8cf55"}]} {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 03:46:20.906106 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [req-5b445a4b-47c9-4547-adc9-ccccb0a7bfd3 req-033664de-7efa-4b08-a466-0306992b1c9b service nova] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:20.906547 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [req-5b445a4b-47c9-4547-adc9-ccccb0a7bfd3 req-033664de-7efa-4b08-a466-0306992b1c9b service nova] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:20.917895 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.compute.server_external_events [req-5b445a4b-47c9-4547-adc9-ccccb0a7bfd3 req-033664de-7efa-4b08-a466-0306992b1c9b service nova] Creating event network-vif-deleted:6d9d0195-e01f-4042-aa96-3a5af9c8cf55 for instance 60273216-f2ed-46cf-8836-1d85335d8920 on hv-cinder-73306 Aug 04 03:46:20.922969 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [req-5b445a4b-47c9-4547-adc9-ccccb0a7bfd3 req-033664de-7efa-4b08-a466-0306992b1c9b service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031303 Aug 04 03:46:20.923558 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 381/762] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 03:46:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 03:46:21.917225 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-de9b96c4-3422-4c7e-a2db-435c5697937b tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:46:21.917838 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-de9b96c4-3422-4c7e-a2db-435c5697937b tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] [instance: 60273216-f2ed-46cf-8836-1d85335d8920] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:46:21.924270 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-de9b96c4-3422-4c7e-a2db-435c5697937b tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:21.924708 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-de9b96c4-3422-4c7e-a2db-435c5697937b tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:21.925491 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-de9b96c4-3422-4c7e-a2db-435c5697937b tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:21.925915 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-de9b96c4-3422-4c7e-a2db-435c5697937b tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:21.939611 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.wsgi [None req-de9b96c4-3422-4c7e-a2db-435c5697937b tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] HTTP exception thrown: Instance 60273216-f2ed-46cf-8836-1d85335d8920 could not be found. Aug 04 03:46:21.941215 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-de9b96c4-3422-4c7e-a2db-435c5697937b tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Request method failure captured: Aug 04 03:46:21.941215 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: request: GET /compute/v2.1/servers/60273216-f2ed-46cf-8836-1d85335d8920 HTTP/1.1 Aug 04 03:46:21.941215 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: Accept: application/json Aug 04 03:46:21.941215 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: Accept-Encoding: identity Aug 04 03:46:21.941215 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: Connection: close Aug 04 03:46:21.941215 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: Content-Length: 0 Aug 04 03:46:21.941215 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: Content-Type: application/json Aug 04 03:46:21.941215 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: Host: 10.222.0.66 Aug 04 03:46:21.941215 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: Openstack-System-Scope: None Aug 04 03:46:21.941215 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: User-Agent: python-urllib3/1.26.11 Aug 04 03:46:21.941215 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Auth-Token: gAAAAABi6z9iJGtDuNMkQNRzXKMLfYH03ewA3atDGoFpPxtvts1QZtyCLQeJxJ5xZv4Jb-yIauhBf4zpbsK162-B4YQFxwTxCIkCQ6jvB-tFo8yRaZBs3m8Flt5Gurg1Uwbts57F5uW3TIfvRnRvF-jH58mlrMbD9VNKLxPPHo2uIUs41P8tL24 Aug 04 03:46:21.941215 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Domain-Id: None Aug 04 03:46:21.941215 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Domain-Name: None Aug 04 03:46:21.941215 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Identity-Status: Confirmed Aug 04 03:46:21.941215 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Is-Admin-Project: True Aug 04 03:46:21.941215 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Project-Domain-Id: default Aug 04 03:46:21.941215 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Project-Domain-Name: Default Aug 04 03:46:21.941215 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Project-Id: 7d9ff6952b014d0a9abb28dcf0b818b0 Aug 04 03:46:21.941215 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-603950778 Aug 04 03:46:21.941215 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Role: member,reader Aug 04 03:46:21.941215 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Roles: member,reader Aug 04 03:46:21.942697 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/7d9ff6952b014d0a9abb28dcf0b818b0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/7d9ff6952b014d0a9abb28dcf0b818b0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/7d9ff6952b014d0a9abb28dcf0b818b0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_7d9ff6952b014d0a9abb28dcf0b818b0"}]}] Aug 04 03:46:21.942697 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Tenant: tempest-ServerRescueNegativeTestJSON-603950778 Aug 04 03:46:21.942697 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Tenant-Id: 7d9ff6952b014d0a9abb28dcf0b818b0 Aug 04 03:46:21.942697 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-603950778 Aug 04 03:46:21.942697 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-User: tempest-ServerRescueNegativeTestJSON-603950778-project Aug 04 03:46:21.942697 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-User-Domain-Id: default Aug 04 03:46:21.942697 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-User-Domain-Name: Default Aug 04 03:46:21.942697 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-User-Id: 3ec8d131a9764028a096314a4ecd58f9 Aug 04 03:46:21.942697 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-User-Name: tempest-ServerRescueNegativeTestJSON-603950778-project Aug 04 03:46:21.942697 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: method: > Aug 04 03:46:21.942697 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: exception: Instance 60273216-f2ed-46cf-8836-1d85335d8920 could not be found. Aug 04 03:46:21.942697 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: action_args: {'id': '60273216-f2ed-46cf-8836-1d85335d8920'} Aug 04 03:46:21.943562 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 03:46:21.943562 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 03:46:21.943562 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 03:46:21.943562 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 03:46:21.943562 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 03:46:21.943562 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 03:46:21.943562 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 03:46:21.943562 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 03:46:21.943562 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 03:46:21.943562 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 03:46:21.943562 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 60273216-f2ed-46cf-8836-1d85335d8920 could not be found. Aug 04 03:46:21.943562 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi Aug 04 03:46:21.943562 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 03:46:21.943562 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi Aug 04 03:46:21.943562 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 03:46:21.943562 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 03:46:21.943562 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 03:46:21.943562 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 03:46:21.943562 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 03:46:21.943562 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 03:46:21.944959 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 03:46:21.944959 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 03:46:21.944959 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 03:46:21.944959 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 03:46:21.944959 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 03:46:21.944959 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 03:46:21.944959 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 03:46:21.944959 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 60273216-f2ed-46cf-8836-1d85335d8920 could not be found. Aug 04 03:46:21.944959 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi Aug 04 03:46:21.944959 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 03:46:21.944959 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi Aug 04 03:46:21.944959 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 03:46:21.944959 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 03:46:21.944959 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 03:46:21.944959 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 03:46:21.944959 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 03:46:21.944959 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 60273216-f2ed-46cf-8836-1d85335d8920 could not be found. Aug 04 03:46:21.944959 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi Aug 04 03:46:21.946529 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-de9b96c4-3422-4c7e-a2db-435c5697937b tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Returning 404 to user: Instance 60273216-f2ed-46cf-8836-1d85335d8920 could not be found. {{(pid=130262) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 03:46:21.946529 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-de9b96c4-3422-4c7e-a2db-435c5697937b tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] 10.222.0.66 "GET /compute/v2.1/servers/60273216-f2ed-46cf-8836-1d85335d8920" status: 404 len: 111 microversion: 2.1 time: 0.030810 Aug 04 03:46:21.946529 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 382/763] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:46:21 2022] GET /compute/v2.1/servers/60273216-f2ed-46cf-8836-1d85335d8920 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 03:46:21.951944 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-ea5a7887-13d5-42d6-8995-7ee9034ef123 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:46:21.952519 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-ea5a7887-13d5-42d6-8995-7ee9034ef123 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] [instance: 8620bffd-405f-41cc-9388-abdb301923d5] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:46:21.958751 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-ea5a7887-13d5-42d6-8995-7ee9034ef123 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:21.959199 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-ea5a7887-13d5-42d6-8995-7ee9034ef123 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:21.959976 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-ea5a7887-13d5-42d6-8995-7ee9034ef123 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:21.960405 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-ea5a7887-13d5-42d6-8995-7ee9034ef123 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:21.985330 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-ea5a7887-13d5-42d6-8995-7ee9034ef123 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] [instance: 8620bffd-405f-41cc-9388-abdb301923d5] Going to try to terminate instance {{(pid=130263) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 03:46:22.218365 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-ea5a7887-13d5-42d6-8995-7ee9034ef123 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] 10.222.0.66 "DELETE /compute/v2.1/servers/8620bffd-405f-41cc-9388-abdb301923d5" status: 204 len: 0 microversion: 2.1 time: 0.270641 Aug 04 03:46:22.218960 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 382/764] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 03:46:21 2022] DELETE /compute/v2.1/servers/8620bffd-405f-41cc-9388-abdb301923d5 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 03:46:22.227178 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-1092e9b8-6e5c-48d0-ad02-c80d9f96e75e tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:46:22.227791 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-1092e9b8-6e5c-48d0-ad02-c80d9f96e75e tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] [instance: 8620bffd-405f-41cc-9388-abdb301923d5] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:46:22.234608 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-1092e9b8-6e5c-48d0-ad02-c80d9f96e75e tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:22.235059 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-1092e9b8-6e5c-48d0-ad02-c80d9f96e75e tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:22.235827 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-1092e9b8-6e5c-48d0-ad02-c80d9f96e75e tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:22.236269 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-1092e9b8-6e5c-48d0-ad02-c80d9f96e75e tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:22.372764 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-1092e9b8-6e5c-48d0-ad02-c80d9f96e75e tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec8d131a9764028a096314a4ecd58f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9ff6952b014d0a9abb28dcf0b818b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:46:22.380184 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-1092e9b8-6e5c-48d0-ad02-c80d9f96e75e tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] 10.222.0.66 "GET /compute/v2.1/servers/8620bffd-405f-41cc-9388-abdb301923d5" status: 200 len: 1522 microversion: 2.1 time: 0.156835 Aug 04 03:46:22.380729 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 383/765] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:46:22 2022] GET /compute/v2.1/servers/8620bffd-405f-41cc-9388-abdb301923d5 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:46:23.402734 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-d8770e2c-5a78-43b5-b6af-d8ad6d1fc626 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:46:23.403380 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-d8770e2c-5a78-43b5-b6af-d8ad6d1fc626 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] [instance: 8620bffd-405f-41cc-9388-abdb301923d5] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:46:23.409974 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-d8770e2c-5a78-43b5-b6af-d8ad6d1fc626 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:23.410424 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-d8770e2c-5a78-43b5-b6af-d8ad6d1fc626 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:23.411192 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-d8770e2c-5a78-43b5-b6af-d8ad6d1fc626 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:23.411617 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-d8770e2c-5a78-43b5-b6af-d8ad6d1fc626 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:23.540724 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-d8770e2c-5a78-43b5-b6af-d8ad6d1fc626 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec8d131a9764028a096314a4ecd58f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9ff6952b014d0a9abb28dcf0b818b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:46:23.548274 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-d8770e2c-5a78-43b5-b6af-d8ad6d1fc626 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] 10.222.0.66 "GET /compute/v2.1/servers/8620bffd-405f-41cc-9388-abdb301923d5" status: 200 len: 1522 microversion: 2.1 time: 0.150726 Aug 04 03:46:23.548837 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 383/766] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:46:23 2022] GET /compute/v2.1/servers/8620bffd-405f-41cc-9388-abdb301923d5 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:46:24.568813 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-d1a62dc2-ef3e-4073-bc6c-b0235ce345d7 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:46:24.569469 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-d1a62dc2-ef3e-4073-bc6c-b0235ce345d7 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] [instance: 8620bffd-405f-41cc-9388-abdb301923d5] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:46:24.576019 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-d1a62dc2-ef3e-4073-bc6c-b0235ce345d7 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:24.576461 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-d1a62dc2-ef3e-4073-bc6c-b0235ce345d7 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:24.577223 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-d1a62dc2-ef3e-4073-bc6c-b0235ce345d7 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:24.577665 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-d1a62dc2-ef3e-4073-bc6c-b0235ce345d7 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:24.712990 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-d1a62dc2-ef3e-4073-bc6c-b0235ce345d7 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec8d131a9764028a096314a4ecd58f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9ff6952b014d0a9abb28dcf0b818b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:46:24.720631 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-d1a62dc2-ef3e-4073-bc6c-b0235ce345d7 tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] 10.222.0.66 "GET /compute/v2.1/servers/8620bffd-405f-41cc-9388-abdb301923d5" status: 200 len: 1522 microversion: 2.1 time: 0.155649 Aug 04 03:46:24.721290 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 384/767] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:46:24 2022] GET /compute/v2.1/servers/8620bffd-405f-41cc-9388-abdb301923d5 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:46:25.202620 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [req-ff4362fc-ab0f-40f6-93d8-e26a4d51382c req-66828ae3-995e-452c-a7e6-c3d49044fd31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8620bffd-405f-41cc-9388-abdb301923d5", "name": "network-vif-deleted", "tag": "fda02e5d-f2e1-4658-81b6-f9d2c0fd627f"}]} {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 03:46:25.208026 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG dbcounter [-] [130263] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=130263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:46:25.213553 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [req-ff4362fc-ab0f-40f6-93d8-e26a4d51382c req-66828ae3-995e-452c-a7e6-c3d49044fd31 service nova] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:25.214070 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [req-ff4362fc-ab0f-40f6-93d8-e26a4d51382c req-66828ae3-995e-452c-a7e6-c3d49044fd31 service nova] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:25.224876 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.compute.server_external_events [req-ff4362fc-ab0f-40f6-93d8-e26a4d51382c req-66828ae3-995e-452c-a7e6-c3d49044fd31 service nova] Creating event network-vif-deleted:fda02e5d-f2e1-4658-81b6-f9d2c0fd627f for instance 8620bffd-405f-41cc-9388-abdb301923d5 on hv-cinder-73306 Aug 04 03:46:25.231224 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [req-ff4362fc-ab0f-40f6-93d8-e26a4d51382c req-66828ae3-995e-452c-a7e6-c3d49044fd31 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032248 Aug 04 03:46:25.231799 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 384/768] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 03:46:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 03:46:25.742644 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-a89add74-b87f-407f-b477-1661562898fd tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:46:25.743181 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-a89add74-b87f-407f-b477-1661562898fd tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] [instance: 8620bffd-405f-41cc-9388-abdb301923d5] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:46:25.746301 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG dbcounter [-] [130262] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=2 {{(pid=130262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:46:25.751041 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-a89add74-b87f-407f-b477-1661562898fd tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:25.751498 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-a89add74-b87f-407f-b477-1661562898fd tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:25.752266 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-a89add74-b87f-407f-b477-1661562898fd tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:25.752708 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-a89add74-b87f-407f-b477-1661562898fd tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:25.784219 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-a89add74-b87f-407f-b477-1661562898fd tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:25.784668 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-a89add74-b87f-407f-b477-1661562898fd tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:25.785116 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.objects.instance [None req-a89add74-b87f-407f-b477-1661562898fd tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lazy-loading 'fault' on Instance uuid 8620bffd-405f-41cc-9388-abdb301923d5 {{(pid=130262) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 03:46:25.826129 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-a89add74-b87f-407f-b477-1661562898fd tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ec8d131a9764028a096314a4ecd58f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d9ff6952b014d0a9abb28dcf0b818b0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:46:25.833574 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-a89add74-b87f-407f-b477-1661562898fd tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] 10.222.0.66 "GET /compute/v2.1/servers/8620bffd-405f-41cc-9388-abdb301923d5" status: 200 len: 1312 microversion: 2.1 time: 0.094875 Aug 04 03:46:25.834136 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 385/769] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:46:25 2022] GET /compute/v2.1/servers/8620bffd-405f-41cc-9388-abdb301923d5 => generated 1312 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:46:26.856344 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-6d51a0a8-82c7-4ad2-a3fa-73ff4faa7bec tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:46:26.857027 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-6d51a0a8-82c7-4ad2-a3fa-73ff4faa7bec tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] [instance: 8620bffd-405f-41cc-9388-abdb301923d5] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:46:26.864273 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-6d51a0a8-82c7-4ad2-a3fa-73ff4faa7bec tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:26.864718 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-6d51a0a8-82c7-4ad2-a3fa-73ff4faa7bec tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:26.865497 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-6d51a0a8-82c7-4ad2-a3fa-73ff4faa7bec tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:26.865929 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-6d51a0a8-82c7-4ad2-a3fa-73ff4faa7bec tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:26.880565 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.wsgi [None req-6d51a0a8-82c7-4ad2-a3fa-73ff4faa7bec tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] HTTP exception thrown: Instance 8620bffd-405f-41cc-9388-abdb301923d5 could not be found. Aug 04 03:46:26.881095 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-6d51a0a8-82c7-4ad2-a3fa-73ff4faa7bec tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Request method failure captured: Aug 04 03:46:26.881095 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: request: GET /compute/v2.1/servers/8620bffd-405f-41cc-9388-abdb301923d5 HTTP/1.1 Aug 04 03:46:26.881095 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Accept: application/json Aug 04 03:46:26.881095 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Accept-Encoding: identity Aug 04 03:46:26.881095 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Connection: close Aug 04 03:46:26.881095 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Content-Length: 0 Aug 04 03:46:26.881095 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Content-Type: application/json Aug 04 03:46:26.881095 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Host: 10.222.0.66 Aug 04 03:46:26.881095 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Openstack-System-Scope: None Aug 04 03:46:26.881095 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: User-Agent: python-urllib3/1.26.11 Aug 04 03:46:26.881095 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Auth-Token: gAAAAABi6z9iJGtDuNMkQNRzXKMLfYH03ewA3atDGoFpPxtvts1QZtyCLQeJxJ5xZv4Jb-yIauhBf4zpbsK162-B4YQFxwTxCIkCQ6jvB-tFo8yRaZBs3m8Flt5Gurg1Uwbts57F5uW3TIfvRnRvF-jH58mlrMbD9VNKLxPPHo2uIUs41P8tL24 Aug 04 03:46:26.881095 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Domain-Id: None Aug 04 03:46:26.881095 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Domain-Name: None Aug 04 03:46:26.881095 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Identity-Status: Confirmed Aug 04 03:46:26.881095 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Is-Admin-Project: True Aug 04 03:46:26.881095 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Project-Domain-Id: default Aug 04 03:46:26.881095 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Project-Domain-Name: Default Aug 04 03:46:26.881095 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Project-Id: 7d9ff6952b014d0a9abb28dcf0b818b0 Aug 04 03:46:26.881095 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-603950778 Aug 04 03:46:26.881095 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Role: member,reader Aug 04 03:46:26.881095 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Roles: member,reader Aug 04 03:46:26.882509 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/7d9ff6952b014d0a9abb28dcf0b818b0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/7d9ff6952b014d0a9abb28dcf0b818b0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/7d9ff6952b014d0a9abb28dcf0b818b0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_7d9ff6952b014d0a9abb28dcf0b818b0"}]}] Aug 04 03:46:26.882509 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Tenant: tempest-ServerRescueNegativeTestJSON-603950778 Aug 04 03:46:26.882509 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Tenant-Id: 7d9ff6952b014d0a9abb28dcf0b818b0 Aug 04 03:46:26.882509 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-603950778 Aug 04 03:46:26.882509 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-User: tempest-ServerRescueNegativeTestJSON-603950778-project Aug 04 03:46:26.882509 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-User-Domain-Id: default Aug 04 03:46:26.882509 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-User-Domain-Name: Default Aug 04 03:46:26.882509 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-User-Id: 3ec8d131a9764028a096314a4ecd58f9 Aug 04 03:46:26.882509 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-User-Name: tempest-ServerRescueNegativeTestJSON-603950778-project Aug 04 03:46:26.882509 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: method: > Aug 04 03:46:26.882509 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: exception: Instance 8620bffd-405f-41cc-9388-abdb301923d5 could not be found. Aug 04 03:46:26.882509 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: action_args: {'id': '8620bffd-405f-41cc-9388-abdb301923d5'} Aug 04 03:46:26.883247 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 03:46:26.883247 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 03:46:26.883247 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 03:46:26.883247 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 03:46:26.883247 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 03:46:26.883247 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 03:46:26.883247 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 03:46:26.883247 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 03:46:26.883247 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 03:46:26.883247 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 03:46:26.883247 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8620bffd-405f-41cc-9388-abdb301923d5 could not be found. Aug 04 03:46:26.883247 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Aug 04 03:46:26.883247 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 03:46:26.883247 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Aug 04 03:46:26.883247 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 03:46:26.883247 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 03:46:26.883247 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 03:46:26.883247 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 03:46:26.883247 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 03:46:26.883247 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 03:46:26.884858 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 03:46:26.884858 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 03:46:26.884858 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 03:46:26.884858 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 03:46:26.884858 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 03:46:26.884858 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 03:46:26.884858 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 03:46:26.884858 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8620bffd-405f-41cc-9388-abdb301923d5 could not be found. Aug 04 03:46:26.884858 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Aug 04 03:46:26.884858 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 03:46:26.884858 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Aug 04 03:46:26.884858 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 03:46:26.884858 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 03:46:26.884858 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 03:46:26.884858 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 03:46:26.884858 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 03:46:26.884858 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8620bffd-405f-41cc-9388-abdb301923d5 could not be found. Aug 04 03:46:26.884858 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Aug 04 03:46:26.886254 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-6d51a0a8-82c7-4ad2-a3fa-73ff4faa7bec tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] Returning 404 to user: Instance 8620bffd-405f-41cc-9388-abdb301923d5 could not be found. {{(pid=130263) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 03:46:26.886254 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-6d51a0a8-82c7-4ad2-a3fa-73ff4faa7bec tempest-ServerRescueNegativeTestJSON-603950778 tempest-ServerRescueNegativeTestJSON-603950778-project] 10.222.0.66 "GET /compute/v2.1/servers/8620bffd-405f-41cc-9388-abdb301923d5" status: 404 len: 111 microversion: 2.1 time: 0.031880 Aug 04 03:46:26.886254 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 385/770] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:46:26 2022] GET /compute/v2.1/servers/8620bffd-405f-41cc-9388-abdb301923d5 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 03:46:31.304274 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-26c59353-affc-4581-8b41-5dc245af5205 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:46:31.306582 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-26c59353-affc-4581-8b41-5dc245af5205 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] [instance: 9307fdad-ca63-449d-bc5c-7e9e167c59f3] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:46:31.314440 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-26c59353-affc-4581-8b41-5dc245af5205 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:31.314891 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-26c59353-affc-4581-8b41-5dc245af5205 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:31.315676 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-26c59353-affc-4581-8b41-5dc245af5205 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:31.316118 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-26c59353-affc-4581-8b41-5dc245af5205 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:31.348265 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-26c59353-affc-4581-8b41-5dc245af5205 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] 10.222.0.66 "GET /compute/v2.1/servers/9307fdad-ca63-449d-bc5c-7e9e167c59f3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047997 Aug 04 03:46:31.348855 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 386/771] 10.222.0.66 () {58 vars in 1302 bytes} [Thu Aug 4 03:46:31 2022] GET /compute/v2.1/servers/9307fdad-ca63-449d-bc5c-7e9e167c59f3/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 03:46:31.419612 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-9f0fa7b9-bce7-4fa6-a865-02797df0ff4e tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:46:31.420102 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-9f0fa7b9-bce7-4fa6-a865-02797df0ff4e tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] [instance: 9307fdad-ca63-449d-bc5c-7e9e167c59f3] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:46:31.427140 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-9f0fa7b9-bce7-4fa6-a865-02797df0ff4e tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:31.427815 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-9f0fa7b9-bce7-4fa6-a865-02797df0ff4e tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:31.432098 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-9f0fa7b9-bce7-4fa6-a865-02797df0ff4e tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:31.432098 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-9f0fa7b9-bce7-4fa6-a865-02797df0ff4e tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:31.455930 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-9f0fa7b9-bce7-4fa6-a865-02797df0ff4e tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] [instance: 9307fdad-ca63-449d-bc5c-7e9e167c59f3] Going to try to terminate instance {{(pid=130263) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 03:46:31.772736 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-9f0fa7b9-bce7-4fa6-a865-02797df0ff4e tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] 10.222.0.66 "DELETE /compute/v2.1/servers/9307fdad-ca63-449d-bc5c-7e9e167c59f3" status: 204 len: 0 microversion: 2.1 time: 0.357550 Aug 04 03:46:31.773384 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 386/772] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 03:46:31 2022] DELETE /compute/v2.1/servers/9307fdad-ca63-449d-bc5c-7e9e167c59f3 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 03:46:31.781842 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-2d3ac954-8100-4f2e-8b03-6d016544db21 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:46:31.782484 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-2d3ac954-8100-4f2e-8b03-6d016544db21 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] [instance: 9307fdad-ca63-449d-bc5c-7e9e167c59f3] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:46:31.788868 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-2d3ac954-8100-4f2e-8b03-6d016544db21 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:31.789579 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-2d3ac954-8100-4f2e-8b03-6d016544db21 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:31.790517 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-2d3ac954-8100-4f2e-8b03-6d016544db21 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:31.790953 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-2d3ac954-8100-4f2e-8b03-6d016544db21 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:31.924734 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-2d3ac954-8100-4f2e-8b03-6d016544db21 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dba436d0a67433f8c8ae7cd40d3f795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46b8dc64007429b805971d4c6f5b471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:46:31.933121 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-2d3ac954-8100-4f2e-8b03-6d016544db21 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] 10.222.0.66 "GET /compute/v2.1/servers/9307fdad-ca63-449d-bc5c-7e9e167c59f3" status: 200 len: 1671 microversion: 2.1 time: 0.154444 Aug 04 03:46:31.933682 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 387/773] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:46:31 2022] GET /compute/v2.1/servers/9307fdad-ca63-449d-bc5c-7e9e167c59f3 => generated 1671 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 03:46:32.955030 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-4caf96e5-cca3-490c-9698-da5ed8f2ad65 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:46:32.955822 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-4caf96e5-cca3-490c-9698-da5ed8f2ad65 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] [instance: 9307fdad-ca63-449d-bc5c-7e9e167c59f3] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:46:32.962803 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-4caf96e5-cca3-490c-9698-da5ed8f2ad65 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:32.964289 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-4caf96e5-cca3-490c-9698-da5ed8f2ad65 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:32.964686 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-4caf96e5-cca3-490c-9698-da5ed8f2ad65 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:32.965127 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-4caf96e5-cca3-490c-9698-da5ed8f2ad65 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:33.097729 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-4caf96e5-cca3-490c-9698-da5ed8f2ad65 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dba436d0a67433f8c8ae7cd40d3f795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46b8dc64007429b805971d4c6f5b471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:46:33.107496 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-4caf96e5-cca3-490c-9698-da5ed8f2ad65 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] 10.222.0.66 "GET /compute/v2.1/servers/9307fdad-ca63-449d-bc5c-7e9e167c59f3" status: 200 len: 1671 microversion: 2.1 time: 0.156497 Aug 04 03:46:33.108464 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 387/774] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:46:32 2022] GET /compute/v2.1/servers/9307fdad-ca63-449d-bc5c-7e9e167c59f3 => generated 1671 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:46:33.972476 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [req-602b5434-93a5-4132-ad72-5fb7b98692c1 req-c858e473-51df-4625-931b-d12c15fb5fa1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9307fdad-ca63-449d-bc5c-7e9e167c59f3", "name": "network-vif-deleted", "tag": "6a5932d2-1cb7-42bc-974f-e0c47bff324c"}]} {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 03:46:33.983953 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [req-602b5434-93a5-4132-ad72-5fb7b98692c1 req-c858e473-51df-4625-931b-d12c15fb5fa1 service nova] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:33.984525 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [req-602b5434-93a5-4132-ad72-5fb7b98692c1 req-c858e473-51df-4625-931b-d12c15fb5fa1 service nova] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:33.996853 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.compute.server_external_events [req-602b5434-93a5-4132-ad72-5fb7b98692c1 req-c858e473-51df-4625-931b-d12c15fb5fa1 service nova] Creating event network-vif-deleted:6a5932d2-1cb7-42bc-974f-e0c47bff324c for instance 9307fdad-ca63-449d-bc5c-7e9e167c59f3 on hv-cinder-73306 Aug 04 03:46:34.002271 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [req-602b5434-93a5-4132-ad72-5fb7b98692c1 req-c858e473-51df-4625-931b-d12c15fb5fa1 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033871 Aug 04 03:46:34.002984 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 388/775] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 03:46:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 03:46:34.140704 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-bc663c05-0214-4592-be72-34b399d71688 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:46:34.146606 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-bc663c05-0214-4592-be72-34b399d71688 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] [instance: 9307fdad-ca63-449d-bc5c-7e9e167c59f3] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:46:34.152937 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-bc663c05-0214-4592-be72-34b399d71688 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:34.153688 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-bc663c05-0214-4592-be72-34b399d71688 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:34.154663 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-bc663c05-0214-4592-be72-34b399d71688 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:34.155267 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-bc663c05-0214-4592-be72-34b399d71688 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:34.250298 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-bc663c05-0214-4592-be72-34b399d71688 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dba436d0a67433f8c8ae7cd40d3f795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46b8dc64007429b805971d4c6f5b471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:46:34.257983 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-bc663c05-0214-4592-be72-34b399d71688 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] 10.222.0.66 "GET /compute/v2.1/servers/9307fdad-ca63-449d-bc5c-7e9e167c59f3" status: 200 len: 1321 microversion: 2.1 time: 0.130874 Aug 04 03:46:34.258922 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 388/776] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:46:34 2022] GET /compute/v2.1/servers/9307fdad-ca63-449d-bc5c-7e9e167c59f3 => generated 1321 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:46:34.621054 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-14facfd5-aaa9-464b-a8ce-6e7a9da8929c tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:46:34.622848 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-14facfd5-aaa9-464b-a8ce-6e7a9da8929c tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] [instance: eb7f2df0-7ac0-4253-a847-e0f797fa845c] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:46:34.632827 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-14facfd5-aaa9-464b-a8ce-6e7a9da8929c tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:34.632827 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-14facfd5-aaa9-464b-a8ce-6e7a9da8929c tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:34.632827 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-14facfd5-aaa9-464b-a8ce-6e7a9da8929c tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:34.632827 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-14facfd5-aaa9-464b-a8ce-6e7a9da8929c tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:34.655208 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG dbcounter [-] [130262] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:46:34.662622 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-14facfd5-aaa9-464b-a8ce-6e7a9da8929c tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] [instance: eb7f2df0-7ac0-4253-a847-e0f797fa845c] Going to try to terminate instance {{(pid=130262) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 03:46:35.006718 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-14facfd5-aaa9-464b-a8ce-6e7a9da8929c tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] 10.222.0.66 "DELETE /compute/v2.1/servers/eb7f2df0-7ac0-4253-a847-e0f797fa845c" status: 204 len: 0 microversion: 2.1 time: 0.389478 Aug 04 03:46:35.007683 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 389/777] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 03:46:34 2022] DELETE /compute/v2.1/servers/eb7f2df0-7ac0-4253-a847-e0f797fa845c => generated 0 bytes in 392 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 03:46:35.017018 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-2b2c9dab-ed43-4420-b459-77027e5019e8 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:46:35.017680 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-2b2c9dab-ed43-4420-b459-77027e5019e8 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] [instance: eb7f2df0-7ac0-4253-a847-e0f797fa845c] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:46:35.024093 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-2b2c9dab-ed43-4420-b459-77027e5019e8 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:35.024537 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-2b2c9dab-ed43-4420-b459-77027e5019e8 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:35.025411 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-2b2c9dab-ed43-4420-b459-77027e5019e8 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:35.025844 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-2b2c9dab-ed43-4420-b459-77027e5019e8 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:35.192739 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-2b2c9dab-ed43-4420-b459-77027e5019e8 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac48e585c133487dadbe0a1e095bfde0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32813adc26c64016b99c9c5fd838d391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:46:35.201966 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-2b2c9dab-ed43-4420-b459-77027e5019e8 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] 10.222.0.66 "GET /compute/v2.1/servers/eb7f2df0-7ac0-4253-a847-e0f797fa845c" status: 200 len: 1576 microversion: 2.1 time: 0.189164 Aug 04 03:46:35.202574 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 389/778] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:46:35 2022] GET /compute/v2.1/servers/eb7f2df0-7ac0-4253-a847-e0f797fa845c => generated 1576 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:46:35.282848 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-536bbe64-4561-4e09-a060-4c83d758043e tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:46:35.282848 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-536bbe64-4561-4e09-a060-4c83d758043e tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] [instance: 9307fdad-ca63-449d-bc5c-7e9e167c59f3] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:46:35.290729 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-536bbe64-4561-4e09-a060-4c83d758043e tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:35.291436 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-536bbe64-4561-4e09-a060-4c83d758043e tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:35.293157 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-536bbe64-4561-4e09-a060-4c83d758043e tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:35.293689 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-536bbe64-4561-4e09-a060-4c83d758043e tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:35.307818 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.wsgi [None req-536bbe64-4561-4e09-a060-4c83d758043e tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] HTTP exception thrown: Instance 9307fdad-ca63-449d-bc5c-7e9e167c59f3 could not be found. Aug 04 03:46:35.309759 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-536bbe64-4561-4e09-a060-4c83d758043e tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Request method failure captured: Aug 04 03:46:35.309759 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: request: GET /compute/v2.1/servers/9307fdad-ca63-449d-bc5c-7e9e167c59f3 HTTP/1.1 Aug 04 03:46:35.309759 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: Accept: application/json Aug 04 03:46:35.309759 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: Accept-Encoding: identity Aug 04 03:46:35.309759 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: Connection: close Aug 04 03:46:35.309759 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: Content-Length: 0 Aug 04 03:46:35.309759 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: Content-Type: application/json Aug 04 03:46:35.309759 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: Host: 10.222.0.66 Aug 04 03:46:35.309759 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: Openstack-System-Scope: None Aug 04 03:46:35.309759 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: User-Agent: python-urllib3/1.26.11 Aug 04 03:46:35.309759 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Auth-Token: gAAAAABi6z9jjstLclSJhOUwTHf-ODCHOvyWYm-xiPGzTzYakNhh-XvfvUtN3VVw_rz9X8BxEZkSKeY1v-8BIr2pnIu_eB5LVFcULBBlXUhgFA2XNAhbiitHkPcF_YXvqofes1l3smLOqF7WJlDo1bBSfDCGzi4nCS4paxuU8y7pqn-SrPAYoNA Aug 04 03:46:35.309759 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Domain-Id: None Aug 04 03:46:35.309759 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Domain-Name: None Aug 04 03:46:35.309759 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Identity-Status: Confirmed Aug 04 03:46:35.309759 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Is-Admin-Project: True Aug 04 03:46:35.309759 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Project-Domain-Id: default Aug 04 03:46:35.309759 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Project-Domain-Name: Default Aug 04 03:46:35.309759 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Project-Id: f46b8dc64007429b805971d4c6f5b471 Aug 04 03:46:35.309759 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Project-Name: tempest-AttachVolumeTestJSON-422253214 Aug 04 03:46:35.309759 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Role: member,reader Aug 04 03:46:35.309759 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Roles: member,reader Aug 04 03:46:35.311359 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/f46b8dc64007429b805971d4c6f5b471"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f46b8dc64007429b805971d4c6f5b471"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f46b8dc64007429b805971d4c6f5b471"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_f46b8dc64007429b805971d4c6f5b471"}]}] Aug 04 03:46:35.311359 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Tenant: tempest-AttachVolumeTestJSON-422253214 Aug 04 03:46:35.311359 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Tenant-Id: f46b8dc64007429b805971d4c6f5b471 Aug 04 03:46:35.311359 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Tenant-Name: tempest-AttachVolumeTestJSON-422253214 Aug 04 03:46:35.311359 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-User: tempest-AttachVolumeTestJSON-422253214-project Aug 04 03:46:35.311359 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-User-Domain-Id: default Aug 04 03:46:35.311359 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-User-Domain-Name: Default Aug 04 03:46:35.311359 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-User-Id: 6dba436d0a67433f8c8ae7cd40d3f795 Aug 04 03:46:35.311359 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-User-Name: tempest-AttachVolumeTestJSON-422253214-project Aug 04 03:46:35.311359 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: method: > Aug 04 03:46:35.311359 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: exception: Instance 9307fdad-ca63-449d-bc5c-7e9e167c59f3 could not be found. Aug 04 03:46:35.311359 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: action_args: {'id': '9307fdad-ca63-449d-bc5c-7e9e167c59f3'} Aug 04 03:46:35.312277 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 03:46:35.312277 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 03:46:35.312277 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 03:46:35.312277 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 03:46:35.312277 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 03:46:35.312277 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 03:46:35.312277 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 03:46:35.312277 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 03:46:35.312277 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 03:46:35.312277 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 03:46:35.312277 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9307fdad-ca63-449d-bc5c-7e9e167c59f3 could not be found. Aug 04 03:46:35.312277 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi Aug 04 03:46:35.312277 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 03:46:35.312277 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi Aug 04 03:46:35.312277 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 03:46:35.312277 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 03:46:35.312277 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 03:46:35.312277 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 03:46:35.312277 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 03:46:35.312277 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 03:46:35.317045 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 03:46:35.317045 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 03:46:35.317045 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 03:46:35.317045 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 03:46:35.317045 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 03:46:35.317045 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 03:46:35.317045 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 03:46:35.317045 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9307fdad-ca63-449d-bc5c-7e9e167c59f3 could not be found. Aug 04 03:46:35.317045 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi Aug 04 03:46:35.317045 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 03:46:35.317045 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi Aug 04 03:46:35.317045 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 03:46:35.317045 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 03:46:35.317045 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 03:46:35.317045 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 03:46:35.317045 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 03:46:35.317045 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9307fdad-ca63-449d-bc5c-7e9e167c59f3 could not be found. Aug 04 03:46:35.317045 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi Aug 04 03:46:35.322218 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-536bbe64-4561-4e09-a060-4c83d758043e tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Returning 404 to user: Instance 9307fdad-ca63-449d-bc5c-7e9e167c59f3 could not be found. {{(pid=130262) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 03:46:35.322218 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-536bbe64-4561-4e09-a060-4c83d758043e tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] 10.222.0.66 "GET /compute/v2.1/servers/9307fdad-ca63-449d-bc5c-7e9e167c59f3" status: 404 len: 111 microversion: 2.1 time: 0.036005 Aug 04 03:46:35.322218 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 390/779] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:46:35 2022] GET /compute/v2.1/servers/9307fdad-ca63-449d-bc5c-7e9e167c59f3 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 03:46:35.322479 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-4f09915a-5570-4f33-98f6-99855c4cc3c9 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Calling method '.version_select at 0x7f72e2d88550>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:46:35.407569 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-4f09915a-5570-4f33-98f6-99855c4cc3c9 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-874038558" status: 202 len: 0 microversion: 2.1 time: 0.090522 Aug 04 03:46:35.408902 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 390/780] 10.222.0.66 () {58 vars in 1218 bytes} [Thu Aug 4 03:46:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-874038558 => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 03:46:36.225505 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-3935b953-5b6b-451b-b2a0-8a2fec460050 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:46:36.231869 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-3935b953-5b6b-451b-b2a0-8a2fec460050 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] [instance: eb7f2df0-7ac0-4253-a847-e0f797fa845c] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:46:36.235845 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-3935b953-5b6b-451b-b2a0-8a2fec460050 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:36.236549 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-3935b953-5b6b-451b-b2a0-8a2fec460050 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:36.237741 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-3935b953-5b6b-451b-b2a0-8a2fec460050 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:36.238365 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-3935b953-5b6b-451b-b2a0-8a2fec460050 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:36.521779 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-9e02e016-16a4-4a58-bd99-b798d5941e2d tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Action: 'create', calling method: .version_select at 0x7f72e2e63d30>, body: {"keypair": {"name": "tempest-keypair-1668471969", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAU0/E3+JEOEX7GEeqHM1Nqe3ZGDc4/nLO+1O+CpI+suQGqYDFPvAArTSQu1GR5qenQngMD06FQ0+RYR0YLELllTfzOny/2weLIcic+vREslowzgpjBB6h6fK9zYDcq8Dw=="}} {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 03:46:36.543657 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-3935b953-5b6b-451b-b2a0-8a2fec460050 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac48e585c133487dadbe0a1e095bfde0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32813adc26c64016b99c9c5fd838d391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:46:36.558060 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-3935b953-5b6b-451b-b2a0-8a2fec460050 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] 10.222.0.66 "GET /compute/v2.1/servers/eb7f2df0-7ac0-4253-a847-e0f797fa845c" status: 200 len: 1576 microversion: 2.1 time: 0.337270 Aug 04 03:46:36.559598 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.quota [None req-9e02e016-16a4-4a58-bd99-b798d5941e2d tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Getting quotas for project f46b8dc64007429b805971d4c6f5b471. Resources: {'key_pairs'} {{(pid=130263) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 03:46:36.561321 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 391/781] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:46:36 2022] GET /compute/v2.1/servers/eb7f2df0-7ac0-4253-a847-e0f797fa845c => generated 1576 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:46:36.571170 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.quota [None req-9e02e016-16a4-4a58-bd99-b798d5941e2d tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Getting quotas for user 6dba436d0a67433f8c8ae7cd40d3f795 and project f46b8dc64007429b805971d4c6f5b471. Resources: {'key_pairs'} {{(pid=130263) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 03:46:36.717647 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-9e02e016-16a4-4a58-bd99-b798d5941e2d tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.200245 Aug 04 03:46:36.719033 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 391/782] 10.222.0.66 () {60 vars in 1159 bytes} [Thu Aug 4 03:46:36 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 03:46:37.583993 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-739f0017-fc80-4f06-bf9f-d96c53cec632 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:46:37.585054 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-739f0017-fc80-4f06-bf9f-d96c53cec632 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] [instance: eb7f2df0-7ac0-4253-a847-e0f797fa845c] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:46:37.592567 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-739f0017-fc80-4f06-bf9f-d96c53cec632 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:37.593189 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-739f0017-fc80-4f06-bf9f-d96c53cec632 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:37.594099 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-739f0017-fc80-4f06-bf9f-d96c53cec632 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:37.594621 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-739f0017-fc80-4f06-bf9f-d96c53cec632 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:37.804748 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-739f0017-fc80-4f06-bf9f-d96c53cec632 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac48e585c133487dadbe0a1e095bfde0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32813adc26c64016b99c9c5fd838d391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:46:37.815674 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-739f0017-fc80-4f06-bf9f-d96c53cec632 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] 10.222.0.66 "GET /compute/v2.1/servers/eb7f2df0-7ac0-4253-a847-e0f797fa845c" status: 200 len: 1576 microversion: 2.1 time: 0.235358 Aug 04 03:46:37.817169 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 392/783] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:46:37 2022] GET /compute/v2.1/servers/eb7f2df0-7ac0-4253-a847-e0f797fa845c => generated 1576 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:46:38.485512 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [req-f36df51c-aecb-41a8-b552-9a3636b321df req-9302bf6f-e556-4251-8da5-c8e609ea3719 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb7f2df0-7ac0-4253-a847-e0f797fa845c", "name": "network-vif-deleted", "tag": "6d1957ef-9b04-4f77-b14d-a55bdf6ca5b0"}]} {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 03:46:38.498217 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [req-f36df51c-aecb-41a8-b552-9a3636b321df req-9302bf6f-e556-4251-8da5-c8e609ea3719 service nova] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:38.500270 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [req-f36df51c-aecb-41a8-b552-9a3636b321df req-9302bf6f-e556-4251-8da5-c8e609ea3719 service nova] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:38.536021 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.compute.server_external_events [req-f36df51c-aecb-41a8-b552-9a3636b321df req-9302bf6f-e556-4251-8da5-c8e609ea3719 service nova] Creating event network-vif-deleted:6d1957ef-9b04-4f77-b14d-a55bdf6ca5b0 for instance eb7f2df0-7ac0-4253-a847-e0f797fa845c on hv-cinder-73306 Aug 04 03:46:38.547592 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [req-f36df51c-aecb-41a8-b552-9a3636b321df req-9302bf6f-e556-4251-8da5-c8e609ea3719 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074984 Aug 04 03:46:38.549273 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 392/784] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 03:46:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 03:46:38.838923 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-2087d15c-dad3-4d97-a3fd-ba41732349c4 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:46:38.839648 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-2087d15c-dad3-4d97-a3fd-ba41732349c4 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] [instance: eb7f2df0-7ac0-4253-a847-e0f797fa845c] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:46:38.854854 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-2087d15c-dad3-4d97-a3fd-ba41732349c4 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:38.858333 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-2087d15c-dad3-4d97-a3fd-ba41732349c4 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:38.862937 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-2087d15c-dad3-4d97-a3fd-ba41732349c4 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:38.865870 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-2087d15c-dad3-4d97-a3fd-ba41732349c4 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:39.371356 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-2087d15c-dad3-4d97-a3fd-ba41732349c4 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac48e585c133487dadbe0a1e095bfde0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32813adc26c64016b99c9c5fd838d391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:46:39.380741 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-2087d15c-dad3-4d97-a3fd-ba41732349c4 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] 10.222.0.66 "GET /compute/v2.1/servers/eb7f2df0-7ac0-4253-a847-e0f797fa845c" status: 200 len: 1225 microversion: 2.1 time: 0.546231 Aug 04 03:46:39.393228 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 393/785] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:46:38 2022] GET /compute/v2.1/servers/eb7f2df0-7ac0-4253-a847-e0f797fa845c => generated 1225 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:46:39.640828 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-91724d71-9e14-4a14-aafb-7a15b3a417ae tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Action: 'create', calling method: .version_select at 0x7f72e2dccdc0>, body: {"keypair": {"name": "tempest-keypair-1570898862", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMrReNpMWQ+Oo5LxtuErk7Rwn6jvUI55KLBbx8WtkSGQuYKuop2xjtwx2tb8cnClT/jLo+RVg6p3eGvq1MbxZgP8T3OP5co81Ddcq9f5Ce+hjb3tMngrfHC73kkT/DgVxQ=="}} {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 03:46:39.659428 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.quota [None req-91724d71-9e14-4a14-aafb-7a15b3a417ae tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Getting quotas for project a98f18ee8c7d4cfe9f4b879505ca6605. Resources: {'key_pairs'} {{(pid=130263) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 03:46:39.664575 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.quota [None req-91724d71-9e14-4a14-aafb-7a15b3a417ae tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Getting quotas for user ac99f60384fe4a119d019cedfe1d3557 and project a98f18ee8c7d4cfe9f4b879505ca6605. Resources: {'key_pairs'} {{(pid=130263) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 03:46:39.755047 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-91724d71-9e14-4a14-aafb-7a15b3a417ae tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.315876 Aug 04 03:46:39.756184 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 393/786] 10.222.0.66 () {60 vars in 1159 bytes} [Thu Aug 4 03:46:39 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 03:46:39.876230 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-682157a7-23f3-4354-8e35-8c9e6c48f83c tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1062642238", "imageRef": "0208f4b3-1d2f-42e4-a9b4-528bf5066fe1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f4a2360d-a859-43ed-85be-aea044bbfe33"}], "security_groups": [{"name": "tempest-securitygroup--1802623790"}], "key_name": "tempest-keypair-1668471969", "user_data": "}} {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 03:46:39.992587 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.network.neutron [None req-682157a7-23f3-4354-8e35-8c9e6c48f83c tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] validate_networks() for [('f4a2360d-a859-43ed-85be-aea044bbfe33', None, None, None, None, None)] {{(pid=130262) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 03:46:40.404981 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-a80736cb-f72e-4fd4-9258-649d6028228a tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:46:40.405825 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-a80736cb-f72e-4fd4-9258-649d6028228a tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] [instance: eb7f2df0-7ac0-4253-a847-e0f797fa845c] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:46:40.412906 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-a80736cb-f72e-4fd4-9258-649d6028228a tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:40.413544 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-a80736cb-f72e-4fd4-9258-649d6028228a tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:40.414417 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-a80736cb-f72e-4fd4-9258-649d6028228a tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:40.414854 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-a80736cb-f72e-4fd4-9258-649d6028228a tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:40.433452 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.wsgi [None req-a80736cb-f72e-4fd4-9258-649d6028228a tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] HTTP exception thrown: Instance eb7f2df0-7ac0-4253-a847-e0f797fa845c could not be found. Aug 04 03:46:40.435215 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-a80736cb-f72e-4fd4-9258-649d6028228a tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Request method failure captured: Aug 04 03:46:40.435215 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: request: GET /compute/v2.1/servers/eb7f2df0-7ac0-4253-a847-e0f797fa845c HTTP/1.1 Aug 04 03:46:40.435215 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Accept: application/json Aug 04 03:46:40.435215 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Accept-Encoding: identity Aug 04 03:46:40.435215 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Connection: close Aug 04 03:46:40.435215 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Content-Length: 0 Aug 04 03:46:40.435215 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Content-Type: application/json Aug 04 03:46:40.435215 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Host: 10.222.0.66 Aug 04 03:46:40.435215 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Openstack-System-Scope: None Aug 04 03:46:40.435215 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: User-Agent: python-urllib3/1.26.11 Aug 04 03:46:40.435215 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Auth-Token: gAAAAABi60AFF-wV8KTWO4eIZ97P_YfToxI7Zc8wk1Ll6AJptMYxHIRgKMY8RYQeg34D2Ep4--KnmrrLbBwKbOSHeJozvBoq6rPiXGsNCZLUOvhB94PYKPerNnuGns310VRY0tMD-AiqxinZNc3RewVLmHi_AQr9FFGEXLcupihluRXvsIMGG8Q Aug 04 03:46:40.435215 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Domain-Id: None Aug 04 03:46:40.435215 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Domain-Name: None Aug 04 03:46:40.435215 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Identity-Status: Confirmed Aug 04 03:46:40.435215 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Is-Admin-Project: True Aug 04 03:46:40.435215 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Project-Domain-Id: default Aug 04 03:46:40.435215 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Project-Domain-Name: Default Aug 04 03:46:40.435215 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Project-Id: 32813adc26c64016b99c9c5fd838d391 Aug 04 03:46:40.435215 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Project-Name: tempest-TestVolumeBootPattern-1823470116 Aug 04 03:46:40.435215 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Role: member,reader Aug 04 03:46:40.435215 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Roles: member,reader Aug 04 03:46:40.436456 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/32813adc26c64016b99c9c5fd838d391"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/32813adc26c64016b99c9c5fd838d391"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/32813adc26c64016b99c9c5fd838d391"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_32813adc26c64016b99c9c5fd838d391"}]}] Aug 04 03:46:40.436456 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Tenant: tempest-TestVolumeBootPattern-1823470116 Aug 04 03:46:40.436456 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Tenant-Id: 32813adc26c64016b99c9c5fd838d391 Aug 04 03:46:40.436456 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Tenant-Name: tempest-TestVolumeBootPattern-1823470116 Aug 04 03:46:40.436456 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-User: tempest-TestVolumeBootPattern-1823470116-project Aug 04 03:46:40.436456 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-User-Domain-Id: default Aug 04 03:46:40.436456 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-User-Domain-Name: Default Aug 04 03:46:40.436456 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-User-Id: ac48e585c133487dadbe0a1e095bfde0 Aug 04 03:46:40.436456 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-User-Name: tempest-TestVolumeBootPattern-1823470116-project Aug 04 03:46:40.436456 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: method: > Aug 04 03:46:40.436456 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: exception: Instance eb7f2df0-7ac0-4253-a847-e0f797fa845c could not be found. Aug 04 03:46:40.436456 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: action_args: {'id': 'eb7f2df0-7ac0-4253-a847-e0f797fa845c'} Aug 04 03:46:40.438413 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 03:46:40.438413 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 03:46:40.438413 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 03:46:40.438413 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 03:46:40.438413 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 03:46:40.438413 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 03:46:40.438413 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 03:46:40.438413 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 03:46:40.438413 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 03:46:40.438413 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 03:46:40.438413 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb7f2df0-7ac0-4253-a847-e0f797fa845c could not be found. Aug 04 03:46:40.438413 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Aug 04 03:46:40.438413 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 03:46:40.438413 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Aug 04 03:46:40.438413 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 03:46:40.438413 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 03:46:40.438413 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 03:46:40.438413 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 03:46:40.438413 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 03:46:40.438413 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 03:46:40.448979 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 03:46:40.448979 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 03:46:40.448979 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 03:46:40.448979 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 03:46:40.448979 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 03:46:40.448979 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 03:46:40.448979 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 03:46:40.448979 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb7f2df0-7ac0-4253-a847-e0f797fa845c could not be found. Aug 04 03:46:40.448979 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Aug 04 03:46:40.448979 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 03:46:40.448979 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Aug 04 03:46:40.448979 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 03:46:40.448979 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 03:46:40.448979 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 03:46:40.448979 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 03:46:40.448979 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 03:46:40.448979 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb7f2df0-7ac0-4253-a847-e0f797fa845c could not be found. Aug 04 03:46:40.448979 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Aug 04 03:46:40.451259 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-a80736cb-f72e-4fd4-9258-649d6028228a tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Returning 404 to user: Instance eb7f2df0-7ac0-4253-a847-e0f797fa845c could not be found. {{(pid=130263) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 03:46:40.451259 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-a80736cb-f72e-4fd4-9258-649d6028228a tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] 10.222.0.66 "GET /compute/v2.1/servers/eb7f2df0-7ac0-4253-a847-e0f797fa845c" status: 404 len: 111 microversion: 2.1 time: 0.037238 Aug 04 03:46:40.451259 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 394/787] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:46:40 2022] GET /compute/v2.1/servers/eb7f2df0-7ac0-4253-a847-e0f797fa845c => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 03:46:40.458906 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.virt.hardware [None req-682157a7-23f3-4354-8e35-8c9e6c48f83c tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Flavor limits 0:0:0 {{(pid=130262) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 03:46:40.458906 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.virt.hardware [None req-682157a7-23f3-4354-8e35-8c9e6c48f83c tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Image limits 0:0:0 {{(pid=130262) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 03:46:40.458906 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.virt.hardware [None req-682157a7-23f3-4354-8e35-8c9e6c48f83c tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Flavor pref 0:0:0 {{(pid=130262) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 03:46:40.458906 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.virt.hardware [None req-682157a7-23f3-4354-8e35-8c9e6c48f83c tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Image pref 0:0:0 {{(pid=130262) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 03:46:40.458906 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.virt.hardware [None req-682157a7-23f3-4354-8e35-8c9e6c48f83c tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130262) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 03:46:40.473283 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-682157a7-23f3-4354-8e35-8c9e6c48f83c tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:40.473750 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-682157a7-23f3-4354-8e35-8c9e6c48f83c tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:40.475058 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-682157a7-23f3-4354-8e35-8c9e6c48f83c tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:40.475538 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-682157a7-23f3-4354-8e35-8c9e6c48f83c tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:40.495928 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.quota [None req-682157a7-23f3-4354-8e35-8c9e6c48f83c tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Getting quotas for project f46b8dc64007429b805971d4c6f5b471. Resources: {'instances', 'ram', 'cores'} {{(pid=130262) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 03:46:40.500109 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.quota [None req-682157a7-23f3-4354-8e35-8c9e6c48f83c tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Getting quotas for user 6dba436d0a67433f8c8ae7cd40d3f795 and project f46b8dc64007429b805971d4c6f5b471. Resources: {'instances', 'ram', 'cores'} {{(pid=130262) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 03:46:40.516780 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-682157a7-23f3-4354-8e35-8c9e6c48f83c tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Going to run 1 instances... {{(pid=130262) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 03:46:40.519227 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-682157a7-23f3-4354-8e35-8c9e6c48f83c tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] [instance: 221108c9-a4b6-4e41-a9e5-a4e1461c991d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0208f4b3-1d2f-42e4-a9b4-528bf5066fe1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130262) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 03:46:40.579962 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-611b68d6-aabe-4fd7-8771-9e40a6f403f0 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-257382756", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-908000990", "security_groups": [{"name": "tempest-secgroup-smoke-212095973"}], "block_device_mapping_v2": [{"uuid": "4b2076da-eecf-4cb2-9b7d-abf74d836ed5", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "8d050520-b725-42ec-a591-c1de472eb260"}]}} {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 03:46:40.661613 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-682157a7-23f3-4354-8e35-8c9e6c48f83c tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.789666 Aug 04 03:46:40.662302 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 394/788] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 03:46:39 2022] POST /compute/v2.1/servers => generated 402 bytes in 792 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 03:46:40.681277 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-d0323015-1cde-401c-b5da-44bdf2db9b2e tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:46:40.681803 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-d0323015-1cde-401c-b5da-44bdf2db9b2e tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] [instance: 221108c9-a4b6-4e41-a9e5-a4e1461c991d] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:46:40.753501 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.network.neutron [None req-611b68d6-aabe-4fd7-8771-9e40a6f403f0 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] validate_networks() for [('8d050520-b725-42ec-a591-c1de472eb260', None, None, None, None, None)] {{(pid=130263) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 03:46:40.848427 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-d0323015-1cde-401c-b5da-44bdf2db9b2e tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dba436d0a67433f8c8ae7cd40d3f795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46b8dc64007429b805971d4c6f5b471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:46:40.856850 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-d0323015-1cde-401c-b5da-44bdf2db9b2e tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] 10.222.0.66 "GET /compute/v2.1/servers/221108c9-a4b6-4e41-a9e5-a4e1461c991d" status: 200 len: 1238 microversion: 2.1 time: 0.183035 Aug 04 03:46:40.858328 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 395/789] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:46:40 2022] GET /compute/v2.1/servers/221108c9-a4b6-4e41-a9e5-a4e1461c991d => generated 1238 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:46:41.267602 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.virt.hardware [None req-611b68d6-aabe-4fd7-8771-9e40a6f403f0 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Flavor limits 0:0:0 {{(pid=130263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 03:46:41.268632 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.virt.hardware [None req-611b68d6-aabe-4fd7-8771-9e40a6f403f0 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Image limits 0:0:0 {{(pid=130263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 03:46:41.269812 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.virt.hardware [None req-611b68d6-aabe-4fd7-8771-9e40a6f403f0 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Flavor pref 0:0:0 {{(pid=130263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 03:46:41.270438 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.virt.hardware [None req-611b68d6-aabe-4fd7-8771-9e40a6f403f0 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Image pref 0:0:0 {{(pid=130263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 03:46:41.271086 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.virt.hardware [None req-611b68d6-aabe-4fd7-8771-9e40a6f403f0 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 03:46:41.282541 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-611b68d6-aabe-4fd7-8771-9e40a6f403f0 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:41.282999 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-611b68d6-aabe-4fd7-8771-9e40a6f403f0 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:41.283805 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-611b68d6-aabe-4fd7-8771-9e40a6f403f0 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:41.284249 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-611b68d6-aabe-4fd7-8771-9e40a6f403f0 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:41.302162 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.quota [None req-611b68d6-aabe-4fd7-8771-9e40a6f403f0 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Getting quotas for project 32813adc26c64016b99c9c5fd838d391. Resources: {'instances', 'ram', 'cores'} {{(pid=130263) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 03:46:41.306319 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.quota [None req-611b68d6-aabe-4fd7-8771-9e40a6f403f0 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Getting quotas for user ac48e585c133487dadbe0a1e095bfde0 and project 32813adc26c64016b99c9c5fd838d391. Resources: {'instances', 'ram', 'cores'} {{(pid=130263) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 03:46:41.381849 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-611b68d6-aabe-4fd7-8771-9e40a6f403f0 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Going to run 1 instances... {{(pid=130263) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 03:46:41.384684 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-611b68d6-aabe-4fd7-8771-9e40a6f403f0 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] [instance: 99218af9-c409-4074-bd4e-a3dff3731105] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='4b2076da-eecf-4cb2-9b7d-abf74d836ed5',volume_size=None,volume_type=None)] {{(pid=130263) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 03:46:41.831331 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-611b68d6-aabe-4fd7-8771-9e40a6f403f0 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.256199 Aug 04 03:46:41.838095 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 395/790] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 03:46:40 2022] POST /compute/v2.1/servers => generated 405 bytes in 1258 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 04 03:46:41.843474 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-4cee523d-0f84-4c64-952a-fe0bf280f94b tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:46:41.845589 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-4cee523d-0f84-4c64-952a-fe0bf280f94b tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] [instance: 99218af9-c409-4074-bd4e-a3dff3731105] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:46:41.877609 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-b67b0ad0-3316-49a4-bafd-2fad0646ac90 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:46:41.878216 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-b67b0ad0-3316-49a4-bafd-2fad0646ac90 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] [instance: 221108c9-a4b6-4e41-a9e5-a4e1461c991d] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:46:41.886163 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-b67b0ad0-3316-49a4-bafd-2fad0646ac90 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:41.886617 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-b67b0ad0-3316-49a4-bafd-2fad0646ac90 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:41.887388 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-b67b0ad0-3316-49a4-bafd-2fad0646ac90 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:41.887820 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-b67b0ad0-3316-49a4-bafd-2fad0646ac90 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:41.914494 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-4cee523d-0f84-4c64-952a-fe0bf280f94b tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac48e585c133487dadbe0a1e095bfde0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32813adc26c64016b99c9c5fd838d391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:46:41.924320 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-4cee523d-0f84-4c64-952a-fe0bf280f94b tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] 10.222.0.66 "GET /compute/v2.1/servers/99218af9-c409-4074-bd4e-a3dff3731105" status: 200 len: 1093 microversion: 2.1 time: 0.083701 Aug 04 03:46:41.925160 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 396/791] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:46:41 2022] GET /compute/v2.1/servers/99218af9-c409-4074-bd4e-a3dff3731105 => generated 1093 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:46:42.009824 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-b67b0ad0-3316-49a4-bafd-2fad0646ac90 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dba436d0a67433f8c8ae7cd40d3f795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46b8dc64007429b805971d4c6f5b471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:46:42.023778 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-b67b0ad0-3316-49a4-bafd-2fad0646ac90 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] 10.222.0.66 "GET /compute/v2.1/servers/221108c9-a4b6-4e41-a9e5-a4e1461c991d" status: 200 len: 1242 microversion: 2.1 time: 0.149430 Aug 04 03:46:42.037240 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 396/792] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:46:41 2022] GET /compute/v2.1/servers/221108c9-a4b6-4e41-a9e5-a4e1461c991d => generated 1242 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:46:42.524366 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-bc1e3686-2f3b-4b4c-a6ba-479bd0734b60 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-162188871", "imageRef": "0208f4b3-1d2f-42e4-a9b4-528bf5066fe1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9a7b7e8a-baf9-483b-925f-a5723b52bbe6"}], "security_groups": [{"name": "tempest-securitygroup--1098367738"}], "key_name": "tempest-keypair-1570898862", "user_data": "}} {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 03:46:42.640571 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.network.neutron [None req-bc1e3686-2f3b-4b4c-a6ba-479bd0734b60 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] validate_networks() for [('9a7b7e8a-baf9-483b-925f-a5723b52bbe6', None, None, None, None, None)] {{(pid=130262) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 03:46:42.953420 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-4574e382-c0e3-441b-b005-ccd478e65bc1 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:46:42.954552 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-4574e382-c0e3-441b-b005-ccd478e65bc1 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] [instance: 99218af9-c409-4074-bd4e-a3dff3731105] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:46:42.962532 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-4574e382-c0e3-441b-b005-ccd478e65bc1 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:42.963919 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-4574e382-c0e3-441b-b005-ccd478e65bc1 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:42.965497 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-4574e382-c0e3-441b-b005-ccd478e65bc1 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:42.966054 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-4574e382-c0e3-441b-b005-ccd478e65bc1 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:43.082477 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-4574e382-c0e3-441b-b005-ccd478e65bc1 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac48e585c133487dadbe0a1e095bfde0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32813adc26c64016b99c9c5fd838d391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:46:43.097111 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-4574e382-c0e3-441b-b005-ccd478e65bc1 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] 10.222.0.66 "GET /compute/v2.1/servers/99218af9-c409-4074-bd4e-a3dff3731105" status: 200 len: 1143 microversion: 2.1 time: 0.153420 Aug 04 03:46:43.101938 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 397/793] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:46:42 2022] GET /compute/v2.1/servers/99218af9-c409-4074-bd4e-a3dff3731105 => generated 1143 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 03:46:43.110163 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-dce16d94-b467-4fb0-bf36-dcde193c9a59 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:46:43.110775 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-dce16d94-b467-4fb0-bf36-dcde193c9a59 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] [instance: 221108c9-a4b6-4e41-a9e5-a4e1461c991d] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:46:43.126626 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-dce16d94-b467-4fb0-bf36-dcde193c9a59 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:43.129804 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-dce16d94-b467-4fb0-bf36-dcde193c9a59 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:43.129804 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-dce16d94-b467-4fb0-bf36-dcde193c9a59 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:43.129804 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-dce16d94-b467-4fb0-bf36-dcde193c9a59 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:43.147096 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.virt.hardware [None req-bc1e3686-2f3b-4b4c-a6ba-479bd0734b60 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Flavor limits 0:0:0 {{(pid=130262) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 03:46:43.148094 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.virt.hardware [None req-bc1e3686-2f3b-4b4c-a6ba-479bd0734b60 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Image limits 0:0:0 {{(pid=130262) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 03:46:43.148934 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.virt.hardware [None req-bc1e3686-2f3b-4b4c-a6ba-479bd0734b60 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Flavor pref 0:0:0 {{(pid=130262) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 03:46:43.149527 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.virt.hardware [None req-bc1e3686-2f3b-4b4c-a6ba-479bd0734b60 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Image pref 0:0:0 {{(pid=130262) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 03:46:43.150111 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.virt.hardware [None req-bc1e3686-2f3b-4b4c-a6ba-479bd0734b60 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130262) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 03:46:43.161073 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-bc1e3686-2f3b-4b4c-a6ba-479bd0734b60 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:43.161767 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-bc1e3686-2f3b-4b4c-a6ba-479bd0734b60 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:43.162746 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-bc1e3686-2f3b-4b4c-a6ba-479bd0734b60 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:43.163401 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-bc1e3686-2f3b-4b4c-a6ba-479bd0734b60 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:43.187381 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.quota [None req-bc1e3686-2f3b-4b4c-a6ba-479bd0734b60 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Getting quotas for project a98f18ee8c7d4cfe9f4b879505ca6605. Resources: {'instances', 'ram', 'cores'} {{(pid=130262) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 03:46:43.192036 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.quota [None req-bc1e3686-2f3b-4b4c-a6ba-479bd0734b60 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Getting quotas for user ac99f60384fe4a119d019cedfe1d3557 and project a98f18ee8c7d4cfe9f4b879505ca6605. Resources: {'instances', 'ram', 'cores'} {{(pid=130262) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 03:46:43.205413 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-bc1e3686-2f3b-4b4c-a6ba-479bd0734b60 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Going to run 1 instances... {{(pid=130262) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 03:46:43.207904 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-bc1e3686-2f3b-4b4c-a6ba-479bd0734b60 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] [instance: 2ed39450-289e-4d51-b1b0-c5fe323e6201] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0208f4b3-1d2f-42e4-a9b4-528bf5066fe1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130262) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 03:46:43.259700 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-dce16d94-b467-4fb0-bf36-dcde193c9a59 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dba436d0a67433f8c8ae7cd40d3f795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46b8dc64007429b805971d4c6f5b471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:46:43.268851 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-dce16d94-b467-4fb0-bf36-dcde193c9a59 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] 10.222.0.66 "GET /compute/v2.1/servers/221108c9-a4b6-4e41-a9e5-a4e1461c991d" status: 200 len: 1298 microversion: 2.1 time: 0.165349 Aug 04 03:46:43.270080 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 398/794] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:46:43 2022] GET /compute/v2.1/servers/221108c9-a4b6-4e41-a9e5-a4e1461c991d => generated 1298 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:46:43.392835 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-bc1e3686-2f3b-4b4c-a6ba-479bd0734b60 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.872680 Aug 04 03:46:43.393847 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 397/795] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 03:46:42 2022] POST /compute/v2.1/servers => generated 402 bytes in 874 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 03:46:43.405511 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-4307f1bc-4765-4b91-ab49-5182a3ca3be0 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:46:43.412141 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-4307f1bc-4765-4b91-ab49-5182a3ca3be0 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] [instance: 2ed39450-289e-4d51-b1b0-c5fe323e6201] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:46:43.485928 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-4307f1bc-4765-4b91-ab49-5182a3ca3be0 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac99f60384fe4a119d019cedfe1d3557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f18ee8c7d4cfe9f4b879505ca6605', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:46:43.495053 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-4307f1bc-4765-4b91-ab49-5182a3ca3be0 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] 10.222.0.66 "GET /compute/v2.1/servers/2ed39450-289e-4d51-b1b0-c5fe323e6201" status: 200 len: 1241 microversion: 2.1 time: 0.092812 Aug 04 03:46:43.496598 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 399/796] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:46:43 2022] GET /compute/v2.1/servers/2ed39450-289e-4d51-b1b0-c5fe323e6201 => generated 1241 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:46:44.124750 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-03ec7e91-c0ee-4a90-a89d-9ceecd9f327d tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:46:44.125439 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-03ec7e91-c0ee-4a90-a89d-9ceecd9f327d tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] [instance: 99218af9-c409-4074-bd4e-a3dff3731105] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:46:44.133545 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-03ec7e91-c0ee-4a90-a89d-9ceecd9f327d tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:44.133984 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-03ec7e91-c0ee-4a90-a89d-9ceecd9f327d tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:44.135031 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-03ec7e91-c0ee-4a90-a89d-9ceecd9f327d tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:44.136087 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-03ec7e91-c0ee-4a90-a89d-9ceecd9f327d tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:44.207175 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-03ec7e91-c0ee-4a90-a89d-9ceecd9f327d tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac48e585c133487dadbe0a1e095bfde0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32813adc26c64016b99c9c5fd838d391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:46:44.218781 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-03ec7e91-c0ee-4a90-a89d-9ceecd9f327d tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] 10.222.0.66 "GET /compute/v2.1/servers/99218af9-c409-4074-bd4e-a3dff3731105" status: 200 len: 1199 microversion: 2.1 time: 0.097974 Aug 04 03:46:44.219674 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 398/797] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:46:44 2022] GET /compute/v2.1/servers/99218af9-c409-4074-bd4e-a3dff3731105 => generated 1199 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:46:44.289868 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-80db00b7-f02c-48c2-9020-a1c710c14f9b tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:46:44.296718 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-80db00b7-f02c-48c2-9020-a1c710c14f9b tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] [instance: 221108c9-a4b6-4e41-a9e5-a4e1461c991d] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:46:44.297827 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-80db00b7-f02c-48c2-9020-a1c710c14f9b tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:44.298501 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-80db00b7-f02c-48c2-9020-a1c710c14f9b tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:44.299350 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-80db00b7-f02c-48c2-9020-a1c710c14f9b tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:44.299867 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-80db00b7-f02c-48c2-9020-a1c710c14f9b tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:44.305306 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG dbcounter [-] [130263] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=130263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:46:44.456487 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-80db00b7-f02c-48c2-9020-a1c710c14f9b tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dba436d0a67433f8c8ae7cd40d3f795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46b8dc64007429b805971d4c6f5b471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:46:44.464488 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-80db00b7-f02c-48c2-9020-a1c710c14f9b tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] 10.222.0.66 "GET /compute/v2.1/servers/221108c9-a4b6-4e41-a9e5-a4e1461c991d" status: 200 len: 1364 microversion: 2.1 time: 0.178485 Aug 04 03:46:44.465039 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 400/798] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:46:44 2022] GET /compute/v2.1/servers/221108c9-a4b6-4e41-a9e5-a4e1461c991d => generated 1364 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:46:44.520270 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-1edeff41-0486-4ed8-a64f-6530e2ed4e9c tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:46:44.521071 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-1edeff41-0486-4ed8-a64f-6530e2ed4e9c tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] [instance: 2ed39450-289e-4d51-b1b0-c5fe323e6201] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:46:44.582947 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-1edeff41-0486-4ed8-a64f-6530e2ed4e9c tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac99f60384fe4a119d019cedfe1d3557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f18ee8c7d4cfe9f4b879505ca6605', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:46:44.590763 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-1edeff41-0486-4ed8-a64f-6530e2ed4e9c tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] 10.222.0.66 "GET /compute/v2.1/servers/2ed39450-289e-4d51-b1b0-c5fe323e6201" status: 200 len: 1241 microversion: 2.1 time: 0.076045 Aug 04 03:46:44.591692 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 399/799] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:46:44 2022] GET /compute/v2.1/servers/2ed39450-289e-4d51-b1b0-c5fe323e6201 => generated 1241 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:46:45.240026 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-c60c1e22-c3ad-4827-9042-2b829d84d822 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:46:45.241000 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-c60c1e22-c3ad-4827-9042-2b829d84d822 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] [instance: 99218af9-c409-4074-bd4e-a3dff3731105] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:46:45.248749 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-c60c1e22-c3ad-4827-9042-2b829d84d822 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:45.249573 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-c60c1e22-c3ad-4827-9042-2b829d84d822 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:45.250353 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-c60c1e22-c3ad-4827-9042-2b829d84d822 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:45.250790 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-c60c1e22-c3ad-4827-9042-2b829d84d822 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:45.473024 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [req-9a6f41e2-fb23-482a-b6f9-6a25cd643fcd req-a264062e-71c9-4e16-a1c6-4ee80da1c3c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "221108c9-a4b6-4e41-a9e5-a4e1461c991d", "tag": "fbd5776e-e5bb-4524-bca5-b312018f5f7d"}]} {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 03:46:45.485647 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [req-9a6f41e2-fb23-482a-b6f9-6a25cd643fcd req-a264062e-71c9-4e16-a1c6-4ee80da1c3c1 service nova] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:45.486092 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [req-9a6f41e2-fb23-482a-b6f9-6a25cd643fcd req-a264062e-71c9-4e16-a1c6-4ee80da1c3c1 service nova] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:45.498984 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.compute.server_external_events [req-9a6f41e2-fb23-482a-b6f9-6a25cd643fcd req-a264062e-71c9-4e16-a1c6-4ee80da1c3c1 service nova] Creating event network-changed:fbd5776e-e5bb-4524-bca5-b312018f5f7d for instance 221108c9-a4b6-4e41-a9e5-a4e1461c991d on hv-cinder-73306 Aug 04 03:46:45.504282 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [req-9a6f41e2-fb23-482a-b6f9-6a25cd643fcd req-a264062e-71c9-4e16-a1c6-4ee80da1c3c1 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034869 Aug 04 03:46:45.504881 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 400/800] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 03:46:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 03:46:45.509962 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-1b2c3fbb-0a06-4d10-b5f8-c3b92c101067 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:46:45.510782 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-1b2c3fbb-0a06-4d10-b5f8-c3b92c101067 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] [instance: 221108c9-a4b6-4e41-a9e5-a4e1461c991d] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:46:45.517685 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-1b2c3fbb-0a06-4d10-b5f8-c3b92c101067 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:45.518161 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-1b2c3fbb-0a06-4d10-b5f8-c3b92c101067 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:45.518940 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-1b2c3fbb-0a06-4d10-b5f8-c3b92c101067 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:45.519380 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-1b2c3fbb-0a06-4d10-b5f8-c3b92c101067 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:45.735237 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-c60c1e22-c3ad-4827-9042-2b829d84d822 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac48e585c133487dadbe0a1e095bfde0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32813adc26c64016b99c9c5fd838d391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:46:45.753290 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-c60c1e22-c3ad-4827-9042-2b829d84d822 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] 10.222.0.66 "GET /compute/v2.1/servers/99218af9-c409-4074-bd4e-a3dff3731105" status: 200 len: 1276 microversion: 2.1 time: 0.516700 Aug 04 03:46:45.768351 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 401/801] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:46:45 2022] GET /compute/v2.1/servers/99218af9-c409-4074-bd4e-a3dff3731105 => generated 1276 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:46:45.775558 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-986f6899-f91a-4470-8874-e2c021b087ce tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:46:45.776392 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-986f6899-f91a-4470-8874-e2c021b087ce tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] [instance: 2ed39450-289e-4d51-b1b0-c5fe323e6201] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:46:45.785075 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-986f6899-f91a-4470-8874-e2c021b087ce tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:45.799256 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-986f6899-f91a-4470-8874-e2c021b087ce tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:45.799256 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-986f6899-f91a-4470-8874-e2c021b087ce tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:45.799256 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-986f6899-f91a-4470-8874-e2c021b087ce tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:45.801006 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-1b2c3fbb-0a06-4d10-b5f8-c3b92c101067 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dba436d0a67433f8c8ae7cd40d3f795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46b8dc64007429b805971d4c6f5b471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:46:45.832041 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-1b2c3fbb-0a06-4d10-b5f8-c3b92c101067 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] 10.222.0.66 "GET /compute/v2.1/servers/221108c9-a4b6-4e41-a9e5-a4e1461c991d" status: 200 len: 1364 microversion: 2.1 time: 0.325804 Aug 04 03:46:45.832827 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 401/802] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:46:45 2022] GET /compute/v2.1/servers/221108c9-a4b6-4e41-a9e5-a4e1461c991d => generated 1364 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:46:45.881723 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-986f6899-f91a-4470-8874-e2c021b087ce tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac99f60384fe4a119d019cedfe1d3557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f18ee8c7d4cfe9f4b879505ca6605', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:46:45.889910 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-986f6899-f91a-4470-8874-e2c021b087ce tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] 10.222.0.66 "GET /compute/v2.1/servers/2ed39450-289e-4d51-b1b0-c5fe323e6201" status: 200 len: 1293 microversion: 2.1 time: 0.133436 Aug 04 03:46:45.890784 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 402/803] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:46:45 2022] GET /compute/v2.1/servers/2ed39450-289e-4d51-b1b0-c5fe323e6201 => generated 1293 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:46:46.777123 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-aa139c98-774d-4820-94d9-e59c426f8020 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:46:46.778398 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-aa139c98-774d-4820-94d9-e59c426f8020 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] [instance: 99218af9-c409-4074-bd4e-a3dff3731105] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:46:46.787001 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-aa139c98-774d-4820-94d9-e59c426f8020 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:46.787537 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-aa139c98-774d-4820-94d9-e59c426f8020 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:46.788643 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-aa139c98-774d-4820-94d9-e59c426f8020 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:46.789092 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-aa139c98-774d-4820-94d9-e59c426f8020 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:46.854185 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-e3d65176-e66e-419b-9a56-b718dd2e870b tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:46:46.855198 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-e3d65176-e66e-419b-9a56-b718dd2e870b tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] [instance: 221108c9-a4b6-4e41-a9e5-a4e1461c991d] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:46:46.864926 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-e3d65176-e66e-419b-9a56-b718dd2e870b tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:46.865422 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-e3d65176-e66e-419b-9a56-b718dd2e870b tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:46.866211 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-e3d65176-e66e-419b-9a56-b718dd2e870b tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:46.866653 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-e3d65176-e66e-419b-9a56-b718dd2e870b tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:47.165368 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-aa139c98-774d-4820-94d9-e59c426f8020 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac48e585c133487dadbe0a1e095bfde0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32813adc26c64016b99c9c5fd838d391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:46:47.176112 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-aa139c98-774d-4820-94d9-e59c426f8020 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] 10.222.0.66 "GET /compute/v2.1/servers/99218af9-c409-4074-bd4e-a3dff3731105" status: 200 len: 1264 microversion: 2.1 time: 0.402882 Aug 04 03:46:47.189228 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 402/804] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:46:46 2022] GET /compute/v2.1/servers/99218af9-c409-4074-bd4e-a3dff3731105 => generated 1264 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:46:47.190722 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-92f5ef04-0f0e-4d7e-9c2a-03bc1e1375ad tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:46:47.191631 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-92f5ef04-0f0e-4d7e-9c2a-03bc1e1375ad tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] [instance: 2ed39450-289e-4d51-b1b0-c5fe323e6201] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:46:47.199487 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-92f5ef04-0f0e-4d7e-9c2a-03bc1e1375ad tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:47.201026 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-92f5ef04-0f0e-4d7e-9c2a-03bc1e1375ad tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:47.201870 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-92f5ef04-0f0e-4d7e-9c2a-03bc1e1375ad tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:47.202311 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-92f5ef04-0f0e-4d7e-9c2a-03bc1e1375ad tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:47.205738 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-e3d65176-e66e-419b-9a56-b718dd2e870b tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dba436d0a67433f8c8ae7cd40d3f795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46b8dc64007429b805971d4c6f5b471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:46:47.214247 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-e3d65176-e66e-419b-9a56-b718dd2e870b tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] 10.222.0.66 "GET /compute/v2.1/servers/221108c9-a4b6-4e41-a9e5-a4e1461c991d" status: 200 len: 1364 microversion: 2.1 time: 0.364062 Aug 04 03:46:47.214962 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 403/805] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:46:46 2022] GET /compute/v2.1/servers/221108c9-a4b6-4e41-a9e5-a4e1461c991d => generated 1364 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:46:47.302191 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-89c5f163-a922-4a12-8da6-d7c0269908b9 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-57974030"}} {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 03:46:47.303096 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-89c5f163-a922-4a12-8da6-d7c0269908b9 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] [instance: bd510bcc-33c6-4299-8a14-018dce8ee011] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:46:47.319533 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-89c5f163-a922-4a12-8da6-d7c0269908b9 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:47.320145 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-89c5f163-a922-4a12-8da6-d7c0269908b9 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:47.321059 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-89c5f163-a922-4a12-8da6-d7c0269908b9 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:47.321590 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-89c5f163-a922-4a12-8da6-d7c0269908b9 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:47.379272 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-92f5ef04-0f0e-4d7e-9c2a-03bc1e1375ad tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac99f60384fe4a119d019cedfe1d3557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f18ee8c7d4cfe9f4b879505ca6605', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:46:47.394025 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-92f5ef04-0f0e-4d7e-9c2a-03bc1e1375ad tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] 10.222.0.66 "GET /compute/v2.1/servers/2ed39450-289e-4d51-b1b0-c5fe323e6201" status: 200 len: 1367 microversion: 2.1 time: 0.208710 Aug 04 03:46:47.405689 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 403/806] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:46:47 2022] GET /compute/v2.1/servers/2ed39450-289e-4d51-b1b0-c5fe323e6201 => generated 1367 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:46:47.473526 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.network.security_group_api [None req-89c5f163-a922-4a12-8da6-d7c0269908b9 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Removing security group f37aa3b3-db55-4759-8933-608dbe65d3dc from port c6499e78-e527-405f-ab7c-374a6cec81fb Aug 04 03:46:47.557172 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-72bf068d-d5fb-43c7-a1fe-83aa759899f0 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:46:47.558181 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-72bf068d-d5fb-43c7-a1fe-83aa759899f0 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] [instance: 3bf41d49-2b84-4f59-a019-a8b1e45891d1] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:46:47.564627 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-72bf068d-d5fb-43c7-a1fe-83aa759899f0 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:47.565316 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-72bf068d-d5fb-43c7-a1fe-83aa759899f0 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:47.566285 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-72bf068d-d5fb-43c7-a1fe-83aa759899f0 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:47.566877 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-72bf068d-d5fb-43c7-a1fe-83aa759899f0 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:47.599555 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-72bf068d-d5fb-43c7-a1fe-83aa759899f0 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] 10.222.0.66 "GET /compute/v2.1/servers/3bf41d49-2b84-4f59-a019-a8b1e45891d1/os-volume_attachments/328f29a4-6989-4599-bb6d-555e7f797c3c" status: 200 len: 194 microversion: 2.20 time: 0.171180 Aug 04 03:46:47.608286 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 404/807] 10.222.0.66 () {60 vars in 1454 bytes} [Thu Aug 4 03:46:47 2022] GET /compute/v2.1/servers/3bf41d49-2b84-4f59-a019-a8b1e45891d1/os-volume_attachments/328f29a4-6989-4599-bb6d-555e7f797c3c => generated 194 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 04 03:46:47.620933 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [req-974dd61c-9586-4669-ad17-e95fb47efb6e req-05499e7f-689f-4f01-b0d6-601bf9da419a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99218af9-c409-4074-bd4e-a3dff3731105", "tag": "f4c20bb3-4881-4ace-8a51-334ca209dbbd"}]} {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 03:46:47.639090 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [req-974dd61c-9586-4669-ad17-e95fb47efb6e req-05499e7f-689f-4f01-b0d6-601bf9da419a service nova] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:47.639530 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [req-974dd61c-9586-4669-ad17-e95fb47efb6e req-05499e7f-689f-4f01-b0d6-601bf9da419a service nova] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:47.651533 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.compute.server_external_events [req-974dd61c-9586-4669-ad17-e95fb47efb6e req-05499e7f-689f-4f01-b0d6-601bf9da419a service nova] Creating event network-changed:f4c20bb3-4881-4ace-8a51-334ca209dbbd for instance 99218af9-c409-4074-bd4e-a3dff3731105 on hv-cinder-73306 Aug 04 03:46:47.656810 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [req-974dd61c-9586-4669-ad17-e95fb47efb6e req-05499e7f-689f-4f01-b0d6-601bf9da419a service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039450 Aug 04 03:46:47.657375 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 405/808] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 03:46:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 03:46:47.680279 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-281e3b9d-99f2-4c9b-86c7-7bbce25566e7 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:46:47.680861 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-281e3b9d-99f2-4c9b-86c7-7bbce25566e7 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] [instance: 3bf41d49-2b84-4f59-a019-a8b1e45891d1] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:46:47.687141 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-281e3b9d-99f2-4c9b-86c7-7bbce25566e7 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:47.687591 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-281e3b9d-99f2-4c9b-86c7-7bbce25566e7 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:47.688354 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-281e3b9d-99f2-4c9b-86c7-7bbce25566e7 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:47.688788 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-281e3b9d-99f2-4c9b-86c7-7bbce25566e7 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:47.773767 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.objects.instance [None req-281e3b9d-99f2-4c9b-86c7-7bbce25566e7 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lazy-loading 'services' on Instance uuid 3bf41d49-2b84-4f59-a019-a8b1e45891d1 {{(pid=130262) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 03:46:47.887628 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-89c5f163-a922-4a12-8da6-d7c0269908b9 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] 10.222.0.66 "POST /compute/v2.1/servers/bd510bcc-33c6-4299-8a14-018dce8ee011/action" status: 202 len: 0 microversion: 2.1 time: 0.590564 Aug 04 03:46:47.888354 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 404/809] 10.222.0.66 () {60 vars in 1278 bytes} [Thu Aug 4 03:46:47 2022] POST /compute/v2.1/servers/bd510bcc-33c6-4299-8a14-018dce8ee011/action => generated 0 bytes in 592 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 03:46:47.898981 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [req-ea341031-6fde-4177-b0d4-de5bf3d6226b req-9e2e46e1-1749-40c3-afb3-4a01a2a35a69 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd510bcc-33c6-4299-8a14-018dce8ee011", "tag": "c6499e78-e527-405f-ab7c-374a6cec81fb"}]} {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 03:46:47.918044 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [req-ea341031-6fde-4177-b0d4-de5bf3d6226b req-9e2e46e1-1749-40c3-afb3-4a01a2a35a69 service nova] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:47.918776 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [req-ea341031-6fde-4177-b0d4-de5bf3d6226b req-9e2e46e1-1749-40c3-afb3-4a01a2a35a69 service nova] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:47.931448 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.compute.server_external_events [req-ea341031-6fde-4177-b0d4-de5bf3d6226b req-9e2e46e1-1749-40c3-afb3-4a01a2a35a69 service nova] Creating event network-changed:c6499e78-e527-405f-ab7c-374a6cec81fb for instance bd510bcc-33c6-4299-8a14-018dce8ee011 on hv-cinder-73306 Aug 04 03:46:47.938828 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [req-ea341031-6fde-4177-b0d4-de5bf3d6226b req-9e2e46e1-1749-40c3-afb3-4a01a2a35a69 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043467 Aug 04 03:46:47.940791 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 405/810] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 03:46:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 03:46:47.994967 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-281e3b9d-99f2-4c9b-86c7-7bbce25566e7 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] 10.222.0.66 "DELETE /compute/v2.1/servers/3bf41d49-2b84-4f59-a019-a8b1e45891d1/os-volume_attachments/328f29a4-6989-4599-bb6d-555e7f797c3c" status: 202 len: 0 microversion: 2.20 time: 0.318520 Aug 04 03:46:47.996498 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 406/811] 10.222.0.66 () {60 vars in 1457 bytes} [Thu Aug 4 03:46:47 2022] DELETE /compute/v2.1/servers/3bf41d49-2b84-4f59-a019-a8b1e45891d1/os-volume_attachments/328f29a4-6989-4599-bb6d-555e7f797c3c => generated 0 bytes in 322 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 04 03:46:48.005534 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-10e8f34f-9037-46b6-82a1-f4ebac9ebc80 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:46:48.007761 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-10e8f34f-9037-46b6-82a1-f4ebac9ebc80 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] [instance: 3bf41d49-2b84-4f59-a019-a8b1e45891d1] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:46:48.015605 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-10e8f34f-9037-46b6-82a1-f4ebac9ebc80 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:48.016291 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-10e8f34f-9037-46b6-82a1-f4ebac9ebc80 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:48.017234 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-10e8f34f-9037-46b6-82a1-f4ebac9ebc80 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:48.017822 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-10e8f34f-9037-46b6-82a1-f4ebac9ebc80 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:48.052210 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-10e8f34f-9037-46b6-82a1-f4ebac9ebc80 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] 10.222.0.66 "GET /compute/v2.1/servers/3bf41d49-2b84-4f59-a019-a8b1e45891d1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050895 Aug 04 03:46:48.052927 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 406/812] 10.222.0.66 () {60 vars in 1343 bytes} [Thu Aug 4 03:46:47 2022] GET /compute/v2.1/servers/3bf41d49-2b84-4f59-a019-a8b1e45891d1/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 04 03:46:48.199770 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-a5cc43e5-9210-45f7-9b2c-518fce810b89 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:46:48.200566 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-a5cc43e5-9210-45f7-9b2c-518fce810b89 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] [instance: 99218af9-c409-4074-bd4e-a3dff3731105] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:46:48.206994 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-a5cc43e5-9210-45f7-9b2c-518fce810b89 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:48.207467 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-a5cc43e5-9210-45f7-9b2c-518fce810b89 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:48.208219 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-a5cc43e5-9210-45f7-9b2c-518fce810b89 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:48.208655 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-a5cc43e5-9210-45f7-9b2c-518fce810b89 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:48.236298 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-042b3cbc-88e5-465c-bdde-efbba9eda1f8 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:46:48.236907 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-042b3cbc-88e5-465c-bdde-efbba9eda1f8 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] [instance: 221108c9-a4b6-4e41-a9e5-a4e1461c991d] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:46:48.245772 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-042b3cbc-88e5-465c-bdde-efbba9eda1f8 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:48.246732 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-042b3cbc-88e5-465c-bdde-efbba9eda1f8 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:48.249275 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-042b3cbc-88e5-465c-bdde-efbba9eda1f8 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:48.249918 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-042b3cbc-88e5-465c-bdde-efbba9eda1f8 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:48.422514 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-a5cc43e5-9210-45f7-9b2c-518fce810b89 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac48e585c133487dadbe0a1e095bfde0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32813adc26c64016b99c9c5fd838d391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:46:48.430202 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-a5cc43e5-9210-45f7-9b2c-518fce810b89 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] 10.222.0.66 "GET /compute/v2.1/servers/99218af9-c409-4074-bd4e-a3dff3731105" status: 200 len: 1264 microversion: 2.1 time: 0.234785 Aug 04 03:46:48.447258 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 407/813] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:46:48 2022] GET /compute/v2.1/servers/99218af9-c409-4074-bd4e-a3dff3731105 => generated 1264 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:46:48.449677 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-042b3cbc-88e5-465c-bdde-efbba9eda1f8 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dba436d0a67433f8c8ae7cd40d3f795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46b8dc64007429b805971d4c6f5b471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:46:48.452896 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-8e58009e-aea8-4670-a61d-f29693167b46 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:46:48.453537 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-8e58009e-aea8-4670-a61d-f29693167b46 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] [instance: 2ed39450-289e-4d51-b1b0-c5fe323e6201] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:46:48.461092 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-042b3cbc-88e5-465c-bdde-efbba9eda1f8 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] 10.222.0.66 "GET /compute/v2.1/servers/221108c9-a4b6-4e41-a9e5-a4e1461c991d" status: 200 len: 1364 microversion: 2.1 time: 0.228959 Aug 04 03:46:48.471438 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 407/814] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:46:48 2022] GET /compute/v2.1/servers/221108c9-a4b6-4e41-a9e5-a4e1461c991d => generated 1364 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 03:46:48.471610 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-8e58009e-aea8-4670-a61d-f29693167b46 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:48.471610 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-8e58009e-aea8-4670-a61d-f29693167b46 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:48.471610 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-8e58009e-aea8-4670-a61d-f29693167b46 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:48.471610 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-8e58009e-aea8-4670-a61d-f29693167b46 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:48.605499 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-8e58009e-aea8-4670-a61d-f29693167b46 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac99f60384fe4a119d019cedfe1d3557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f18ee8c7d4cfe9f4b879505ca6605', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:46:48.613331 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-8e58009e-aea8-4670-a61d-f29693167b46 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] 10.222.0.66 "GET /compute/v2.1/servers/2ed39450-289e-4d51-b1b0-c5fe323e6201" status: 200 len: 1367 microversion: 2.1 time: 0.164198 Aug 04 03:46:48.613894 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 408/815] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:46:48 2022] GET /compute/v2.1/servers/2ed39450-289e-4d51-b1b0-c5fe323e6201 => generated 1367 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:46:49.065530 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-a75d0989-23d7-42d0-baaa-895e7bf72c0e tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:46:49.067772 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-a75d0989-23d7-42d0-baaa-895e7bf72c0e tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] [instance: 3bf41d49-2b84-4f59-a019-a8b1e45891d1] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:46:49.075148 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-a75d0989-23d7-42d0-baaa-895e7bf72c0e tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:49.075601 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-a75d0989-23d7-42d0-baaa-895e7bf72c0e tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:49.076375 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-a75d0989-23d7-42d0-baaa-895e7bf72c0e tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:49.076813 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-a75d0989-23d7-42d0-baaa-895e7bf72c0e tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:49.109730 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-a75d0989-23d7-42d0-baaa-895e7bf72c0e tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] 10.222.0.66 "GET /compute/v2.1/servers/3bf41d49-2b84-4f59-a019-a8b1e45891d1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048001 Aug 04 03:46:49.110619 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 408/816] 10.222.0.66 () {60 vars in 1343 bytes} [Thu Aug 4 03:46:49 2022] GET /compute/v2.1/servers/3bf41d49-2b84-4f59-a019-a8b1e45891d1/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 03:46:49.124539 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-e0a37e89-66f6-4f37-8440-67a97d922f24 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:46:49.136349 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-e0a37e89-66f6-4f37-8440-67a97d922f24 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] [instance: bd510bcc-33c6-4299-8a14-018dce8ee011] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:46:49.136349 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-e0a37e89-66f6-4f37-8440-67a97d922f24 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:49.136349 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-e0a37e89-66f6-4f37-8440-67a97d922f24 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:49.136349 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-e0a37e89-66f6-4f37-8440-67a97d922f24 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:49.136720 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-e0a37e89-66f6-4f37-8440-67a97d922f24 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:49.214997 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.objects.instance [None req-e0a37e89-66f6-4f37-8440-67a97d922f24 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lazy-loading 'services' on Instance uuid bd510bcc-33c6-4299-8a14-018dce8ee011 {{(pid=130262) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 03:46:49.218505 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG dbcounter [-] [130262] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=130262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:46:49.401426 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-e0a37e89-66f6-4f37-8440-67a97d922f24 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] 10.222.0.66 "DELETE /compute/v2.1/servers/bd510bcc-33c6-4299-8a14-018dce8ee011/os-volume_attachments/78b2ce5e-d82b-4b06-8d4d-a89912a5fcea" status: 202 len: 0 microversion: 2.1 time: 0.279709 Aug 04 03:46:49.405432 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 409/817] 10.222.0.66 () {58 vars in 1416 bytes} [Thu Aug 4 03:46:49 2022] DELETE /compute/v2.1/servers/bd510bcc-33c6-4299-8a14-018dce8ee011/os-volume_attachments/78b2ce5e-d82b-4b06-8d4d-a89912a5fcea => generated 0 bytes in 283 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 03:46:49.411277 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-8edf4e56-5640-4f40-ae79-4369ae55a7a1 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:46:49.413987 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-8edf4e56-5640-4f40-ae79-4369ae55a7a1 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] [instance: bd510bcc-33c6-4299-8a14-018dce8ee011] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:46:49.421127 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-8edf4e56-5640-4f40-ae79-4369ae55a7a1 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:49.421969 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-8edf4e56-5640-4f40-ae79-4369ae55a7a1 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:49.422842 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-8edf4e56-5640-4f40-ae79-4369ae55a7a1 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:49.423559 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-8edf4e56-5640-4f40-ae79-4369ae55a7a1 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:49.457015 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-8edf4e56-5640-4f40-ae79-4369ae55a7a1 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] 10.222.0.66 "GET /compute/v2.1/servers/bd510bcc-33c6-4299-8a14-018dce8ee011/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049831 Aug 04 03:46:49.462721 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 409/818] 10.222.0.66 () {58 vars in 1302 bytes} [Thu Aug 4 03:46:49 2022] GET /compute/v2.1/servers/bd510bcc-33c6-4299-8a14-018dce8ee011/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 03:46:49.464312 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-be701b65-09a4-4e17-be1b-488e90eeb95e tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:46:49.465028 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-be701b65-09a4-4e17-be1b-488e90eeb95e tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] [instance: 99218af9-c409-4074-bd4e-a3dff3731105] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:46:49.475360 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-be701b65-09a4-4e17-be1b-488e90eeb95e tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:49.476584 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-be701b65-09a4-4e17-be1b-488e90eeb95e tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:49.477721 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-be701b65-09a4-4e17-be1b-488e90eeb95e tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:49.478632 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-be701b65-09a4-4e17-be1b-488e90eeb95e tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:49.491651 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-44e11fac-45d4-4ce6-853d-7a2f5ed478ba tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:46:49.492977 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-44e11fac-45d4-4ce6-853d-7a2f5ed478ba tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] [instance: 221108c9-a4b6-4e41-a9e5-a4e1461c991d] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:46:49.500921 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-44e11fac-45d4-4ce6-853d-7a2f5ed478ba tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:49.501795 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-44e11fac-45d4-4ce6-853d-7a2f5ed478ba tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:49.502853 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-44e11fac-45d4-4ce6-853d-7a2f5ed478ba tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:49.503682 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-44e11fac-45d4-4ce6-853d-7a2f5ed478ba tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:49.957674 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-be701b65-09a4-4e17-be1b-488e90eeb95e tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac48e585c133487dadbe0a1e095bfde0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32813adc26c64016b99c9c5fd838d391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:46:49.967781 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-44e11fac-45d4-4ce6-853d-7a2f5ed478ba tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dba436d0a67433f8c8ae7cd40d3f795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46b8dc64007429b805971d4c6f5b471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:46:49.976721 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-be701b65-09a4-4e17-be1b-488e90eeb95e tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] 10.222.0.66 "GET /compute/v2.1/servers/99218af9-c409-4074-bd4e-a3dff3731105" status: 200 len: 1264 microversion: 2.1 time: 0.526316 Aug 04 03:46:49.978371 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-44e11fac-45d4-4ce6-853d-7a2f5ed478ba tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] 10.222.0.66 "GET /compute/v2.1/servers/221108c9-a4b6-4e41-a9e5-a4e1461c991d" status: 200 len: 1364 microversion: 2.1 time: 0.498910 Aug 04 03:46:49.989230 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 410/819] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:46:49 2022] GET /compute/v2.1/servers/221108c9-a4b6-4e41-a9e5-a4e1461c991d => generated 1364 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 03:46:49.989230 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-4ec96439-72d5-45f4-9d2d-19fa4b1496a4 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:46:49.989230 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-4ec96439-72d5-45f4-9d2d-19fa4b1496a4 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] [instance: 2ed39450-289e-4d51-b1b0-c5fe323e6201] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:46:49.994207 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG dbcounter [-] [130263] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=5 {{(pid=130263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:46:49.994207 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-4ec96439-72d5-45f4-9d2d-19fa4b1496a4 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:49.994207 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-4ec96439-72d5-45f4-9d2d-19fa4b1496a4 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:49.999956 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 410/820] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:46:49 2022] GET /compute/v2.1/servers/99218af9-c409-4074-bd4e-a3dff3731105 => generated 1264 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 03:46:50.000053 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-4ec96439-72d5-45f4-9d2d-19fa4b1496a4 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:50.000053 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-4ec96439-72d5-45f4-9d2d-19fa4b1496a4 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:50.000191 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [req-4b1512b1-1c0e-4bd8-8f0a-7ed52688a049 req-1c5939ed-8533-4d14-9186-2354a9c6f776 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd510bcc-33c6-4299-8a14-018dce8ee011", "tag": "c6499e78-e527-405f-ab7c-374a6cec81fb"}]} {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 03:46:50.011466 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [req-4b1512b1-1c0e-4bd8-8f0a-7ed52688a049 req-1c5939ed-8533-4d14-9186-2354a9c6f776 service nova] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:50.011772 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [req-4b1512b1-1c0e-4bd8-8f0a-7ed52688a049 req-1c5939ed-8533-4d14-9186-2354a9c6f776 service nova] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:50.032271 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.compute.server_external_events [req-4b1512b1-1c0e-4bd8-8f0a-7ed52688a049 req-1c5939ed-8533-4d14-9186-2354a9c6f776 service nova] Creating event network-changed:c6499e78-e527-405f-ab7c-374a6cec81fb for instance bd510bcc-33c6-4299-8a14-018dce8ee011 on hv-cinder-73306 Aug 04 03:46:50.037987 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [req-4b1512b1-1c0e-4bd8-8f0a-7ed52688a049 req-1c5939ed-8533-4d14-9186-2354a9c6f776 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043268 Aug 04 03:46:50.038951 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 411/821] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 03:46:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 03:46:50.124213 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-beac7955-516e-4ddd-88c3-7fb1afa834be tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:46:50.126819 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-beac7955-516e-4ddd-88c3-7fb1afa834be tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] [instance: 3bf41d49-2b84-4f59-a019-a8b1e45891d1] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:46:50.130042 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG dbcounter [-] [130262] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=130262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:46:50.140153 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-beac7955-516e-4ddd-88c3-7fb1afa834be tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:50.140605 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-beac7955-516e-4ddd-88c3-7fb1afa834be tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:50.143149 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-beac7955-516e-4ddd-88c3-7fb1afa834be tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:50.143149 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-beac7955-516e-4ddd-88c3-7fb1afa834be tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:50.195904 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-beac7955-516e-4ddd-88c3-7fb1afa834be tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] 10.222.0.66 "GET /compute/v2.1/servers/3bf41d49-2b84-4f59-a019-a8b1e45891d1/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.076237 Aug 04 03:46:50.201300 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 412/822] 10.222.0.66 () {60 vars in 1343 bytes} [Thu Aug 4 03:46:50 2022] GET /compute/v2.1/servers/3bf41d49-2b84-4f59-a019-a8b1e45891d1/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 04 03:46:50.202256 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-4ec96439-72d5-45f4-9d2d-19fa4b1496a4 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac99f60384fe4a119d019cedfe1d3557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f18ee8c7d4cfe9f4b879505ca6605', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:46:50.214173 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-4ec96439-72d5-45f4-9d2d-19fa4b1496a4 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] 10.222.0.66 "GET /compute/v2.1/servers/2ed39450-289e-4d51-b1b0-c5fe323e6201" status: 200 len: 1367 microversion: 2.1 time: 0.232399 Aug 04 03:46:50.214936 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 411/823] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:46:49 2022] GET /compute/v2.1/servers/2ed39450-289e-4d51-b1b0-c5fe323e6201 => generated 1367 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:46:50.476584 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-db43d4fd-e272-4d75-a5a2-1d37b40de4c0 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:46:50.479268 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-db43d4fd-e272-4d75-a5a2-1d37b40de4c0 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] [instance: bd510bcc-33c6-4299-8a14-018dce8ee011] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:46:50.489409 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-db43d4fd-e272-4d75-a5a2-1d37b40de4c0 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:50.490177 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-db43d4fd-e272-4d75-a5a2-1d37b40de4c0 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:50.491425 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-db43d4fd-e272-4d75-a5a2-1d37b40de4c0 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:50.491961 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-db43d4fd-e272-4d75-a5a2-1d37b40de4c0 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:50.538074 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-db43d4fd-e272-4d75-a5a2-1d37b40de4c0 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] 10.222.0.66 "GET /compute/v2.1/servers/bd510bcc-33c6-4299-8a14-018dce8ee011/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.070924 Aug 04 03:46:50.542934 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 413/824] 10.222.0.66 () {58 vars in 1302 bytes} [Thu Aug 4 03:46:50 2022] GET /compute/v2.1/servers/bd510bcc-33c6-4299-8a14-018dce8ee011/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 03:46:50.783250 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [req-6295e7d9-6eba-4828-a1cd-ee17f25fcc20 req-91a0ceaa-21e0-4b40-93e6-4e9fe1b5f015 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ed39450-289e-4d51-b1b0-c5fe323e6201", "tag": "50488897-66f7-41a7-9f38-95ae861c95b6"}]} {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 03:46:50.792838 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [req-6295e7d9-6eba-4828-a1cd-ee17f25fcc20 req-91a0ceaa-21e0-4b40-93e6-4e9fe1b5f015 service nova] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:50.793237 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [req-6295e7d9-6eba-4828-a1cd-ee17f25fcc20 req-91a0ceaa-21e0-4b40-93e6-4e9fe1b5f015 service nova] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:50.804083 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.compute.server_external_events [req-6295e7d9-6eba-4828-a1cd-ee17f25fcc20 req-91a0ceaa-21e0-4b40-93e6-4e9fe1b5f015 service nova] Creating event network-changed:50488897-66f7-41a7-9f38-95ae861c95b6 for instance 2ed39450-289e-4d51-b1b0-c5fe323e6201 on hv-cinder-73306 Aug 04 03:46:50.809858 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [req-6295e7d9-6eba-4828-a1cd-ee17f25fcc20 req-91a0ceaa-21e0-4b40-93e6-4e9fe1b5f015 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030475 Aug 04 03:46:50.810495 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 412/825] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 03:46:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 03:46:51.001462 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-1cb4eed3-b66e-48f8-9f7f-ef65f0d1bb18 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:46:51.002044 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-eeda57da-de85-4cd1-a718-fb4b6903c5f5 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:46:51.002373 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-1cb4eed3-b66e-48f8-9f7f-ef65f0d1bb18 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] [instance: 99218af9-c409-4074-bd4e-a3dff3731105] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:46:51.002745 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-eeda57da-de85-4cd1-a718-fb4b6903c5f5 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] [instance: 221108c9-a4b6-4e41-a9e5-a4e1461c991d] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:46:51.009627 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-eeda57da-de85-4cd1-a718-fb4b6903c5f5 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:51.010127 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-eeda57da-de85-4cd1-a718-fb4b6903c5f5 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:51.010897 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-eeda57da-de85-4cd1-a718-fb4b6903c5f5 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:51.011335 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-eeda57da-de85-4cd1-a718-fb4b6903c5f5 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:51.013179 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-1cb4eed3-b66e-48f8-9f7f-ef65f0d1bb18 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:51.013912 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-1cb4eed3-b66e-48f8-9f7f-ef65f0d1bb18 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:51.018446 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-1cb4eed3-b66e-48f8-9f7f-ef65f0d1bb18 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:51.020705 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-1cb4eed3-b66e-48f8-9f7f-ef65f0d1bb18 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:51.292839 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG dbcounter [-] [130263] Writing DB stats nova_cell0:SELECT=2 {{(pid=130263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:46:51.373180 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-eeda57da-de85-4cd1-a718-fb4b6903c5f5 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dba436d0a67433f8c8ae7cd40d3f795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46b8dc64007429b805971d4c6f5b471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:46:51.390347 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-eeda57da-de85-4cd1-a718-fb4b6903c5f5 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] 10.222.0.66 "GET /compute/v2.1/servers/221108c9-a4b6-4e41-a9e5-a4e1461c991d" status: 200 len: 1364 microversion: 2.1 time: 0.392262 Aug 04 03:46:51.390966 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 413/826] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:46:50 2022] GET /compute/v2.1/servers/221108c9-a4b6-4e41-a9e5-a4e1461c991d => generated 1364 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 03:46:51.396010 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-ab4336b2-c0af-4dcd-b569-496f7df99661 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:46:51.398452 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-ab4336b2-c0af-4dcd-b569-496f7df99661 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] [instance: 3bf41d49-2b84-4f59-a019-a8b1e45891d1] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:46:51.406424 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-ab4336b2-c0af-4dcd-b569-496f7df99661 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:51.406883 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-ab4336b2-c0af-4dcd-b569-496f7df99661 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:51.407704 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-ab4336b2-c0af-4dcd-b569-496f7df99661 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:51.410441 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-ab4336b2-c0af-4dcd-b569-496f7df99661 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:51.443174 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-ab4336b2-c0af-4dcd-b569-496f7df99661 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] 10.222.0.66 "GET /compute/v2.1/servers/3bf41d49-2b84-4f59-a019-a8b1e45891d1/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.050737 Aug 04 03:46:51.443874 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 414/827] 10.222.0.66 () {60 vars in 1343 bytes} [Thu Aug 4 03:46:51 2022] GET /compute/v2.1/servers/3bf41d49-2b84-4f59-a019-a8b1e45891d1/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:46:51.444524 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-1cb4eed3-b66e-48f8-9f7f-ef65f0d1bb18 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac48e585c133487dadbe0a1e095bfde0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32813adc26c64016b99c9c5fd838d391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:46:51.451274 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-ac5d9ee0-9633-4a80-b5a2-97bef64d2d54 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:46:51.452366 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-ac5d9ee0-9633-4a80-b5a2-97bef64d2d54 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] [instance: 2ed39450-289e-4d51-b1b0-c5fe323e6201] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:46:51.460389 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-ac5d9ee0-9633-4a80-b5a2-97bef64d2d54 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:51.461074 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-ac5d9ee0-9633-4a80-b5a2-97bef64d2d54 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:51.462434 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-ac5d9ee0-9633-4a80-b5a2-97bef64d2d54 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:51.466351 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-ac5d9ee0-9633-4a80-b5a2-97bef64d2d54 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:51.466784 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-1cb4eed3-b66e-48f8-9f7f-ef65f0d1bb18 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] 10.222.0.66 "GET /compute/v2.1/servers/99218af9-c409-4074-bd4e-a3dff3731105" status: 200 len: 1264 microversion: 2.1 time: 0.468625 Aug 04 03:46:51.473524 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 414/828] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:46:50 2022] GET /compute/v2.1/servers/99218af9-c409-4074-bd4e-a3dff3731105 => generated 1264 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:46:51.550590 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-86168961-1df8-4b63-9b06-f905034204da tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:46:51.552756 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-86168961-1df8-4b63-9b06-f905034204da tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] [instance: bd510bcc-33c6-4299-8a14-018dce8ee011] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:46:51.559817 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-86168961-1df8-4b63-9b06-f905034204da tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:51.560481 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-86168961-1df8-4b63-9b06-f905034204da tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:51.561292 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-86168961-1df8-4b63-9b06-f905034204da tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:51.561930 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-86168961-1df8-4b63-9b06-f905034204da tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:51.595181 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-86168961-1df8-4b63-9b06-f905034204da tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] 10.222.0.66 "GET /compute/v2.1/servers/bd510bcc-33c6-4299-8a14-018dce8ee011/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048375 Aug 04 03:46:51.596042 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 415/829] 10.222.0.66 () {58 vars in 1302 bytes} [Thu Aug 4 03:46:51 2022] GET /compute/v2.1/servers/bd510bcc-33c6-4299-8a14-018dce8ee011/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 04 03:46:51.600889 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-22764968-20b2-417e-94fb-38cb4f03e775 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:46:51.601640 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-22764968-20b2-417e-94fb-38cb4f03e775 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] [instance: 3bf41d49-2b84-4f59-a019-a8b1e45891d1] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:46:51.609275 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-22764968-20b2-417e-94fb-38cb4f03e775 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:51.609723 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-22764968-20b2-417e-94fb-38cb4f03e775 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:51.614475 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-22764968-20b2-417e-94fb-38cb4f03e775 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:51.614475 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-22764968-20b2-417e-94fb-38cb4f03e775 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:51.638194 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-22764968-20b2-417e-94fb-38cb4f03e775 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] [instance: 3bf41d49-2b84-4f59-a019-a8b1e45891d1] Going to try to terminate instance {{(pid=130262) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 03:46:51.691055 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-ac5d9ee0-9633-4a80-b5a2-97bef64d2d54 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac99f60384fe4a119d019cedfe1d3557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f18ee8c7d4cfe9f4b879505ca6605', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:46:51.699199 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-ac5d9ee0-9633-4a80-b5a2-97bef64d2d54 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] 10.222.0.66 "GET /compute/v2.1/servers/2ed39450-289e-4d51-b1b0-c5fe323e6201" status: 200 len: 1367 microversion: 2.1 time: 0.253439 Aug 04 03:46:51.699762 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 415/830] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:46:51 2022] GET /compute/v2.1/servers/2ed39450-289e-4d51-b1b0-c5fe323e6201 => generated 1367 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:46:51.704271 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-9ffc5bc8-a8f2-458d-9338-11f988b99462 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:46:51.704766 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-9ffc5bc8-a8f2-458d-9338-11f988b99462 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] [instance: bd510bcc-33c6-4299-8a14-018dce8ee011] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:46:51.710649 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-9ffc5bc8-a8f2-458d-9338-11f988b99462 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:51.711086 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-9ffc5bc8-a8f2-458d-9338-11f988b99462 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:51.711855 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-9ffc5bc8-a8f2-458d-9338-11f988b99462 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:51.712294 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-9ffc5bc8-a8f2-458d-9338-11f988b99462 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:51.788955 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.wsgi [None req-9ffc5bc8-a8f2-458d-9338-11f988b99462 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] HTTP exception thrown: Instance bd510bcc-33c6-4299-8a14-018dce8ee011 is not attached to volume 78b2ce5e-d82b-4b06-8d4d-a89912a5fcea Aug 04 03:46:51.792125 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-9ffc5bc8-a8f2-458d-9338-11f988b99462 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Request method failure captured: Aug 04 03:46:51.792125 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: request: DELETE /compute/v2.1/servers/bd510bcc-33c6-4299-8a14-018dce8ee011/os-volume_attachments/78b2ce5e-d82b-4b06-8d4d-a89912a5fcea HTTP/1.1 Aug 04 03:46:51.792125 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Accept: application/json Aug 04 03:46:51.792125 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Accept-Encoding: identity Aug 04 03:46:51.792125 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Connection: close Aug 04 03:46:51.792125 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Content-Length: 0 Aug 04 03:46:51.792125 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Content-Type: application/json Aug 04 03:46:51.792125 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Host: 10.222.0.66 Aug 04 03:46:51.792125 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Openstack-System-Scope: None Aug 04 03:46:51.792125 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: User-Agent: python-urllib3/1.26.11 Aug 04 03:46:51.792125 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Auth-Token: gAAAAABi60A6hVNq9vUvOJIdBibiRTL80Qo54vqhDpA6gOtxsw7Aj-XZzuMte5_L1sxCaMKGcvSXGcPioMbIJ5GtK6M1spGrh_cMsy01m2vvaeKyJRWL9dR21hum5XQ65yy-a8U0Cn5fJNf79UpD8t8SUAbgWFphTi_WdWUjbAKjPkgMeca4_zA Aug 04 03:46:51.792125 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Domain-Id: None Aug 04 03:46:51.792125 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Domain-Name: None Aug 04 03:46:51.792125 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Identity-Status: Confirmed Aug 04 03:46:51.792125 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Is-Admin-Project: True Aug 04 03:46:51.792125 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Project-Domain-Id: default Aug 04 03:46:51.792125 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Project-Domain-Name: Default Aug 04 03:46:51.792125 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Project-Id: 2049d7705d5c4afe94c22a6f1284327b Aug 04 03:46:51.792125 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Project-Name: tempest-TestMinimumBasicScenario-1797892478 Aug 04 03:46:51.792125 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Role: member,reader Aug 04 03:46:51.792125 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Roles: member,reader Aug 04 03:46:51.793821 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/2049d7705d5c4afe94c22a6f1284327b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/2049d7705d5c4afe94c22a6f1284327b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/2049d7705d5c4afe94c22a6f1284327b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_2049d7705d5c4afe94c22a6f1284327b"}]}] Aug 04 03:46:51.793821 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Tenant: tempest-TestMinimumBasicScenario-1797892478 Aug 04 03:46:51.793821 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Tenant-Id: 2049d7705d5c4afe94c22a6f1284327b Aug 04 03:46:51.793821 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1797892478 Aug 04 03:46:51.793821 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-User: tempest-TestMinimumBasicScenario-1797892478-project Aug 04 03:46:51.793821 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-User-Domain-Id: default Aug 04 03:46:51.793821 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-User-Domain-Name: Default Aug 04 03:46:51.793821 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-User-Id: d245c731eb58483bb635a7e70542b892 Aug 04 03:46:51.793821 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-User-Name: tempest-TestMinimumBasicScenario-1797892478-project Aug 04 03:46:51.793821 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: method: > Aug 04 03:46:51.793821 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: exception: Instance bd510bcc-33c6-4299-8a14-018dce8ee011 is not attached to volume 78b2ce5e-d82b-4b06-8d4d-a89912a5fcea Aug 04 03:46:51.794640 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: action_args: {'server_id': 'bd510bcc-33c6-4299-8a14-018dce8ee011', 'id': '78b2ce5e-d82b-4b06-8d4d-a89912a5fcea'} Aug 04 03:46:51.794640 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 03:46:51.794640 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 03:46:51.794640 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 04 03:46:51.794640 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 04 03:46:51.794640 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 04 03:46:51.794640 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 04 03:46:51.794640 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Aug 04 03:46:51.794640 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 04 03:46:51.794640 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 78b2ce5e-d82b-4b06-8d4d-a89912a5fcea. Aug 04 03:46:51.794640 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Aug 04 03:46:51.794640 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 03:46:51.794640 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Aug 04 03:46:51.794640 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 03:46:51.794640 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 03:46:51.794640 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 03:46:51.794640 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 03:46:51.794640 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 03:46:51.794640 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 03:46:51.795976 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 03:46:51.795976 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 04 03:46:51.795976 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 04 03:46:51.795976 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd510bcc-33c6-4299-8a14-018dce8ee011 is not attached to volume 78b2ce5e-d82b-4b06-8d4d-a89912a5fcea Aug 04 03:46:51.795976 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Aug 04 03:46:51.795976 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 03:46:51.795976 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Aug 04 03:46:51.795976 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 03:46:51.795976 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 03:46:51.795976 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 03:46:51.795976 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 03:46:51.795976 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 03:46:51.795976 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd510bcc-33c6-4299-8a14-018dce8ee011 is not attached to volume 78b2ce5e-d82b-4b06-8d4d-a89912a5fcea Aug 04 03:46:51.795976 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Aug 04 03:46:51.795976 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-9ffc5bc8-a8f2-458d-9338-11f988b99462 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Returning 404 to user: Instance bd510bcc-33c6-4299-8a14-018dce8ee011 is not attached to volume 78b2ce5e-d82b-4b06-8d4d-a89912a5fcea {{(pid=130263) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 03:46:51.797039 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-9ffc5bc8-a8f2-458d-9338-11f988b99462 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] 10.222.0.66 "DELETE /compute/v2.1/servers/bd510bcc-33c6-4299-8a14-018dce8ee011/os-volume_attachments/78b2ce5e-d82b-4b06-8d4d-a89912a5fcea" status: 404 len: 154 microversion: 2.1 time: 0.092848 Aug 04 03:46:51.797039 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 416/831] 10.222.0.66 () {58 vars in 1416 bytes} [Thu Aug 4 03:46:51 2022] DELETE /compute/v2.1/servers/bd510bcc-33c6-4299-8a14-018dce8ee011/os-volume_attachments/78b2ce5e-d82b-4b06-8d4d-a89912a5fcea => generated 154 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 03:46:51.959276 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-22764968-20b2-417e-94fb-38cb4f03e775 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] 10.222.0.66 "DELETE /compute/v2.1/servers/3bf41d49-2b84-4f59-a019-a8b1e45891d1" status: 204 len: 0 microversion: 2.20 time: 0.361815 Aug 04 03:46:51.959892 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 416/832] 10.222.0.66 () {60 vars in 1280 bytes} [Thu Aug 4 03:46:51 2022] DELETE /compute/v2.1/servers/3bf41d49-2b84-4f59-a019-a8b1e45891d1 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 04 03:46:51.968519 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-b425ac7a-0163-4ff5-9fd1-382569c2bd45 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:46:51.969164 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-b425ac7a-0163-4ff5-9fd1-382569c2bd45 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] [instance: 3bf41d49-2b84-4f59-a019-a8b1e45891d1] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:46:51.975377 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-b425ac7a-0163-4ff5-9fd1-382569c2bd45 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:51.975819 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-b425ac7a-0163-4ff5-9fd1-382569c2bd45 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:51.976571 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-b425ac7a-0163-4ff5-9fd1-382569c2bd45 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:51.976998 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-b425ac7a-0163-4ff5-9fd1-382569c2bd45 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:52.120953 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-b425ac7a-0163-4ff5-9fd1-382569c2bd45 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:46:52.129481 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-b425ac7a-0163-4ff5-9fd1-382569c2bd45 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:46:52.130973 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-b425ac7a-0163-4ff5-9fd1-382569c2bd45 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:46:52.140165 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-b425ac7a-0163-4ff5-9fd1-382569c2bd45 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] 10.222.0.66 "GET /compute/v2.1/servers/3bf41d49-2b84-4f59-a019-a8b1e45891d1" status: 200 len: 1723 microversion: 2.20 time: 0.167892 Aug 04 03:46:52.140165 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 417/833] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 03:46:51 2022] GET /compute/v2.1/servers/3bf41d49-2b84-4f59-a019-a8b1e45891d1 => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 03:46:52.414021 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-36b5924f-628f-46de-996e-4f09d2321075 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:46:52.414735 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-36b5924f-628f-46de-996e-4f09d2321075 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] [instance: 221108c9-a4b6-4e41-a9e5-a4e1461c991d] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:46:52.421796 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-36b5924f-628f-46de-996e-4f09d2321075 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:52.426065 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-36b5924f-628f-46de-996e-4f09d2321075 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:52.426065 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-36b5924f-628f-46de-996e-4f09d2321075 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:52.426065 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-36b5924f-628f-46de-996e-4f09d2321075 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:52.503538 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-8a8e1182-b47e-4733-9b76-5bf572a5085d tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:46:52.505785 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-8a8e1182-b47e-4733-9b76-5bf572a5085d tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] [instance: 99218af9-c409-4074-bd4e-a3dff3731105] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:46:52.514860 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-8a8e1182-b47e-4733-9b76-5bf572a5085d tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:52.515476 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-8a8e1182-b47e-4733-9b76-5bf572a5085d tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:52.516432 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-8a8e1182-b47e-4733-9b76-5bf572a5085d tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:52.516900 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-8a8e1182-b47e-4733-9b76-5bf572a5085d tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:52.540700 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG dbcounter [-] [130263] Writing DB stats nova_cell1:SELECT=100 {{(pid=130263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:46:52.714038 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-36b5924f-628f-46de-996e-4f09d2321075 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dba436d0a67433f8c8ae7cd40d3f795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46b8dc64007429b805971d4c6f5b471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:46:52.729942 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-36b5924f-628f-46de-996e-4f09d2321075 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] 10.222.0.66 "GET /compute/v2.1/servers/221108c9-a4b6-4e41-a9e5-a4e1461c991d" status: 200 len: 1364 microversion: 2.1 time: 0.315367 Aug 04 03:46:52.740309 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 417/834] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:46:52 2022] GET /compute/v2.1/servers/221108c9-a4b6-4e41-a9e5-a4e1461c991d => generated 1364 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:46:52.745592 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-bf1c29b5-1f36-4fdd-81e8-2cc3dfdebb39 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:46:52.746205 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-bf1c29b5-1f36-4fdd-81e8-2cc3dfdebb39 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] [instance: 2ed39450-289e-4d51-b1b0-c5fe323e6201] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:46:52.747927 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-8a8e1182-b47e-4733-9b76-5bf572a5085d tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac48e585c133487dadbe0a1e095bfde0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32813adc26c64016b99c9c5fd838d391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:46:52.754090 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-bf1c29b5-1f36-4fdd-81e8-2cc3dfdebb39 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:52.754544 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-bf1c29b5-1f36-4fdd-81e8-2cc3dfdebb39 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:52.761389 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-bf1c29b5-1f36-4fdd-81e8-2cc3dfdebb39 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:52.761389 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-bf1c29b5-1f36-4fdd-81e8-2cc3dfdebb39 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:52.761606 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-8a8e1182-b47e-4733-9b76-5bf572a5085d tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] 10.222.0.66 "GET /compute/v2.1/servers/99218af9-c409-4074-bd4e-a3dff3731105" status: 200 len: 1264 microversion: 2.1 time: 0.257896 Aug 04 03:46:52.761606 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 418/835] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:46:52 2022] GET /compute/v2.1/servers/99218af9-c409-4074-bd4e-a3dff3731105 => generated 1264 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:46:52.763762 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [req-3d514bf2-de88-437b-a966-1dc38ba937d6 req-55653d8f-87e9-4383-8db5-b11c57feb23e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "221108c9-a4b6-4e41-a9e5-a4e1461c991d", "name": "network-vif-plugged", "status": "completed", "tag": "fbd5776e-e5bb-4524-bca5-b312018f5f7d"}]} {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 03:46:52.775671 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [req-3d514bf2-de88-437b-a966-1dc38ba937d6 req-55653d8f-87e9-4383-8db5-b11c57feb23e service nova] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:52.776277 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [req-3d514bf2-de88-437b-a966-1dc38ba937d6 req-55653d8f-87e9-4383-8db5-b11c57feb23e service nova] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:52.791646 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.compute.server_external_events [req-3d514bf2-de88-437b-a966-1dc38ba937d6 req-55653d8f-87e9-4383-8db5-b11c57feb23e service nova] Creating event network-vif-plugged:fbd5776e-e5bb-4524-bca5-b312018f5f7d for instance 221108c9-a4b6-4e41-a9e5-a4e1461c991d on hv-cinder-73306 Aug 04 03:46:52.797487 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [req-3d514bf2-de88-437b-a966-1dc38ba937d6 req-55653d8f-87e9-4383-8db5-b11c57feb23e service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038650 Aug 04 03:46:52.801632 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 419/836] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 03:46:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 03:46:52.899115 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-bf1c29b5-1f36-4fdd-81e8-2cc3dfdebb39 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac99f60384fe4a119d019cedfe1d3557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f18ee8c7d4cfe9f4b879505ca6605', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:46:52.907669 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-bf1c29b5-1f36-4fdd-81e8-2cc3dfdebb39 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] 10.222.0.66 "GET /compute/v2.1/servers/2ed39450-289e-4d51-b1b0-c5fe323e6201" status: 200 len: 1367 microversion: 2.1 time: 0.166057 Aug 04 03:46:52.908229 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 418/837] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:46:52 2022] GET /compute/v2.1/servers/2ed39450-289e-4d51-b1b0-c5fe323e6201 => generated 1367 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:46:53.082633 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-75c11699-5cf3-40f8-9fab-75f575a5e37c tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:46:53.082633 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-75c11699-5cf3-40f8-9fab-75f575a5e37c tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] [instance: bd510bcc-33c6-4299-8a14-018dce8ee011] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:46:53.086886 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-75c11699-5cf3-40f8-9fab-75f575a5e37c tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:53.087331 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-75c11699-5cf3-40f8-9fab-75f575a5e37c tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:53.088078 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-75c11699-5cf3-40f8-9fab-75f575a5e37c tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:53.088511 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-75c11699-5cf3-40f8-9fab-75f575a5e37c tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:53.112935 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-75c11699-5cf3-40f8-9fab-75f575a5e37c tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] [instance: bd510bcc-33c6-4299-8a14-018dce8ee011] Going to try to terminate instance {{(pid=130263) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 03:46:53.155903 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-b7404532-55a6-42cc-8110-ab23172487f8 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:46:53.156540 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-b7404532-55a6-42cc-8110-ab23172487f8 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] [instance: 3bf41d49-2b84-4f59-a019-a8b1e45891d1] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:46:53.162560 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-b7404532-55a6-42cc-8110-ab23172487f8 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:53.163051 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-b7404532-55a6-42cc-8110-ab23172487f8 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:53.163814 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-b7404532-55a6-42cc-8110-ab23172487f8 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:53.164244 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-b7404532-55a6-42cc-8110-ab23172487f8 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:53.180059 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG dbcounter [-] [130262] Writing DB stats nova_cell0:SELECT=4 {{(pid=130262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:46:53.295124 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-b7404532-55a6-42cc-8110-ab23172487f8 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:46:53.303139 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-b7404532-55a6-42cc-8110-ab23172487f8 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:46:53.304569 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-b7404532-55a6-42cc-8110-ab23172487f8 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:46:53.305770 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-b7404532-55a6-42cc-8110-ab23172487f8 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] 10.222.0.66 "GET /compute/v2.1/servers/3bf41d49-2b84-4f59-a019-a8b1e45891d1" status: 200 len: 1723 microversion: 2.20 time: 0.154522 Aug 04 03:46:53.306323 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 419/838] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 03:46:53 2022] GET /compute/v2.1/servers/3bf41d49-2b84-4f59-a019-a8b1e45891d1 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 03:46:53.383093 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-75c11699-5cf3-40f8-9fab-75f575a5e37c tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] 10.222.0.66 "DELETE /compute/v2.1/servers/bd510bcc-33c6-4299-8a14-018dce8ee011" status: 204 len: 0 microversion: 2.1 time: 0.308352 Aug 04 03:46:53.383704 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 420/839] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 03:46:53 2022] DELETE /compute/v2.1/servers/bd510bcc-33c6-4299-8a14-018dce8ee011 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 03:46:53.398533 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-9a724424-f56e-4a10-a271-1c380fc5df18 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:46:53.399147 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-9a724424-f56e-4a10-a271-1c380fc5df18 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] [instance: bd510bcc-33c6-4299-8a14-018dce8ee011] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:46:53.406176 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-9a724424-f56e-4a10-a271-1c380fc5df18 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:53.406623 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-9a724424-f56e-4a10-a271-1c380fc5df18 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:53.407420 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-9a724424-f56e-4a10-a271-1c380fc5df18 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:53.407869 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-9a724424-f56e-4a10-a271-1c380fc5df18 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:53.548930 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-9a724424-f56e-4a10-a271-1c380fc5df18 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd245c731eb58483bb635a7e70542b892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2049d7705d5c4afe94c22a6f1284327b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:46:53.639582 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-9a724424-f56e-4a10-a271-1c380fc5df18 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] 10.222.0.66 "GET /compute/v2.1/servers/bd510bcc-33c6-4299-8a14-018dce8ee011" status: 200 len: 1553 microversion: 2.1 time: 0.162203 Aug 04 03:46:53.639582 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 420/840] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:46:53 2022] GET /compute/v2.1/servers/bd510bcc-33c6-4299-8a14-018dce8ee011 => generated 1553 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:46:53.747659 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-214be523-e7a9-4f19-8d27-8516b1b352ba tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:46:53.748387 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-214be523-e7a9-4f19-8d27-8516b1b352ba tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] [instance: 221108c9-a4b6-4e41-a9e5-a4e1461c991d] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:46:53.751449 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG dbcounter [-] [130263] Writing DB stats nova_cell0:SELECT=16 {{(pid=130263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:46:53.757709 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-214be523-e7a9-4f19-8d27-8516b1b352ba tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:53.773897 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-214be523-e7a9-4f19-8d27-8516b1b352ba tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:53.773897 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-214be523-e7a9-4f19-8d27-8516b1b352ba tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:53.773897 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-214be523-e7a9-4f19-8d27-8516b1b352ba tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:53.841740 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-d8bfaf96-f6c7-46e2-99ad-442f7fab1b45 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:46:53.844003 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-d8bfaf96-f6c7-46e2-99ad-442f7fab1b45 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] [instance: 99218af9-c409-4074-bd4e-a3dff3731105] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:46:53.850366 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-d8bfaf96-f6c7-46e2-99ad-442f7fab1b45 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:53.853478 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-d8bfaf96-f6c7-46e2-99ad-442f7fab1b45 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:53.853478 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-d8bfaf96-f6c7-46e2-99ad-442f7fab1b45 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:53.853478 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-d8bfaf96-f6c7-46e2-99ad-442f7fab1b45 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:54.008428 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-214be523-e7a9-4f19-8d27-8516b1b352ba tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dba436d0a67433f8c8ae7cd40d3f795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46b8dc64007429b805971d4c6f5b471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:46:54.017076 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-214be523-e7a9-4f19-8d27-8516b1b352ba tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] 10.222.0.66 "GET /compute/v2.1/servers/221108c9-a4b6-4e41-a9e5-a4e1461c991d" status: 200 len: 1364 microversion: 2.1 time: 0.273856 Aug 04 03:46:54.017901 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 421/841] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:46:53 2022] GET /compute/v2.1/servers/221108c9-a4b6-4e41-a9e5-a4e1461c991d => generated 1364 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:46:54.022987 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-e7598b84-6258-4dab-83c6-1843f4327c55 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:46:54.023592 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-e7598b84-6258-4dab-83c6-1843f4327c55 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] [instance: 2ed39450-289e-4d51-b1b0-c5fe323e6201] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:46:54.034652 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-e7598b84-6258-4dab-83c6-1843f4327c55 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:54.035610 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-e7598b84-6258-4dab-83c6-1843f4327c55 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:54.035972 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-e7598b84-6258-4dab-83c6-1843f4327c55 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:54.036410 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-e7598b84-6258-4dab-83c6-1843f4327c55 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:54.046483 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-d8bfaf96-f6c7-46e2-99ad-442f7fab1b45 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac48e585c133487dadbe0a1e095bfde0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32813adc26c64016b99c9c5fd838d391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:46:54.054320 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-d8bfaf96-f6c7-46e2-99ad-442f7fab1b45 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] 10.222.0.66 "GET /compute/v2.1/servers/99218af9-c409-4074-bd4e-a3dff3731105" status: 200 len: 1264 microversion: 2.1 time: 0.216517 Aug 04 03:46:54.054998 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 421/842] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:46:53 2022] GET /compute/v2.1/servers/99218af9-c409-4074-bd4e-a3dff3731105 => generated 1264 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 03:46:54.171113 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-e7598b84-6258-4dab-83c6-1843f4327c55 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac99f60384fe4a119d019cedfe1d3557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f18ee8c7d4cfe9f4b879505ca6605', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:46:54.178780 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-e7598b84-6258-4dab-83c6-1843f4327c55 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] 10.222.0.66 "GET /compute/v2.1/servers/2ed39450-289e-4d51-b1b0-c5fe323e6201" status: 200 len: 1367 microversion: 2.1 time: 0.159513 Aug 04 03:46:54.179330 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 422/843] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:46:54 2022] GET /compute/v2.1/servers/2ed39450-289e-4d51-b1b0-c5fe323e6201 => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:46:54.328553 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-bc4534d8-dcd7-4623-9ea5-4f45e37f2d8a tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:46:54.329294 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-bc4534d8-dcd7-4623-9ea5-4f45e37f2d8a tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] [instance: 3bf41d49-2b84-4f59-a019-a8b1e45891d1] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:46:54.335332 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-bc4534d8-dcd7-4623-9ea5-4f45e37f2d8a tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:54.335782 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-bc4534d8-dcd7-4623-9ea5-4f45e37f2d8a tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:54.336567 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-bc4534d8-dcd7-4623-9ea5-4f45e37f2d8a tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:54.337003 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-bc4534d8-dcd7-4623-9ea5-4f45e37f2d8a tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:54.468205 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-bc4534d8-dcd7-4623-9ea5-4f45e37f2d8a tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:46:54.476024 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-bc4534d8-dcd7-4623-9ea5-4f45e37f2d8a tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:46:54.477541 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-bc4534d8-dcd7-4623-9ea5-4f45e37f2d8a tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:46:54.483921 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-bc4534d8-dcd7-4623-9ea5-4f45e37f2d8a tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] 10.222.0.66 "GET /compute/v2.1/servers/3bf41d49-2b84-4f59-a019-a8b1e45891d1" status: 200 len: 1723 microversion: 2.20 time: 0.154256 Aug 04 03:46:54.483921 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 422/844] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 03:46:54 2022] GET /compute/v2.1/servers/3bf41d49-2b84-4f59-a019-a8b1e45891d1 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 03:46:54.577937 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-7aaa2d7a-f6d7-4c9a-8a8e-0d0d87d3d1e6 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:46:54.578565 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-7aaa2d7a-f6d7-4c9a-8a8e-0d0d87d3d1e6 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] [instance: bd510bcc-33c6-4299-8a14-018dce8ee011] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:46:54.584607 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-7aaa2d7a-f6d7-4c9a-8a8e-0d0d87d3d1e6 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:54.585054 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-7aaa2d7a-f6d7-4c9a-8a8e-0d0d87d3d1e6 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:54.585890 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-7aaa2d7a-f6d7-4c9a-8a8e-0d0d87d3d1e6 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:54.586319 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-7aaa2d7a-f6d7-4c9a-8a8e-0d0d87d3d1e6 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:54.719204 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-7aaa2d7a-f6d7-4c9a-8a8e-0d0d87d3d1e6 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd245c731eb58483bb635a7e70542b892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2049d7705d5c4afe94c22a6f1284327b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:46:54.726714 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-7aaa2d7a-f6d7-4c9a-8a8e-0d0d87d3d1e6 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] 10.222.0.66 "GET /compute/v2.1/servers/bd510bcc-33c6-4299-8a14-018dce8ee011" status: 200 len: 1553 microversion: 2.1 time: 0.153368 Aug 04 03:46:54.727273 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 423/845] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:46:54 2022] GET /compute/v2.1/servers/bd510bcc-33c6-4299-8a14-018dce8ee011 => generated 1553 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:46:55.038755 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-74dd7985-4a88-4089-a5eb-b8a210333484 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:46:55.039288 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-74dd7985-4a88-4089-a5eb-b8a210333484 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] [instance: 221108c9-a4b6-4e41-a9e5-a4e1461c991d] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:46:55.041131 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG dbcounter [-] [130262] Writing DB stats nova_cell0:SELECT=18 {{(pid=130262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:46:55.046646 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-74dd7985-4a88-4089-a5eb-b8a210333484 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:55.047096 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-74dd7985-4a88-4089-a5eb-b8a210333484 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:55.047865 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-74dd7985-4a88-4089-a5eb-b8a210333484 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:55.048311 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-74dd7985-4a88-4089-a5eb-b8a210333484 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:55.075220 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-affd85df-4bb3-4302-9dfd-2e9b6fe1d5ed tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:46:55.075920 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-affd85df-4bb3-4302-9dfd-2e9b6fe1d5ed tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] [instance: 99218af9-c409-4074-bd4e-a3dff3731105] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:46:55.083513 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-affd85df-4bb3-4302-9dfd-2e9b6fe1d5ed tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:55.083961 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-affd85df-4bb3-4302-9dfd-2e9b6fe1d5ed tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:55.084722 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-affd85df-4bb3-4302-9dfd-2e9b6fe1d5ed tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:55.085154 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-affd85df-4bb3-4302-9dfd-2e9b6fe1d5ed tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:55.228835 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-74dd7985-4a88-4089-a5eb-b8a210333484 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dba436d0a67433f8c8ae7cd40d3f795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46b8dc64007429b805971d4c6f5b471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:46:55.237049 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-74dd7985-4a88-4089-a5eb-b8a210333484 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] 10.222.0.66 "GET /compute/v2.1/servers/221108c9-a4b6-4e41-a9e5-a4e1461c991d" status: 200 len: 1364 microversion: 2.1 time: 0.202242 Aug 04 03:46:55.237666 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 423/846] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:46:55 2022] GET /compute/v2.1/servers/221108c9-a4b6-4e41-a9e5-a4e1461c991d => generated 1364 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:46:55.250111 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-ed419fe6-7598-4f80-974f-291b1c1a6821 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:46:55.250111 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-ed419fe6-7598-4f80-974f-291b1c1a6821 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] [instance: 2ed39450-289e-4d51-b1b0-c5fe323e6201] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:46:55.250111 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-ed419fe6-7598-4f80-974f-291b1c1a6821 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:55.250111 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-ed419fe6-7598-4f80-974f-291b1c1a6821 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:55.250540 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-ed419fe6-7598-4f80-974f-291b1c1a6821 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:55.250739 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-ed419fe6-7598-4f80-974f-291b1c1a6821 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:55.261943 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-affd85df-4bb3-4302-9dfd-2e9b6fe1d5ed tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac48e585c133487dadbe0a1e095bfde0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32813adc26c64016b99c9c5fd838d391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:46:55.270147 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-affd85df-4bb3-4302-9dfd-2e9b6fe1d5ed tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] 10.222.0.66 "GET /compute/v2.1/servers/99218af9-c409-4074-bd4e-a3dff3731105" status: 200 len: 1264 microversion: 2.1 time: 0.198801 Aug 04 03:46:55.270803 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 424/847] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:46:55 2022] GET /compute/v2.1/servers/99218af9-c409-4074-bd4e-a3dff3731105 => generated 1264 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 03:46:55.386182 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-ed419fe6-7598-4f80-974f-291b1c1a6821 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac99f60384fe4a119d019cedfe1d3557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f18ee8c7d4cfe9f4b879505ca6605', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:46:55.395556 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-ed419fe6-7598-4f80-974f-291b1c1a6821 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] 10.222.0.66 "GET /compute/v2.1/servers/2ed39450-289e-4d51-b1b0-c5fe323e6201" status: 200 len: 1367 microversion: 2.1 time: 0.156865 Aug 04 03:46:55.415900 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 424/848] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:46:55 2022] GET /compute/v2.1/servers/2ed39450-289e-4d51-b1b0-c5fe323e6201 => generated 1367 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:46:55.504071 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-b4844cd4-f5ee-4df2-9778-5de41b57b84e tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:46:55.504679 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-b4844cd4-f5ee-4df2-9778-5de41b57b84e tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] [instance: 3bf41d49-2b84-4f59-a019-a8b1e45891d1] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:46:55.510892 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-b4844cd4-f5ee-4df2-9778-5de41b57b84e tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:55.511348 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-b4844cd4-f5ee-4df2-9778-5de41b57b84e tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:55.512112 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-b4844cd4-f5ee-4df2-9778-5de41b57b84e tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:55.512551 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-b4844cd4-f5ee-4df2-9778-5de41b57b84e tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:55.686493 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-b4844cd4-f5ee-4df2-9778-5de41b57b84e tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:46:55.694459 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-b4844cd4-f5ee-4df2-9778-5de41b57b84e tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:46:55.695958 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-b4844cd4-f5ee-4df2-9778-5de41b57b84e tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:46:55.697121 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-b4844cd4-f5ee-4df2-9778-5de41b57b84e tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] 10.222.0.66 "GET /compute/v2.1/servers/3bf41d49-2b84-4f59-a019-a8b1e45891d1" status: 200 len: 1723 microversion: 2.20 time: 0.197041 Aug 04 03:46:55.697710 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 425/849] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 03:46:55 2022] GET /compute/v2.1/servers/3bf41d49-2b84-4f59-a019-a8b1e45891d1 => generated 1723 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 03:46:55.747674 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-457ae46a-33bf-47bd-932e-3be57c8396e8 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:46:55.748902 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-457ae46a-33bf-47bd-932e-3be57c8396e8 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] [instance: bd510bcc-33c6-4299-8a14-018dce8ee011] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:46:55.754940 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-457ae46a-33bf-47bd-932e-3be57c8396e8 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:55.755392 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-457ae46a-33bf-47bd-932e-3be57c8396e8 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:55.756162 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-457ae46a-33bf-47bd-932e-3be57c8396e8 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:55.756586 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-457ae46a-33bf-47bd-932e-3be57c8396e8 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:55.760422 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG dbcounter [-] [130262] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=130262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:46:55.886193 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-457ae46a-33bf-47bd-932e-3be57c8396e8 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd245c731eb58483bb635a7e70542b892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2049d7705d5c4afe94c22a6f1284327b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:46:55.893624 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-457ae46a-33bf-47bd-932e-3be57c8396e8 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] 10.222.0.66 "GET /compute/v2.1/servers/bd510bcc-33c6-4299-8a14-018dce8ee011" status: 200 len: 1553 microversion: 2.1 time: 0.149713 Aug 04 03:46:55.894185 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 425/850] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:46:55 2022] GET /compute/v2.1/servers/bd510bcc-33c6-4299-8a14-018dce8ee011 => generated 1553 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:46:56.257634 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-2bbd280b-bed4-4d27-85cd-32864f673e1f tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:46:56.258242 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-2bbd280b-bed4-4d27-85cd-32864f673e1f tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] [instance: 221108c9-a4b6-4e41-a9e5-a4e1461c991d] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:46:56.265617 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-2bbd280b-bed4-4d27-85cd-32864f673e1f tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:56.266069 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-2bbd280b-bed4-4d27-85cd-32864f673e1f tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:56.266831 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-2bbd280b-bed4-4d27-85cd-32864f673e1f tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:56.267265 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-2bbd280b-bed4-4d27-85cd-32864f673e1f tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:56.291840 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-acf50135-3ad7-4c49-b18f-fb76ab38175c tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:46:56.292476 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-acf50135-3ad7-4c49-b18f-fb76ab38175c tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] [instance: 99218af9-c409-4074-bd4e-a3dff3731105] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:46:56.299581 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-acf50135-3ad7-4c49-b18f-fb76ab38175c tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:56.300044 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-acf50135-3ad7-4c49-b18f-fb76ab38175c tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:56.300812 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-acf50135-3ad7-4c49-b18f-fb76ab38175c tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:56.301275 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-acf50135-3ad7-4c49-b18f-fb76ab38175c tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:56.456908 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-2bbd280b-bed4-4d27-85cd-32864f673e1f tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dba436d0a67433f8c8ae7cd40d3f795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46b8dc64007429b805971d4c6f5b471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:46:56.464482 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-2bbd280b-bed4-4d27-85cd-32864f673e1f tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] 10.222.0.66 "GET /compute/v2.1/servers/221108c9-a4b6-4e41-a9e5-a4e1461c991d" status: 200 len: 1364 microversion: 2.1 time: 0.210896 Aug 04 03:46:56.465070 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 426/851] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:46:56 2022] GET /compute/v2.1/servers/221108c9-a4b6-4e41-a9e5-a4e1461c991d => generated 1364 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:46:56.472404 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-9a984e63-bce4-4e72-8ef4-1f967d6affa0 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:46:56.473001 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-9a984e63-bce4-4e72-8ef4-1f967d6affa0 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] [instance: 2ed39450-289e-4d51-b1b0-c5fe323e6201] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:46:56.479003 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-9a984e63-bce4-4e72-8ef4-1f967d6affa0 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:56.479452 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-9a984e63-bce4-4e72-8ef4-1f967d6affa0 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:56.480208 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-9a984e63-bce4-4e72-8ef4-1f967d6affa0 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:56.480639 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-9a984e63-bce4-4e72-8ef4-1f967d6affa0 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:56.488567 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-acf50135-3ad7-4c49-b18f-fb76ab38175c tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac48e585c133487dadbe0a1e095bfde0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32813adc26c64016b99c9c5fd838d391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:46:56.496266 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-acf50135-3ad7-4c49-b18f-fb76ab38175c tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] 10.222.0.66 "GET /compute/v2.1/servers/99218af9-c409-4074-bd4e-a3dff3731105" status: 200 len: 1264 microversion: 2.1 time: 0.208420 Aug 04 03:46:56.496827 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 426/852] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:46:56 2022] GET /compute/v2.1/servers/99218af9-c409-4074-bd4e-a3dff3731105 => generated 1264 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:46:56.611458 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-9a984e63-bce4-4e72-8ef4-1f967d6affa0 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac99f60384fe4a119d019cedfe1d3557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f18ee8c7d4cfe9f4b879505ca6605', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:46:56.618817 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-9a984e63-bce4-4e72-8ef4-1f967d6affa0 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] 10.222.0.66 "GET /compute/v2.1/servers/2ed39450-289e-4d51-b1b0-c5fe323e6201" status: 200 len: 1367 microversion: 2.1 time: 0.150197 Aug 04 03:46:56.619368 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 427/853] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:46:56 2022] GET /compute/v2.1/servers/2ed39450-289e-4d51-b1b0-c5fe323e6201 => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:46:56.720090 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-c15374d7-be07-44c1-a5e0-57f5ac7a8b6d tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:46:56.720628 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-c15374d7-be07-44c1-a5e0-57f5ac7a8b6d tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] [instance: 3bf41d49-2b84-4f59-a019-a8b1e45891d1] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:46:56.726579 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-c15374d7-be07-44c1-a5e0-57f5ac7a8b6d tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:56.727026 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-c15374d7-be07-44c1-a5e0-57f5ac7a8b6d tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:56.727783 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-c15374d7-be07-44c1-a5e0-57f5ac7a8b6d tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:56.728215 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-c15374d7-be07-44c1-a5e0-57f5ac7a8b6d tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:56.860250 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-c15374d7-be07-44c1-a5e0-57f5ac7a8b6d tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:46:56.868450 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-c15374d7-be07-44c1-a5e0-57f5ac7a8b6d tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:46:56.869996 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-c15374d7-be07-44c1-a5e0-57f5ac7a8b6d tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:46:56.871148 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-c15374d7-be07-44c1-a5e0-57f5ac7a8b6d tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] 10.222.0.66 "GET /compute/v2.1/servers/3bf41d49-2b84-4f59-a019-a8b1e45891d1" status: 200 len: 1723 microversion: 2.20 time: 0.155225 Aug 04 03:46:56.871702 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 427/854] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 03:46:56 2022] GET /compute/v2.1/servers/3bf41d49-2b84-4f59-a019-a8b1e45891d1 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 03:46:56.915055 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-d2ee3b67-edcd-4317-86c2-329116e31e11 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:46:56.915705 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-d2ee3b67-edcd-4317-86c2-329116e31e11 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] [instance: bd510bcc-33c6-4299-8a14-018dce8ee011] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:46:56.922385 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-d2ee3b67-edcd-4317-86c2-329116e31e11 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:56.922842 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-d2ee3b67-edcd-4317-86c2-329116e31e11 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:56.923611 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-d2ee3b67-edcd-4317-86c2-329116e31e11 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:56.924076 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-d2ee3b67-edcd-4317-86c2-329116e31e11 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:57.051884 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-d2ee3b67-edcd-4317-86c2-329116e31e11 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd245c731eb58483bb635a7e70542b892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2049d7705d5c4afe94c22a6f1284327b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:46:57.059414 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-d2ee3b67-edcd-4317-86c2-329116e31e11 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] 10.222.0.66 "GET /compute/v2.1/servers/bd510bcc-33c6-4299-8a14-018dce8ee011" status: 200 len: 1553 microversion: 2.1 time: 0.148227 Aug 04 03:46:57.059977 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 428/855] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:46:56 2022] GET /compute/v2.1/servers/bd510bcc-33c6-4299-8a14-018dce8ee011 => generated 1553 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:46:57.488075 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-d12d6504-9761-4675-98d4-915ef15a4ae6 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:46:57.488685 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-d12d6504-9761-4675-98d4-915ef15a4ae6 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] [instance: 221108c9-a4b6-4e41-a9e5-a4e1461c991d] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:46:57.495199 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-d12d6504-9761-4675-98d4-915ef15a4ae6 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:57.495642 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-d12d6504-9761-4675-98d4-915ef15a4ae6 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:57.496400 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-d12d6504-9761-4675-98d4-915ef15a4ae6 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:57.496836 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-d12d6504-9761-4675-98d4-915ef15a4ae6 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:57.516461 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-4a331249-9a1d-4000-83d3-72ded602f0e9 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:46:57.517074 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-4a331249-9a1d-4000-83d3-72ded602f0e9 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] [instance: 99218af9-c409-4074-bd4e-a3dff3731105] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:46:57.523574 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-4a331249-9a1d-4000-83d3-72ded602f0e9 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:57.524023 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-4a331249-9a1d-4000-83d3-72ded602f0e9 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:57.524784 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-4a331249-9a1d-4000-83d3-72ded602f0e9 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:57.525241 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-4a331249-9a1d-4000-83d3-72ded602f0e9 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:57.697872 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-d12d6504-9761-4675-98d4-915ef15a4ae6 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dba436d0a67433f8c8ae7cd40d3f795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46b8dc64007429b805971d4c6f5b471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:46:57.701699 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-4a331249-9a1d-4000-83d3-72ded602f0e9 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac48e585c133487dadbe0a1e095bfde0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32813adc26c64016b99c9c5fd838d391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:46:57.705399 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-d12d6504-9761-4675-98d4-915ef15a4ae6 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] 10.222.0.66 "GET /compute/v2.1/servers/221108c9-a4b6-4e41-a9e5-a4e1461c991d" status: 200 len: 1364 microversion: 2.1 time: 0.221056 Aug 04 03:46:57.705974 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 428/856] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:46:57 2022] GET /compute/v2.1/servers/221108c9-a4b6-4e41-a9e5-a4e1461c991d => generated 1364 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:46:57.709470 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-4a331249-9a1d-4000-83d3-72ded602f0e9 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] 10.222.0.66 "GET /compute/v2.1/servers/99218af9-c409-4074-bd4e-a3dff3731105" status: 200 len: 1264 microversion: 2.1 time: 0.196837 Aug 04 03:46:57.710027 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 429/857] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:46:57 2022] GET /compute/v2.1/servers/99218af9-c409-4074-bd4e-a3dff3731105 => generated 1264 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 03:46:57.710446 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-ea739f00-fb47-427a-b066-9afca08d8e84 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:46:57.711049 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-ea739f00-fb47-427a-b066-9afca08d8e84 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] [instance: 2ed39450-289e-4d51-b1b0-c5fe323e6201] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:46:57.717904 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-ea739f00-fb47-427a-b066-9afca08d8e84 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:57.718351 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-ea739f00-fb47-427a-b066-9afca08d8e84 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:57.719117 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-ea739f00-fb47-427a-b066-9afca08d8e84 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:57.719552 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-ea739f00-fb47-427a-b066-9afca08d8e84 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:57.849905 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-ea739f00-fb47-427a-b066-9afca08d8e84 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac99f60384fe4a119d019cedfe1d3557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f18ee8c7d4cfe9f4b879505ca6605', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:46:57.857476 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-ea739f00-fb47-427a-b066-9afca08d8e84 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] 10.222.0.66 "GET /compute/v2.1/servers/2ed39450-289e-4d51-b1b0-c5fe323e6201" status: 200 len: 1367 microversion: 2.1 time: 0.150518 Aug 04 03:46:57.859000 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 429/858] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:46:57 2022] GET /compute/v2.1/servers/2ed39450-289e-4d51-b1b0-c5fe323e6201 => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:46:57.895749 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-37763692-f9e2-473b-b9f1-55a2cf98240b tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:46:57.896361 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-37763692-f9e2-473b-b9f1-55a2cf98240b tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] [instance: 3bf41d49-2b84-4f59-a019-a8b1e45891d1] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:46:57.902344 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-37763692-f9e2-473b-b9f1-55a2cf98240b tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:57.902791 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-37763692-f9e2-473b-b9f1-55a2cf98240b tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:57.903557 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-37763692-f9e2-473b-b9f1-55a2cf98240b tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:57.903992 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-37763692-f9e2-473b-b9f1-55a2cf98240b tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:58.080714 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-c38bf6e7-7cc2-4a15-88ee-c03ab7e91ccc tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:46:58.081252 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-c38bf6e7-7cc2-4a15-88ee-c03ab7e91ccc tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] [instance: bd510bcc-33c6-4299-8a14-018dce8ee011] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:46:58.087032 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-c38bf6e7-7cc2-4a15-88ee-c03ab7e91ccc tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:58.087476 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-c38bf6e7-7cc2-4a15-88ee-c03ab7e91ccc tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:58.088238 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-c38bf6e7-7cc2-4a15-88ee-c03ab7e91ccc tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:58.088688 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-c38bf6e7-7cc2-4a15-88ee-c03ab7e91ccc tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:58.133158 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-37763692-f9e2-473b-b9f1-55a2cf98240b tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:46:58.141430 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-37763692-f9e2-473b-b9f1-55a2cf98240b tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:46:58.143015 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-37763692-f9e2-473b-b9f1-55a2cf98240b tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:46:58.144284 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-37763692-f9e2-473b-b9f1-55a2cf98240b tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] 10.222.0.66 "GET /compute/v2.1/servers/3bf41d49-2b84-4f59-a019-a8b1e45891d1" status: 200 len: 1723 microversion: 2.20 time: 0.252926 Aug 04 03:46:58.144848 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 430/859] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 03:46:57 2022] GET /compute/v2.1/servers/3bf41d49-2b84-4f59-a019-a8b1e45891d1 => generated 1723 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 03:46:58.380968 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-c38bf6e7-7cc2-4a15-88ee-c03ab7e91ccc tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd245c731eb58483bb635a7e70542b892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2049d7705d5c4afe94c22a6f1284327b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:46:58.388744 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-c38bf6e7-7cc2-4a15-88ee-c03ab7e91ccc tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] 10.222.0.66 "GET /compute/v2.1/servers/bd510bcc-33c6-4299-8a14-018dce8ee011" status: 200 len: 1553 microversion: 2.1 time: 0.312520 Aug 04 03:46:58.389590 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 430/860] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:46:58 2022] GET /compute/v2.1/servers/bd510bcc-33c6-4299-8a14-018dce8ee011 => generated 1553 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 03:46:58.726965 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-0b0ccbe6-2d06-4512-80e6-e4dd7a51e96c tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:46:58.729558 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-0b0ccbe6-2d06-4512-80e6-e4dd7a51e96c tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] [instance: 221108c9-a4b6-4e41-a9e5-a4e1461c991d] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:46:58.734167 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-6b05637b-710f-4539-baa2-e83a8242bf88 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:46:58.734904 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-6b05637b-710f-4539-baa2-e83a8242bf88 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] [instance: 99218af9-c409-4074-bd4e-a3dff3731105] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:46:58.742363 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-0b0ccbe6-2d06-4512-80e6-e4dd7a51e96c tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:58.742578 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-6b05637b-710f-4539-baa2-e83a8242bf88 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:58.742692 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-0b0ccbe6-2d06-4512-80e6-e4dd7a51e96c tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:58.743488 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-6b05637b-710f-4539-baa2-e83a8242bf88 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:58.743635 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-0b0ccbe6-2d06-4512-80e6-e4dd7a51e96c tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:58.743865 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-0b0ccbe6-2d06-4512-80e6-e4dd7a51e96c tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:58.744272 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-6b05637b-710f-4539-baa2-e83a8242bf88 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:58.744888 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-6b05637b-710f-4539-baa2-e83a8242bf88 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:59.039224 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-6b05637b-710f-4539-baa2-e83a8242bf88 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac48e585c133487dadbe0a1e095bfde0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32813adc26c64016b99c9c5fd838d391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:46:59.050008 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-6b05637b-710f-4539-baa2-e83a8242bf88 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] 10.222.0.66 "GET /compute/v2.1/servers/99218af9-c409-4074-bd4e-a3dff3731105" status: 200 len: 1264 microversion: 2.1 time: 0.322347 Aug 04 03:46:59.063500 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 431/861] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:46:58 2022] GET /compute/v2.1/servers/99218af9-c409-4074-bd4e-a3dff3731105 => generated 1264 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:46:59.069192 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-21c0ceb2-e25c-4f96-bf5a-4b23a9977193 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:46:59.070018 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-21c0ceb2-e25c-4f96-bf5a-4b23a9977193 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] [instance: 2ed39450-289e-4d51-b1b0-c5fe323e6201] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:46:59.076425 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-21c0ceb2-e25c-4f96-bf5a-4b23a9977193 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:59.076941 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-21c0ceb2-e25c-4f96-bf5a-4b23a9977193 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:59.078128 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-21c0ceb2-e25c-4f96-bf5a-4b23a9977193 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:59.078734 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-21c0ceb2-e25c-4f96-bf5a-4b23a9977193 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:59.093994 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-0b0ccbe6-2d06-4512-80e6-e4dd7a51e96c tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dba436d0a67433f8c8ae7cd40d3f795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46b8dc64007429b805971d4c6f5b471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:46:59.114089 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-0b0ccbe6-2d06-4512-80e6-e4dd7a51e96c tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] 10.222.0.66 "GET /compute/v2.1/servers/221108c9-a4b6-4e41-a9e5-a4e1461c991d" status: 200 len: 1364 microversion: 2.1 time: 0.391213 Aug 04 03:46:59.115326 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 431/862] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:46:58 2022] GET /compute/v2.1/servers/221108c9-a4b6-4e41-a9e5-a4e1461c991d => generated 1364 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:46:59.172696 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-1b49306c-950e-4d29-878f-960f4db2aa37 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:46:59.172696 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-1b49306c-950e-4d29-878f-960f4db2aa37 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] [instance: 3bf41d49-2b84-4f59-a019-a8b1e45891d1] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:46:59.183906 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-1b49306c-950e-4d29-878f-960f4db2aa37 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:59.184362 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-1b49306c-950e-4d29-878f-960f4db2aa37 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:59.186794 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-1b49306c-950e-4d29-878f-960f4db2aa37 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:59.187881 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-1b49306c-950e-4d29-878f-960f4db2aa37 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:59.345239 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-1b49306c-950e-4d29-878f-960f4db2aa37 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:46:59.360401 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-1b49306c-950e-4d29-878f-960f4db2aa37 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:46:59.362043 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-1b49306c-950e-4d29-878f-960f4db2aa37 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:46:59.364701 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-1b49306c-950e-4d29-878f-960f4db2aa37 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] 10.222.0.66 "GET /compute/v2.1/servers/3bf41d49-2b84-4f59-a019-a8b1e45891d1" status: 200 len: 1655 microversion: 2.20 time: 0.199095 Aug 04 03:46:59.366067 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 432/863] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 03:46:59 2022] GET /compute/v2.1/servers/3bf41d49-2b84-4f59-a019-a8b1e45891d1 => generated 1655 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 03:46:59.411900 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-7dff35e6-1b01-4eab-99af-ac66abe7da06 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:46:59.413117 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-7dff35e6-1b01-4eab-99af-ac66abe7da06 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] [instance: bd510bcc-33c6-4299-8a14-018dce8ee011] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:46:59.428554 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-7dff35e6-1b01-4eab-99af-ac66abe7da06 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:59.430302 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-7dff35e6-1b01-4eab-99af-ac66abe7da06 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:59.431115 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-7dff35e6-1b01-4eab-99af-ac66abe7da06 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:59.431566 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-7dff35e6-1b01-4eab-99af-ac66abe7da06 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:59.448999 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-21c0ceb2-e25c-4f96-bf5a-4b23a9977193 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac99f60384fe4a119d019cedfe1d3557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f18ee8c7d4cfe9f4b879505ca6605', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:46:59.458422 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-21c0ceb2-e25c-4f96-bf5a-4b23a9977193 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] 10.222.0.66 "GET /compute/v2.1/servers/2ed39450-289e-4d51-b1b0-c5fe323e6201" status: 200 len: 1367 microversion: 2.1 time: 0.393473 Aug 04 03:46:59.462675 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 432/864] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:46:59 2022] GET /compute/v2.1/servers/2ed39450-289e-4d51-b1b0-c5fe323e6201 => generated 1367 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:46:59.544318 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [req-bf8c5024-05c6-43a2-aa18-bae6acdb0d3f req-8fb6e084-d7b4-4f04-a95c-c6b13391606a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3bf41d49-2b84-4f59-a019-a8b1e45891d1", "name": "network-vif-deleted", "tag": "8144b5cf-3a6c-452a-a3bb-81896a2ba4e0"}]} {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 03:46:59.555425 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [req-bf8c5024-05c6-43a2-aa18-bae6acdb0d3f req-8fb6e084-d7b4-4f04-a95c-c6b13391606a service nova] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:59.555633 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [req-bf8c5024-05c6-43a2-aa18-bae6acdb0d3f req-8fb6e084-d7b4-4f04-a95c-c6b13391606a service nova] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:59.567817 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.compute.server_external_events [req-bf8c5024-05c6-43a2-aa18-bae6acdb0d3f req-8fb6e084-d7b4-4f04-a95c-c6b13391606a service nova] Creating event network-vif-deleted:8144b5cf-3a6c-452a-a3bb-81896a2ba4e0 for instance 3bf41d49-2b84-4f59-a019-a8b1e45891d1 on hv-cinder-73306 Aug 04 03:46:59.572891 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [req-bf8c5024-05c6-43a2-aa18-bae6acdb0d3f req-8fb6e084-d7b4-4f04-a95c-c6b13391606a service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032162 Aug 04 03:46:59.573855 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 433/865] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 03:46:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 03:46:59.634456 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [req-1f7c00d4-c0d4-4167-9498-77b40b1cc378 req-bd34ad67-70ee-4cb8-8c41-c2723b840a52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd510bcc-33c6-4299-8a14-018dce8ee011", "name": "network-vif-deleted", "tag": "c6499e78-e527-405f-ab7c-374a6cec81fb"}]} {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 03:46:59.640584 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-7dff35e6-1b01-4eab-99af-ac66abe7da06 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd245c731eb58483bb635a7e70542b892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2049d7705d5c4afe94c22a6f1284327b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:46:59.646460 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [req-1f7c00d4-c0d4-4167-9498-77b40b1cc378 req-bd34ad67-70ee-4cb8-8c41-c2723b840a52 service nova] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:46:59.647011 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [req-1f7c00d4-c0d4-4167-9498-77b40b1cc378 req-bd34ad67-70ee-4cb8-8c41-c2723b840a52 service nova] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:46:59.650984 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-7dff35e6-1b01-4eab-99af-ac66abe7da06 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] 10.222.0.66 "GET /compute/v2.1/servers/bd510bcc-33c6-4299-8a14-018dce8ee011" status: 200 len: 1553 microversion: 2.1 time: 0.243633 Aug 04 03:46:59.653560 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 433/866] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:46:59 2022] GET /compute/v2.1/servers/bd510bcc-33c6-4299-8a14-018dce8ee011 => generated 1553 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:46:59.659454 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.compute.server_external_events [req-1f7c00d4-c0d4-4167-9498-77b40b1cc378 req-bd34ad67-70ee-4cb8-8c41-c2723b840a52 service nova] Creating event network-vif-deleted:c6499e78-e527-405f-ab7c-374a6cec81fb for instance bd510bcc-33c6-4299-8a14-018dce8ee011 on hv-cinder-73306 Aug 04 03:46:59.664696 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [req-1f7c00d4-c0d4-4167-9498-77b40b1cc378 req-bd34ad67-70ee-4cb8-8c41-c2723b840a52 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035668 Aug 04 03:46:59.665311 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 434/867] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 03:46:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 03:47:00.071388 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-714548aa-7ef5-407a-b78e-8548588bbb03 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:47:00.074682 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-714548aa-7ef5-407a-b78e-8548588bbb03 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] [instance: 99218af9-c409-4074-bd4e-a3dff3731105] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:47:00.078974 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-714548aa-7ef5-407a-b78e-8548588bbb03 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:47:00.079423 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-714548aa-7ef5-407a-b78e-8548588bbb03 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:47:00.080212 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-714548aa-7ef5-407a-b78e-8548588bbb03 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:47:00.080644 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-714548aa-7ef5-407a-b78e-8548588bbb03 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:47:00.084698 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG dbcounter [-] [130263] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:47:00.142127 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-87652570-c0ee-4387-8ddc-75423f2b5654 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:47:00.144471 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-87652570-c0ee-4387-8ddc-75423f2b5654 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] [instance: 221108c9-a4b6-4e41-a9e5-a4e1461c991d] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:47:00.151819 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-87652570-c0ee-4387-8ddc-75423f2b5654 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:47:00.152308 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-87652570-c0ee-4387-8ddc-75423f2b5654 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:47:00.153334 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-87652570-c0ee-4387-8ddc-75423f2b5654 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:47:00.153971 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-87652570-c0ee-4387-8ddc-75423f2b5654 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:47:00.272180 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-714548aa-7ef5-407a-b78e-8548588bbb03 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac48e585c133487dadbe0a1e095bfde0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32813adc26c64016b99c9c5fd838d391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:47:00.282389 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-714548aa-7ef5-407a-b78e-8548588bbb03 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] 10.222.0.66 "GET /compute/v2.1/servers/99218af9-c409-4074-bd4e-a3dff3731105" status: 200 len: 1264 microversion: 2.1 time: 0.214961 Aug 04 03:47:00.283052 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 434/868] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:47:00 2022] GET /compute/v2.1/servers/99218af9-c409-4074-bd4e-a3dff3731105 => generated 1264 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:47:00.338164 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-87652570-c0ee-4387-8ddc-75423f2b5654 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dba436d0a67433f8c8ae7cd40d3f795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46b8dc64007429b805971d4c6f5b471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:47:00.346805 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-87652570-c0ee-4387-8ddc-75423f2b5654 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] 10.222.0.66 "GET /compute/v2.1/servers/221108c9-a4b6-4e41-a9e5-a4e1461c991d" status: 200 len: 1364 microversion: 2.1 time: 0.214479 Aug 04 03:47:00.361748 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 435/869] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:47:00 2022] GET /compute/v2.1/servers/221108c9-a4b6-4e41-a9e5-a4e1461c991d => generated 1364 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 03:47:00.393115 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-d39f9e84-e047-4aff-9651-84b23612843a tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:47:00.393975 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-d39f9e84-e047-4aff-9651-84b23612843a tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] [instance: 3bf41d49-2b84-4f59-a019-a8b1e45891d1] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:47:00.401514 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-d39f9e84-e047-4aff-9651-84b23612843a tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:47:00.413081 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-d39f9e84-e047-4aff-9651-84b23612843a tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:47:00.414730 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-d39f9e84-e047-4aff-9651-84b23612843a tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:47:00.415355 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-d39f9e84-e047-4aff-9651-84b23612843a tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:47:00.455010 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-d39f9e84-e047-4aff-9651-84b23612843a tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:47:00.455839 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-d39f9e84-e047-4aff-9651-84b23612843a tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:47:00.456371 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.objects.instance [None req-d39f9e84-e047-4aff-9651-84b23612843a tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lazy-loading 'fault' on Instance uuid 3bf41d49-2b84-4f59-a019-a8b1e45891d1 {{(pid=130263) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 03:47:00.487481 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-68bc6dbb-cd59-4d0d-ab52-f49eadaeaaca tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:47:00.488901 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-68bc6dbb-cd59-4d0d-ab52-f49eadaeaaca tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] [instance: 2ed39450-289e-4d51-b1b0-c5fe323e6201] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:47:00.496754 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-68bc6dbb-cd59-4d0d-ab52-f49eadaeaaca tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:47:00.497228 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-68bc6dbb-cd59-4d0d-ab52-f49eadaeaaca tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:47:00.498229 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-68bc6dbb-cd59-4d0d-ab52-f49eadaeaaca tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:47:00.498913 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-68bc6dbb-cd59-4d0d-ab52-f49eadaeaaca tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:47:00.527674 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-d39f9e84-e047-4aff-9651-84b23612843a tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:47:00.538128 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-d39f9e84-e047-4aff-9651-84b23612843a tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:47:00.540082 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-d39f9e84-e047-4aff-9651-84b23612843a tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:47:00.541407 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-d39f9e84-e047-4aff-9651-84b23612843a tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] 10.222.0.66 "GET /compute/v2.1/servers/3bf41d49-2b84-4f59-a019-a8b1e45891d1" status: 200 len: 1371 microversion: 2.20 time: 0.155604 Aug 04 03:47:00.542157 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 435/870] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 03:47:00 2022] GET /compute/v2.1/servers/3bf41d49-2b84-4f59-a019-a8b1e45891d1 => generated 1371 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 03:47:00.649875 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-68bc6dbb-cd59-4d0d-ab52-f49eadaeaaca tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac99f60384fe4a119d019cedfe1d3557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f18ee8c7d4cfe9f4b879505ca6605', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:47:00.658646 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-68bc6dbb-cd59-4d0d-ab52-f49eadaeaaca tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] 10.222.0.66 "GET /compute/v2.1/servers/2ed39450-289e-4d51-b1b0-c5fe323e6201" status: 200 len: 1367 microversion: 2.1 time: 0.176860 Aug 04 03:47:00.659311 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 436/871] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:47:00 2022] GET /compute/v2.1/servers/2ed39450-289e-4d51-b1b0-c5fe323e6201 => generated 1367 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 03:47:00.672443 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-7041b439-2115-459c-8174-b139c2c6e552 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:47:00.673051 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-7041b439-2115-459c-8174-b139c2c6e552 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] [instance: bd510bcc-33c6-4299-8a14-018dce8ee011] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:47:00.678933 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-7041b439-2115-459c-8174-b139c2c6e552 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:47:00.679382 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-7041b439-2115-459c-8174-b139c2c6e552 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:47:00.680143 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-7041b439-2115-459c-8174-b139c2c6e552 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:47:00.680575 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-7041b439-2115-459c-8174-b139c2c6e552 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:47:00.710802 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-7041b439-2115-459c-8174-b139c2c6e552 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:47:00.711252 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-7041b439-2115-459c-8174-b139c2c6e552 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:47:00.711701 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.objects.instance [None req-7041b439-2115-459c-8174-b139c2c6e552 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lazy-loading 'fault' on Instance uuid bd510bcc-33c6-4299-8a14-018dce8ee011 {{(pid=130263) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 03:47:00.754048 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-7041b439-2115-459c-8174-b139c2c6e552 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd245c731eb58483bb635a7e70542b892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2049d7705d5c4afe94c22a6f1284327b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:47:00.761675 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-7041b439-2115-459c-8174-b139c2c6e552 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] 10.222.0.66 "GET /compute/v2.1/servers/bd510bcc-33c6-4299-8a14-018dce8ee011" status: 200 len: 1348 microversion: 2.1 time: 0.093130 Aug 04 03:47:00.762242 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 436/872] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:47:00 2022] GET /compute/v2.1/servers/bd510bcc-33c6-4299-8a14-018dce8ee011 => generated 1348 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:47:01.303021 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-0d3cf731-54e9-4ce2-9d59-5292b876429d tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:47:01.303621 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-0d3cf731-54e9-4ce2-9d59-5292b876429d tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] [instance: 99218af9-c409-4074-bd4e-a3dff3731105] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:47:01.310614 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-0d3cf731-54e9-4ce2-9d59-5292b876429d tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:47:01.311862 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-0d3cf731-54e9-4ce2-9d59-5292b876429d tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:47:01.312631 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-0d3cf731-54e9-4ce2-9d59-5292b876429d tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:47:01.313059 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-0d3cf731-54e9-4ce2-9d59-5292b876429d tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:47:01.368627 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-f6d5726f-eab3-43f8-924b-b6373fc7563f tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:47:01.369407 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-f6d5726f-eab3-43f8-924b-b6373fc7563f tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] [instance: 221108c9-a4b6-4e41-a9e5-a4e1461c991d] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:47:01.376834 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-f6d5726f-eab3-43f8-924b-b6373fc7563f tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:47:01.377415 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-f6d5726f-eab3-43f8-924b-b6373fc7563f tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:47:01.378260 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-f6d5726f-eab3-43f8-924b-b6373fc7563f tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:47:01.378806 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-f6d5726f-eab3-43f8-924b-b6373fc7563f tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:47:01.500984 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-0d3cf731-54e9-4ce2-9d59-5292b876429d tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac48e585c133487dadbe0a1e095bfde0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32813adc26c64016b99c9c5fd838d391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:47:01.508936 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-0d3cf731-54e9-4ce2-9d59-5292b876429d tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] 10.222.0.66 "GET /compute/v2.1/servers/99218af9-c409-4074-bd4e-a3dff3731105" status: 200 len: 1264 microversion: 2.1 time: 0.210047 Aug 04 03:47:01.509731 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 437/873] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:47:01 2022] GET /compute/v2.1/servers/99218af9-c409-4074-bd4e-a3dff3731105 => generated 1264 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:47:01.547204 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-f6d5726f-eab3-43f8-924b-b6373fc7563f tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dba436d0a67433f8c8ae7cd40d3f795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46b8dc64007429b805971d4c6f5b471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:47:01.554701 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-f6d5726f-eab3-43f8-924b-b6373fc7563f tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] 10.222.0.66 "GET /compute/v2.1/servers/221108c9-a4b6-4e41-a9e5-a4e1461c991d" status: 200 len: 1550 microversion: 2.1 time: 0.190133 Aug 04 03:47:01.555264 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 437/874] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:47:01 2022] GET /compute/v2.1/servers/221108c9-a4b6-4e41-a9e5-a4e1461c991d => generated 1550 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 03:47:01.565635 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-ebaebb68-4dd3-4d92-9cf7-ce91a56683d0 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:47:01.566247 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-ebaebb68-4dd3-4d92-9cf7-ce91a56683d0 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] [instance: 3bf41d49-2b84-4f59-a019-a8b1e45891d1] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:47:01.572460 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-ebaebb68-4dd3-4d92-9cf7-ce91a56683d0 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:47:01.572914 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-ebaebb68-4dd3-4d92-9cf7-ce91a56683d0 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:47:01.573750 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-ebaebb68-4dd3-4d92-9cf7-ce91a56683d0 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:47:01.574184 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-ebaebb68-4dd3-4d92-9cf7-ce91a56683d0 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:47:01.575161 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-4dd399f1-6aeb-4148-8ec4-a8ea927fc2a8 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:47:01.575662 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-4dd399f1-6aeb-4148-8ec4-a8ea927fc2a8 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] [instance: 221108c9-a4b6-4e41-a9e5-a4e1461c991d] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:47:01.581758 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-4dd399f1-6aeb-4148-8ec4-a8ea927fc2a8 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:47:01.582214 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-4dd399f1-6aeb-4148-8ec4-a8ea927fc2a8 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:47:01.582983 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-4dd399f1-6aeb-4148-8ec4-a8ea927fc2a8 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:47:01.583425 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-4dd399f1-6aeb-4148-8ec4-a8ea927fc2a8 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:47:01.587619 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.wsgi [None req-ebaebb68-4dd3-4d92-9cf7-ce91a56683d0 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] HTTP exception thrown: Instance 3bf41d49-2b84-4f59-a019-a8b1e45891d1 could not be found. Aug 04 03:47:01.589303 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-ebaebb68-4dd3-4d92-9cf7-ce91a56683d0 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Request method failure captured: Aug 04 03:47:01.589303 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: request: GET /compute/v2.1/servers/3bf41d49-2b84-4f59-a019-a8b1e45891d1 HTTP/1.1 Aug 04 03:47:01.589303 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: Accept: application/json Aug 04 03:47:01.589303 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: Accept-Encoding: identity Aug 04 03:47:01.589303 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: Connection: close Aug 04 03:47:01.589303 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: Content-Length: 0 Aug 04 03:47:01.589303 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: Content-Type: application/json Aug 04 03:47:01.589303 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: Host: 10.222.0.66 Aug 04 03:47:01.589303 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: Openstack-System-Scope: None Aug 04 03:47:01.589303 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: User-Agent: python-urllib3/1.26.11 Aug 04 03:47:01.589303 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Auth-Token: gAAAAABi6z_6eWpflhTHAR3k3-3-Ak9FHGaJVefRoBRycC9xcveJTyS3VydXfkrfjNWpmddv6tXX_m9fThQticZOp_TpGnnbBBZrV9UfFxUpSnkrNgFZrKBKp35EjTPK7UxdKFU_Z27hg5qNhGcQL_Kq5UIMJbwlYCTazf0GoGyA8EbjGBcubh4 Aug 04 03:47:01.589303 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Domain-Id: None Aug 04 03:47:01.589303 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Domain-Name: None Aug 04 03:47:01.589303 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Identity-Status: Confirmed Aug 04 03:47:01.589303 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Is-Admin-Project: True Aug 04 03:47:01.589303 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Openstack-Nova-Api-Version: 2.20 Aug 04 03:47:01.589303 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Project-Domain-Id: default Aug 04 03:47:01.589303 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Project-Domain-Name: Default Aug 04 03:47:01.589303 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Project-Id: 274bea7582354f49841b893c0a39ffdf Aug 04 03:47:01.589303 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-558990152 Aug 04 03:47:01.589303 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Role: member,reader Aug 04 03:47:01.589303 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Roles: member,reader Aug 04 03:47:01.591018 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/274bea7582354f49841b893c0a39ffdf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/274bea7582354f49841b893c0a39ffdf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/274bea7582354f49841b893c0a39ffdf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_274bea7582354f49841b893c0a39ffdf"}]}] Aug 04 03:47:01.591018 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Tenant: tempest-AttachVolumeShelveTestJSON-558990152 Aug 04 03:47:01.591018 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Tenant-Id: 274bea7582354f49841b893c0a39ffdf Aug 04 03:47:01.591018 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-558990152 Aug 04 03:47:01.591018 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-User: tempest-AttachVolumeShelveTestJSON-558990152-project Aug 04 03:47:01.591018 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-User-Domain-Id: default Aug 04 03:47:01.591018 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-User-Domain-Name: Default Aug 04 03:47:01.591018 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-User-Id: 55beb38ea2994ea7987fe546235b58a5 Aug 04 03:47:01.591018 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-User-Name: tempest-AttachVolumeShelveTestJSON-558990152-project Aug 04 03:47:01.591018 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: method: > Aug 04 03:47:01.591018 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: exception: Instance 3bf41d49-2b84-4f59-a019-a8b1e45891d1 could not be found. Aug 04 03:47:01.591018 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: action_args: {'id': '3bf41d49-2b84-4f59-a019-a8b1e45891d1'} Aug 04 03:47:01.591932 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 03:47:01.591932 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 03:47:01.591932 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 03:47:01.591932 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 03:47:01.591932 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 03:47:01.591932 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 03:47:01.591932 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 03:47:01.591932 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 03:47:01.591932 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 03:47:01.591932 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 03:47:01.591932 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3bf41d49-2b84-4f59-a019-a8b1e45891d1 could not be found. Aug 04 03:47:01.591932 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi Aug 04 03:47:01.591932 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 03:47:01.591932 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi Aug 04 03:47:01.591932 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 03:47:01.591932 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 03:47:01.591932 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 03:47:01.591932 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 03:47:01.591932 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 03:47:01.591932 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 03:47:01.594119 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 03:47:01.594119 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 03:47:01.594119 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 03:47:01.594119 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 03:47:01.594119 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 03:47:01.594119 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 03:47:01.594119 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 03:47:01.594119 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3bf41d49-2b84-4f59-a019-a8b1e45891d1 could not be found. Aug 04 03:47:01.594119 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi Aug 04 03:47:01.594119 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 03:47:01.594119 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi Aug 04 03:47:01.594119 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 03:47:01.594119 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 03:47:01.594119 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 03:47:01.594119 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 03:47:01.594119 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 03:47:01.594119 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3bf41d49-2b84-4f59-a019-a8b1e45891d1 could not be found. Aug 04 03:47:01.594119 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi Aug 04 03:47:01.595739 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-ebaebb68-4dd3-4d92-9cf7-ce91a56683d0 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Returning 404 to user: Instance 3bf41d49-2b84-4f59-a019-a8b1e45891d1 could not be found. {{(pid=130262) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 03:47:01.595739 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-ebaebb68-4dd3-4d92-9cf7-ce91a56683d0 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] 10.222.0.66 "GET /compute/v2.1/servers/3bf41d49-2b84-4f59-a019-a8b1e45891d1" status: 404 len: 111 microversion: 2.20 time: 0.029622 Aug 04 03:47:01.595739 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 438/875] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 03:47:01 2022] GET /compute/v2.1/servers/3bf41d49-2b84-4f59-a019-a8b1e45891d1 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 04 03:47:01.599848 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-724d5261-be99-482d-84cc-d2dcbc19e774 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Calling method '.version_select at 0x7f72e2f4edc0>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:47:01.663113 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-4dd399f1-6aeb-4148-8ec4-a8ea927fc2a8 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] 10.222.0.66 "GET /compute/v2.1/servers/221108c9-a4b6-4e41-a9e5-a4e1461c991d/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.091778 Aug 04 03:47:01.663707 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 438/876] 10.222.0.66 () {58 vars in 1275 bytes} [Thu Aug 4 03:47:01 2022] GET /compute/v2.1/servers/221108c9-a4b6-4e41-a9e5-a4e1461c991d/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 03:47:01.678132 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-12d08b6f-a7f7-4420-b432-fa3439cac740 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:47:01.678754 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-12d08b6f-a7f7-4420-b432-fa3439cac740 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] [instance: 2ed39450-289e-4d51-b1b0-c5fe323e6201] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:47:01.684826 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-12d08b6f-a7f7-4420-b432-fa3439cac740 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:47:01.687235 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-12d08b6f-a7f7-4420-b432-fa3439cac740 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:47:01.687235 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-12d08b6f-a7f7-4420-b432-fa3439cac740 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:47:01.687235 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-12d08b6f-a7f7-4420-b432-fa3439cac740 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:47:01.715839 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-724d5261-be99-482d-84cc-d2dcbc19e774 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1362409090" status: 204 len: 0 microversion: 2.20 time: 0.119350 Aug 04 03:47:01.716605 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 439/877] 10.222.0.66 () {60 vars in 1262 bytes} [Thu Aug 4 03:47:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1362409090 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 04 03:47:01.785055 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-a2769d9d-81c8-4c14-a74e-52a8c0fb0ef5 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:47:01.785704 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-a2769d9d-81c8-4c14-a74e-52a8c0fb0ef5 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] [instance: bd510bcc-33c6-4299-8a14-018dce8ee011] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:47:01.793052 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-a2769d9d-81c8-4c14-a74e-52a8c0fb0ef5 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:47:01.793733 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-a2769d9d-81c8-4c14-a74e-52a8c0fb0ef5 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:47:01.794514 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-a2769d9d-81c8-4c14-a74e-52a8c0fb0ef5 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:47:01.794956 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-a2769d9d-81c8-4c14-a74e-52a8c0fb0ef5 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:47:01.812612 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.wsgi [None req-a2769d9d-81c8-4c14-a74e-52a8c0fb0ef5 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] HTTP exception thrown: Instance bd510bcc-33c6-4299-8a14-018dce8ee011 could not be found. Aug 04 03:47:01.814217 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-a2769d9d-81c8-4c14-a74e-52a8c0fb0ef5 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Request method failure captured: Aug 04 03:47:01.814217 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: request: GET /compute/v2.1/servers/bd510bcc-33c6-4299-8a14-018dce8ee011 HTTP/1.1 Aug 04 03:47:01.814217 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: Accept: application/json Aug 04 03:47:01.814217 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: Accept-Encoding: identity Aug 04 03:47:01.814217 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: Connection: close Aug 04 03:47:01.814217 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: Content-Length: 0 Aug 04 03:47:01.814217 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: Content-Type: application/json Aug 04 03:47:01.814217 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: Host: 10.222.0.66 Aug 04 03:47:01.814217 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: Openstack-System-Scope: None Aug 04 03:47:01.814217 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: User-Agent: python-urllib3/1.26.11 Aug 04 03:47:01.814217 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Auth-Token: gAAAAABi60A6hVNq9vUvOJIdBibiRTL80Qo54vqhDpA6gOtxsw7Aj-XZzuMte5_L1sxCaMKGcvSXGcPioMbIJ5GtK6M1spGrh_cMsy01m2vvaeKyJRWL9dR21hum5XQ65yy-a8U0Cn5fJNf79UpD8t8SUAbgWFphTi_WdWUjbAKjPkgMeca4_zA Aug 04 03:47:01.814217 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Domain-Id: None Aug 04 03:47:01.814217 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Domain-Name: None Aug 04 03:47:01.814217 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Identity-Status: Confirmed Aug 04 03:47:01.814217 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Is-Admin-Project: True Aug 04 03:47:01.814217 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Project-Domain-Id: default Aug 04 03:47:01.814217 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Project-Domain-Name: Default Aug 04 03:47:01.814217 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Project-Id: 2049d7705d5c4afe94c22a6f1284327b Aug 04 03:47:01.814217 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Project-Name: tempest-TestMinimumBasicScenario-1797892478 Aug 04 03:47:01.814217 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Role: member,reader Aug 04 03:47:01.814217 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Roles: member,reader Aug 04 03:47:01.815629 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/2049d7705d5c4afe94c22a6f1284327b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/2049d7705d5c4afe94c22a6f1284327b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/2049d7705d5c4afe94c22a6f1284327b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_2049d7705d5c4afe94c22a6f1284327b"}]}] Aug 04 03:47:01.815629 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Tenant: tempest-TestMinimumBasicScenario-1797892478 Aug 04 03:47:01.815629 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Tenant-Id: 2049d7705d5c4afe94c22a6f1284327b Aug 04 03:47:01.815629 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1797892478 Aug 04 03:47:01.815629 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-User: tempest-TestMinimumBasicScenario-1797892478-project Aug 04 03:47:01.815629 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-User-Domain-Id: default Aug 04 03:47:01.815629 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-User-Domain-Name: Default Aug 04 03:47:01.815629 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-User-Id: d245c731eb58483bb635a7e70542b892 Aug 04 03:47:01.815629 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-User-Name: tempest-TestMinimumBasicScenario-1797892478-project Aug 04 03:47:01.815629 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: method: > Aug 04 03:47:01.815629 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: exception: Instance bd510bcc-33c6-4299-8a14-018dce8ee011 could not be found. Aug 04 03:47:01.815629 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: action_args: {'id': 'bd510bcc-33c6-4299-8a14-018dce8ee011'} Aug 04 03:47:01.816390 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 03:47:01.816390 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 03:47:01.816390 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 03:47:01.816390 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 03:47:01.816390 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 03:47:01.816390 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 03:47:01.816390 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 03:47:01.816390 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 03:47:01.816390 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 03:47:01.816390 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 03:47:01.816390 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bd510bcc-33c6-4299-8a14-018dce8ee011 could not be found. Aug 04 03:47:01.816390 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi Aug 04 03:47:01.816390 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 03:47:01.816390 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi Aug 04 03:47:01.816390 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 03:47:01.816390 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 03:47:01.816390 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 03:47:01.816390 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 03:47:01.816390 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 03:47:01.816390 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 03:47:01.823593 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 03:47:01.823593 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 03:47:01.823593 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 03:47:01.823593 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 03:47:01.823593 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 03:47:01.823593 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 03:47:01.823593 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 03:47:01.823593 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd510bcc-33c6-4299-8a14-018dce8ee011 could not be found. Aug 04 03:47:01.823593 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi Aug 04 03:47:01.823593 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 03:47:01.823593 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi Aug 04 03:47:01.823593 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 03:47:01.823593 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 03:47:01.823593 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 03:47:01.823593 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 03:47:01.823593 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 03:47:01.823593 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd510bcc-33c6-4299-8a14-018dce8ee011 could not be found. Aug 04 03:47:01.823593 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi Aug 04 03:47:01.824944 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-a2769d9d-81c8-4c14-a74e-52a8c0fb0ef5 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Returning 404 to user: Instance bd510bcc-33c6-4299-8a14-018dce8ee011 could not be found. {{(pid=130262) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 03:47:01.824944 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-a2769d9d-81c8-4c14-a74e-52a8c0fb0ef5 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] 10.222.0.66 "GET /compute/v2.1/servers/bd510bcc-33c6-4299-8a14-018dce8ee011" status: 404 len: 111 microversion: 2.1 time: 0.036042 Aug 04 03:47:01.824944 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 440/878] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:47:01 2022] GET /compute/v2.1/servers/bd510bcc-33c6-4299-8a14-018dce8ee011 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 03:47:01.825391 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-ebabaaf0-fed3-4a6c-a53d-ad930ebbfd21 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] Calling method '.version_select at 0x7f72e2f3f040>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:47:01.892914 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-ebabaaf0-fed3-4a6c-a53d-ad930ebbfd21 tempest-TestMinimumBasicScenario-1797892478 tempest-TestMinimumBasicScenario-1797892478-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-620712029" status: 202 len: 0 microversion: 2.1 time: 0.072165 Aug 04 03:47:01.893539 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 441/879] 10.222.0.66 () {58 vars in 1269 bytes} [Thu Aug 4 03:47:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-620712029 => generated 0 bytes in 73 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 04 03:47:01.994569 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-12d08b6f-a7f7-4420-b432-fa3439cac740 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac99f60384fe4a119d019cedfe1d3557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f18ee8c7d4cfe9f4b879505ca6605', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:47:02.005406 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-12d08b6f-a7f7-4420-b432-fa3439cac740 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] 10.222.0.66 "GET /compute/v2.1/servers/2ed39450-289e-4d51-b1b0-c5fe323e6201" status: 200 len: 1367 microversion: 2.1 time: 0.330824 Aug 04 03:47:02.007256 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 439/880] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:47:01 2022] GET /compute/v2.1/servers/2ed39450-289e-4d51-b1b0-c5fe323e6201 => generated 1367 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 03:47:02.131434 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [req-23b9f739-5c26-4fde-bd8d-fce13e1ae609 req-1b45ad54-2dfd-4605-87ea-811f1053129e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99218af9-c409-4074-bd4e-a3dff3731105", "name": "network-vif-plugged", "status": "completed", "tag": "f4c20bb3-4881-4ace-8a51-334ca209dbbd"}]} {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 03:47:02.144770 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [req-23b9f739-5c26-4fde-bd8d-fce13e1ae609 req-1b45ad54-2dfd-4605-87ea-811f1053129e service nova] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:47:02.145241 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [req-23b9f739-5c26-4fde-bd8d-fce13e1ae609 req-1b45ad54-2dfd-4605-87ea-811f1053129e service nova] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:47:02.156504 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.compute.server_external_events [req-23b9f739-5c26-4fde-bd8d-fce13e1ae609 req-1b45ad54-2dfd-4605-87ea-811f1053129e service nova] Creating event network-vif-plugged:f4c20bb3-4881-4ace-8a51-334ca209dbbd for instance 99218af9-c409-4074-bd4e-a3dff3731105 on hv-cinder-73306 Aug 04 03:47:02.161389 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [req-23b9f739-5c26-4fde-bd8d-fce13e1ae609 req-1b45ad54-2dfd-4605-87ea-811f1053129e service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033688 Aug 04 03:47:02.162525 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 442/881] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 03:47:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 03:47:02.530809 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-da33497c-85e8-44c5-920f-80bd595b3fb1 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:47:02.532229 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-da33497c-85e8-44c5-920f-80bd595b3fb1 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] [instance: 99218af9-c409-4074-bd4e-a3dff3731105] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:47:02.547546 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-da33497c-85e8-44c5-920f-80bd595b3fb1 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:47:02.547965 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-da33497c-85e8-44c5-920f-80bd595b3fb1 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:47:02.551884 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-da33497c-85e8-44c5-920f-80bd595b3fb1 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:47:02.552392 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-da33497c-85e8-44c5-920f-80bd595b3fb1 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:47:02.686665 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-174bbaef-476e-4313-abd1-11eff39af8e4 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Action: 'create', calling method: .version_select at 0x7f72e2f4e940>, body: {"keypair": {"name": "tempest-keypair-1797702810", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBCs0YVOPm5F6gYkx144xmPHvrvyRvhGgfhycrRukKWlbk5Wmk69dA2U2QPgh8z4G6ncjcrXynSPmW5Dwcd2ASRQRNo9bGwM6ZFetK8PH4MromUzYpcYmb5Ig5KV1t9BUQ=="}} {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 03:47:02.707382 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.quota [None req-174bbaef-476e-4313-abd1-11eff39af8e4 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Getting quotas for project 274bea7582354f49841b893c0a39ffdf. Resources: {'key_pairs'} {{(pid=130262) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 03:47:02.711731 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.quota [None req-174bbaef-476e-4313-abd1-11eff39af8e4 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Getting quotas for user 55beb38ea2994ea7987fe546235b58a5 and project 274bea7582354f49841b893c0a39ffdf. Resources: {'key_pairs'} {{(pid=130262) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 03:47:02.801247 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-174bbaef-476e-4313-abd1-11eff39af8e4 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.120598 Aug 04 03:47:02.802115 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 443/882] 10.222.0.66 () {62 vars in 1200 bytes} [Thu Aug 4 03:47:02 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 122 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 04 03:47:02.806965 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-da33497c-85e8-44c5-920f-80bd595b3fb1 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac48e585c133487dadbe0a1e095bfde0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32813adc26c64016b99c9c5fd838d391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:47:02.817259 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-da33497c-85e8-44c5-920f-80bd595b3fb1 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] 10.222.0.66 "GET /compute/v2.1/servers/99218af9-c409-4074-bd4e-a3dff3731105" status: 200 len: 1264 microversion: 2.1 time: 0.290837 Aug 04 03:47:02.826326 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 440/883] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:47:02 2022] GET /compute/v2.1/servers/99218af9-c409-4074-bd4e-a3dff3731105 => generated 1264 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:47:03.027022 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-7542d49c-9afc-42ec-ba74-a0ed175b3d84 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:47:03.027755 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-7542d49c-9afc-42ec-ba74-a0ed175b3d84 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] [instance: 2ed39450-289e-4d51-b1b0-c5fe323e6201] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:47:03.038267 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-7542d49c-9afc-42ec-ba74-a0ed175b3d84 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:47:03.038716 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-7542d49c-9afc-42ec-ba74-a0ed175b3d84 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:47:03.039488 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-7542d49c-9afc-42ec-ba74-a0ed175b3d84 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:47:03.040085 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-7542d49c-9afc-42ec-ba74-a0ed175b3d84 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:47:03.082296 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [req-2d3efaea-0e74-4cc0-9e12-ee50d5ae62fa req-3d055166-8b40-44bf-953c-b5a6058e6167 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "221108c9-a4b6-4e41-a9e5-a4e1461c991d", "tag": "fbd5776e-e5bb-4524-bca5-b312018f5f7d"}]} {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 03:47:03.095246 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [req-2d3efaea-0e74-4cc0-9e12-ee50d5ae62fa req-3d055166-8b40-44bf-953c-b5a6058e6167 service nova] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:47:03.095680 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [req-2d3efaea-0e74-4cc0-9e12-ee50d5ae62fa req-3d055166-8b40-44bf-953c-b5a6058e6167 service nova] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:47:03.112704 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.compute.server_external_events [req-2d3efaea-0e74-4cc0-9e12-ee50d5ae62fa req-3d055166-8b40-44bf-953c-b5a6058e6167 service nova] Creating event network-changed:fbd5776e-e5bb-4524-bca5-b312018f5f7d for instance 221108c9-a4b6-4e41-a9e5-a4e1461c991d on hv-cinder-73306 Aug 04 03:47:03.119564 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [req-2d3efaea-0e74-4cc0-9e12-ee50d5ae62fa req-3d055166-8b40-44bf-953c-b5a6058e6167 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040941 Aug 04 03:47:03.120391 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 441/884] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 03:47:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 03:47:03.207843 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-7542d49c-9afc-42ec-ba74-a0ed175b3d84 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac99f60384fe4a119d019cedfe1d3557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f18ee8c7d4cfe9f4b879505ca6605', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:47:03.215455 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-7542d49c-9afc-42ec-ba74-a0ed175b3d84 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] 10.222.0.66 "GET /compute/v2.1/servers/2ed39450-289e-4d51-b1b0-c5fe323e6201" status: 200 len: 1367 microversion: 2.1 time: 0.192370 Aug 04 03:47:03.216120 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 444/885] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:47:03 2022] GET /compute/v2.1/servers/2ed39450-289e-4d51-b1b0-c5fe323e6201 => generated 1367 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:47:03.847214 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-2fb47fc6-8d02-47d9-8f62-f12d85cecbd8 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:47:03.848046 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-2fb47fc6-8d02-47d9-8f62-f12d85cecbd8 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] [instance: 99218af9-c409-4074-bd4e-a3dff3731105] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:47:03.856098 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-2fb47fc6-8d02-47d9-8f62-f12d85cecbd8 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:47:03.857177 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-2fb47fc6-8d02-47d9-8f62-f12d85cecbd8 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:47:03.858749 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-2fb47fc6-8d02-47d9-8f62-f12d85cecbd8 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:47:03.859387 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-2fb47fc6-8d02-47d9-8f62-f12d85cecbd8 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:47:04.018957 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-2fb47fc6-8d02-47d9-8f62-f12d85cecbd8 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac48e585c133487dadbe0a1e095bfde0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32813adc26c64016b99c9c5fd838d391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:47:04.027030 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-2fb47fc6-8d02-47d9-8f62-f12d85cecbd8 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] 10.222.0.66 "GET /compute/v2.1/servers/99218af9-c409-4074-bd4e-a3dff3731105" status: 200 len: 1264 microversion: 2.1 time: 0.186836 Aug 04 03:47:04.027701 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 442/886] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:47:03 2022] GET /compute/v2.1/servers/99218af9-c409-4074-bd4e-a3dff3731105 => generated 1264 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:47:04.194337 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [req-d17f2b14-054b-4d69-b565-71a9f18acfd3 req-b6f310f0-93ea-4acf-b6f4-781577e0488d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ed39450-289e-4d51-b1b0-c5fe323e6201", "name": "network-vif-plugged", "status": "completed", "tag": "50488897-66f7-41a7-9f38-95ae861c95b6"}]} {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 03:47:04.207938 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [req-d17f2b14-054b-4d69-b565-71a9f18acfd3 req-b6f310f0-93ea-4acf-b6f4-781577e0488d service nova] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:47:04.210801 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [req-d17f2b14-054b-4d69-b565-71a9f18acfd3 req-b6f310f0-93ea-4acf-b6f4-781577e0488d service nova] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:47:04.221066 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.compute.server_external_events [req-d17f2b14-054b-4d69-b565-71a9f18acfd3 req-b6f310f0-93ea-4acf-b6f4-781577e0488d service nova] Creating event network-vif-plugged:50488897-66f7-41a7-9f38-95ae861c95b6 for instance 2ed39450-289e-4d51-b1b0-c5fe323e6201 on hv-cinder-73306 Aug 04 03:47:04.226297 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [req-d17f2b14-054b-4d69-b565-71a9f18acfd3 req-b6f310f0-93ea-4acf-b6f4-781577e0488d service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036511 Aug 04 03:47:04.231025 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 445/887] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 03:47:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 03:47:04.236965 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-1ef408ae-51f0-4f7f-bc3d-8b8ef9aad047 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:47:04.238338 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-1ef408ae-51f0-4f7f-bc3d-8b8ef9aad047 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] [instance: 2ed39450-289e-4d51-b1b0-c5fe323e6201] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:47:04.244697 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-1ef408ae-51f0-4f7f-bc3d-8b8ef9aad047 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:47:04.245145 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-1ef408ae-51f0-4f7f-bc3d-8b8ef9aad047 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:47:04.245955 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-1ef408ae-51f0-4f7f-bc3d-8b8ef9aad047 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:47:04.246395 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-1ef408ae-51f0-4f7f-bc3d-8b8ef9aad047 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:47:04.390274 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-1ef408ae-51f0-4f7f-bc3d-8b8ef9aad047 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac99f60384fe4a119d019cedfe1d3557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f18ee8c7d4cfe9f4b879505ca6605', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:47:04.402136 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-1ef408ae-51f0-4f7f-bc3d-8b8ef9aad047 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] 10.222.0.66 "GET /compute/v2.1/servers/2ed39450-289e-4d51-b1b0-c5fe323e6201" status: 200 len: 1367 microversion: 2.1 time: 0.169563 Aug 04 03:47:04.402935 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 443/888] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:47:04 2022] GET /compute/v2.1/servers/2ed39450-289e-4d51-b1b0-c5fe323e6201 => generated 1367 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:47:05.051341 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-a8a8a5a4-62a1-4e28-a115-20c3838e7ab7 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:47:05.052044 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-a8a8a5a4-62a1-4e28-a115-20c3838e7ab7 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] [instance: 99218af9-c409-4074-bd4e-a3dff3731105] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:47:05.058686 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-a8a8a5a4-62a1-4e28-a115-20c3838e7ab7 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:47:05.059134 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-a8a8a5a4-62a1-4e28-a115-20c3838e7ab7 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:47:05.060025 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-a8a8a5a4-62a1-4e28-a115-20c3838e7ab7 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:47:05.060325 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-a8a8a5a4-62a1-4e28-a115-20c3838e7ab7 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:47:05.209818 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-a8a8a5a4-62a1-4e28-a115-20c3838e7ab7 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac48e585c133487dadbe0a1e095bfde0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32813adc26c64016b99c9c5fd838d391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:47:05.220297 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-a8a8a5a4-62a1-4e28-a115-20c3838e7ab7 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] 10.222.0.66 "GET /compute/v2.1/servers/99218af9-c409-4074-bd4e-a3dff3731105" status: 200 len: 1450 microversion: 2.1 time: 0.174040 Aug 04 03:47:05.220973 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 446/889] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:47:05 2022] GET /compute/v2.1/servers/99218af9-c409-4074-bd4e-a3dff3731105 => generated 1450 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:47:05.241960 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-8c60b9a2-f2b4-4313-9486-43f1949e265f tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:47:05.242902 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-8c60b9a2-f2b4-4313-9486-43f1949e265f tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] [instance: 99218af9-c409-4074-bd4e-a3dff3731105] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:47:05.250029 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-8c60b9a2-f2b4-4313-9486-43f1949e265f tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:47:05.250489 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-8c60b9a2-f2b4-4313-9486-43f1949e265f tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:47:05.251323 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-8c60b9a2-f2b4-4313-9486-43f1949e265f tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:47:05.251760 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-8c60b9a2-f2b4-4313-9486-43f1949e265f tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:47:05.426096 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-4f746ef1-22da-45e4-894e-a49fa49b65f7 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:47:05.426893 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-4f746ef1-22da-45e4-894e-a49fa49b65f7 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] [instance: 2ed39450-289e-4d51-b1b0-c5fe323e6201] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:47:05.436673 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-4f746ef1-22da-45e4-894e-a49fa49b65f7 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:47:05.441431 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-4f746ef1-22da-45e4-894e-a49fa49b65f7 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:47:05.442802 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-4f746ef1-22da-45e4-894e-a49fa49b65f7 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:47:05.443709 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-4f746ef1-22da-45e4-894e-a49fa49b65f7 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:47:05.660136 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-8c60b9a2-f2b4-4313-9486-43f1949e265f tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac48e585c133487dadbe0a1e095bfde0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32813adc26c64016b99c9c5fd838d391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:47:05.670875 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-8c60b9a2-f2b4-4313-9486-43f1949e265f tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] 10.222.0.66 "GET /compute/v2.1/servers/99218af9-c409-4074-bd4e-a3dff3731105" status: 200 len: 1450 microversion: 2.1 time: 0.432195 Aug 04 03:47:05.671994 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 444/890] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:47:05 2022] GET /compute/v2.1/servers/99218af9-c409-4074-bd4e-a3dff3731105 => generated 1450 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:47:05.760863 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-4f746ef1-22da-45e4-894e-a49fa49b65f7 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac99f60384fe4a119d019cedfe1d3557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f18ee8c7d4cfe9f4b879505ca6605', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:47:05.769420 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-4f746ef1-22da-45e4-894e-a49fa49b65f7 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] 10.222.0.66 "GET /compute/v2.1/servers/2ed39450-289e-4d51-b1b0-c5fe323e6201" status: 200 len: 1367 microversion: 2.1 time: 0.349218 Aug 04 03:47:05.781313 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 447/891] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:47:05 2022] GET /compute/v2.1/servers/2ed39450-289e-4d51-b1b0-c5fe323e6201 => generated 1367 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 03:47:06.372847 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-4bce0a44-dac5-4b70-90f1-1d83b93099d4 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-590647353", "imageRef": "0208f4b3-1d2f-42e4-a9b4-528bf5066fe1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "643c3c50-31c5-4c02-91db-4d069e60f726"}], "security_groups": [{"name": "tempest-securitygroup--1300311263"}], "key_name": "tempest-keypair-1797702810", "user_data": "}} {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 03:47:06.621642 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.network.neutron [None req-4bce0a44-dac5-4b70-90f1-1d83b93099d4 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] validate_networks() for [('643c3c50-31c5-4c02-91db-4d069e60f726', None, None, None, None, None)] {{(pid=130263) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 03:47:06.794673 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-1721076c-fec5-45cd-81b5-4abfe03017c9 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:47:06.796089 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-1721076c-fec5-45cd-81b5-4abfe03017c9 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] [instance: 2ed39450-289e-4d51-b1b0-c5fe323e6201] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:47:06.806784 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-1721076c-fec5-45cd-81b5-4abfe03017c9 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:47:06.807690 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-1721076c-fec5-45cd-81b5-4abfe03017c9 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:47:06.809256 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-1721076c-fec5-45cd-81b5-4abfe03017c9 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:47:06.810145 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-1721076c-fec5-45cd-81b5-4abfe03017c9 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:47:07.178297 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-1721076c-fec5-45cd-81b5-4abfe03017c9 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac99f60384fe4a119d019cedfe1d3557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f18ee8c7d4cfe9f4b879505ca6605', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:47:07.182450 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG dbcounter [-] [130262] Writing DB stats nova_cell1:SELECT=100 {{(pid=130262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:47:07.187515 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-1721076c-fec5-45cd-81b5-4abfe03017c9 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] 10.222.0.66 "GET /compute/v2.1/servers/2ed39450-289e-4d51-b1b0-c5fe323e6201" status: 200 len: 1557 microversion: 2.1 time: 0.399335 Aug 04 03:47:07.188208 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 448/892] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:47:06 2022] GET /compute/v2.1/servers/2ed39450-289e-4d51-b1b0-c5fe323e6201 => generated 1557 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 03:47:07.211932 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-231e2a8c-32d6-4974-8b10-18e73c8b10e4 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:47:07.212699 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-231e2a8c-32d6-4974-8b10-18e73c8b10e4 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] [instance: 2ed39450-289e-4d51-b1b0-c5fe323e6201] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:47:07.220229 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-231e2a8c-32d6-4974-8b10-18e73c8b10e4 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:47:07.220930 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-231e2a8c-32d6-4974-8b10-18e73c8b10e4 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:47:07.221749 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-231e2a8c-32d6-4974-8b10-18e73c8b10e4 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:47:07.222350 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-231e2a8c-32d6-4974-8b10-18e73c8b10e4 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:47:07.370787 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-231e2a8c-32d6-4974-8b10-18e73c8b10e4 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] 10.222.0.66 "GET /compute/v2.1/servers/2ed39450-289e-4d51-b1b0-c5fe323e6201/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.164071 Aug 04 03:47:07.371619 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 449/893] 10.222.0.66 () {58 vars in 1275 bytes} [Thu Aug 4 03:47:07 2022] GET /compute/v2.1/servers/2ed39450-289e-4d51-b1b0-c5fe323e6201/os-interface => generated 284 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 03:47:07.427816 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.virt.hardware [None req-4bce0a44-dac5-4b70-90f1-1d83b93099d4 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Flavor limits 0:0:0 {{(pid=130263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 03:47:07.428505 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.virt.hardware [None req-4bce0a44-dac5-4b70-90f1-1d83b93099d4 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Image limits 0:0:0 {{(pid=130263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 03:47:07.429097 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.virt.hardware [None req-4bce0a44-dac5-4b70-90f1-1d83b93099d4 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Flavor pref 0:0:0 {{(pid=130263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 03:47:07.429628 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.virt.hardware [None req-4bce0a44-dac5-4b70-90f1-1d83b93099d4 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Image pref 0:0:0 {{(pid=130263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 03:47:07.431326 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.virt.hardware [None req-4bce0a44-dac5-4b70-90f1-1d83b93099d4 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 03:47:07.441949 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-4bce0a44-dac5-4b70-90f1-1d83b93099d4 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:47:07.442692 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-4bce0a44-dac5-4b70-90f1-1d83b93099d4 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:47:07.443688 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-4bce0a44-dac5-4b70-90f1-1d83b93099d4 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:47:07.444362 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-4bce0a44-dac5-4b70-90f1-1d83b93099d4 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:47:07.463548 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.quota [None req-4bce0a44-dac5-4b70-90f1-1d83b93099d4 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Getting quotas for project 274bea7582354f49841b893c0a39ffdf. Resources: {'instances', 'ram', 'cores'} {{(pid=130263) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 03:47:07.468515 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.quota [None req-4bce0a44-dac5-4b70-90f1-1d83b93099d4 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Getting quotas for user 55beb38ea2994ea7987fe546235b58a5 and project 274bea7582354f49841b893c0a39ffdf. Resources: {'instances', 'ram', 'cores'} {{(pid=130263) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 03:47:07.483521 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-4bce0a44-dac5-4b70-90f1-1d83b93099d4 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Going to run 1 instances... {{(pid=130263) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 03:47:07.485903 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-4bce0a44-dac5-4b70-90f1-1d83b93099d4 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] [instance: 62affd75-bad1-417a-aac7-3495d56d9f19] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0208f4b3-1d2f-42e4-a9b4-528bf5066fe1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130263) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 03:47:07.596792 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-4bce0a44-dac5-4b70-90f1-1d83b93099d4 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.228836 Aug 04 03:47:07.597565 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 445/894] 10.222.0.66 () {62 vars in 1188 bytes} [Thu Aug 4 03:47:06 2022] POST /compute/v2.1/servers => generated 402 bytes in 1230 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 04 03:47:07.609945 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-817ad2c5-00c7-4db1-ac75-1d657952b578 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:47:07.610639 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-817ad2c5-00c7-4db1-ac75-1d657952b578 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] [instance: 62affd75-bad1-417a-aac7-3495d56d9f19] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:47:07.723424 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-817ad2c5-00c7-4db1-ac75-1d657952b578 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:47:07.732084 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-817ad2c5-00c7-4db1-ac75-1d657952b578 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:47:07.737595 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-817ad2c5-00c7-4db1-ac75-1d657952b578 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:47:07.737595 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-817ad2c5-00c7-4db1-ac75-1d657952b578 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] 10.222.0.66 "GET /compute/v2.1/servers/62affd75-bad1-417a-aac7-3495d56d9f19" status: 200 len: 1281 microversion: 2.20 time: 0.130896 Aug 04 03:47:07.737595 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 450/895] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 03:47:07 2022] GET /compute/v2.1/servers/62affd75-bad1-417a-aac7-3495d56d9f19 => generated 1281 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 03:47:08.380153 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [req-10b4d00e-f188-4c02-8681-490a683fb58d req-28067640-2116-4a83-8b10-871650167eb4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99218af9-c409-4074-bd4e-a3dff3731105", "tag": "f4c20bb3-4881-4ace-8a51-334ca209dbbd"}]} {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 03:47:08.393394 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [req-10b4d00e-f188-4c02-8681-490a683fb58d req-28067640-2116-4a83-8b10-871650167eb4 service nova] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:47:08.393764 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [req-10b4d00e-f188-4c02-8681-490a683fb58d req-28067640-2116-4a83-8b10-871650167eb4 service nova] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:47:08.405686 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.compute.server_external_events [req-10b4d00e-f188-4c02-8681-490a683fb58d req-28067640-2116-4a83-8b10-871650167eb4 service nova] Creating event network-changed:f4c20bb3-4881-4ace-8a51-334ca209dbbd for instance 99218af9-c409-4074-bd4e-a3dff3731105 on hv-cinder-73306 Aug 04 03:47:08.410613 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [req-10b4d00e-f188-4c02-8681-490a683fb58d req-28067640-2116-4a83-8b10-871650167eb4 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034809 Aug 04 03:47:08.411615 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 446/896] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 03:47:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 03:47:08.763946 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-9538f4d6-d30b-4bfc-8db6-1756061ab682 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:47:08.765521 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-9538f4d6-d30b-4bfc-8db6-1756061ab682 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] [instance: 62affd75-bad1-417a-aac7-3495d56d9f19] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:47:08.771864 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG dbcounter [-] [130262] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:DELETE=2,nova_api:INSERT=1 {{(pid=130262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:47:08.782469 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-9538f4d6-d30b-4bfc-8db6-1756061ab682 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:47:08.786003 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-9538f4d6-d30b-4bfc-8db6-1756061ab682 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:47:08.788381 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-9538f4d6-d30b-4bfc-8db6-1756061ab682 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:47:08.789504 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-9538f4d6-d30b-4bfc-8db6-1756061ab682 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:47:08.914573 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-9538f4d6-d30b-4bfc-8db6-1756061ab682 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:47:08.924384 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-9538f4d6-d30b-4bfc-8db6-1756061ab682 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:47:08.926386 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-9538f4d6-d30b-4bfc-8db6-1756061ab682 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:47:08.927522 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-9538f4d6-d30b-4bfc-8db6-1756061ab682 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] 10.222.0.66 "GET /compute/v2.1/servers/62affd75-bad1-417a-aac7-3495d56d9f19" status: 200 len: 1285 microversion: 2.20 time: 0.173337 Aug 04 03:47:08.928075 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 451/897] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 03:47:08 2022] GET /compute/v2.1/servers/62affd75-bad1-417a-aac7-3495d56d9f19 => generated 1285 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 03:47:09.668817 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [req-ef41ce1c-7d85-44b3-aa5a-caefb1953713 req-a08be569-c0bf-4d61-9be7-93f657760efa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ed39450-289e-4d51-b1b0-c5fe323e6201", "tag": "50488897-66f7-41a7-9f38-95ae861c95b6"}]} {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 03:47:09.679732 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [req-ef41ce1c-7d85-44b3-aa5a-caefb1953713 req-a08be569-c0bf-4d61-9be7-93f657760efa service nova] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:47:09.680392 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [req-ef41ce1c-7d85-44b3-aa5a-caefb1953713 req-a08be569-c0bf-4d61-9be7-93f657760efa service nova] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:47:09.706181 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.compute.server_external_events [req-ef41ce1c-7d85-44b3-aa5a-caefb1953713 req-a08be569-c0bf-4d61-9be7-93f657760efa service nova] Creating event network-changed:50488897-66f7-41a7-9f38-95ae861c95b6 for instance 2ed39450-289e-4d51-b1b0-c5fe323e6201 on hv-cinder-73306 Aug 04 03:47:09.713958 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [req-ef41ce1c-7d85-44b3-aa5a-caefb1953713 req-a08be569-c0bf-4d61-9be7-93f657760efa service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049595 Aug 04 03:47:09.719806 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 447/898] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 03:47:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 03:47:09.961063 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-25ef8567-1322-4d26-a55f-a447bee3b49c tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:47:09.962477 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-25ef8567-1322-4d26-a55f-a447bee3b49c tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] [instance: 62affd75-bad1-417a-aac7-3495d56d9f19] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:47:09.975712 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-25ef8567-1322-4d26-a55f-a447bee3b49c tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:47:09.977105 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-25ef8567-1322-4d26-a55f-a447bee3b49c tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:47:09.978223 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-25ef8567-1322-4d26-a55f-a447bee3b49c tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:47:09.978730 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-25ef8567-1322-4d26-a55f-a447bee3b49c tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:47:10.223165 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-25ef8567-1322-4d26-a55f-a447bee3b49c tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:47:10.230373 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-25ef8567-1322-4d26-a55f-a447bee3b49c tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:47:10.234352 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-25ef8567-1322-4d26-a55f-a447bee3b49c tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:47:10.236297 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-25ef8567-1322-4d26-a55f-a447bee3b49c tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] 10.222.0.66 "GET /compute/v2.1/servers/62affd75-bad1-417a-aac7-3495d56d9f19" status: 200 len: 1341 microversion: 2.20 time: 0.288406 Aug 04 03:47:10.252276 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 452/899] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 03:47:09 2022] GET /compute/v2.1/servers/62affd75-bad1-417a-aac7-3495d56d9f19 => generated 1341 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 03:47:11.260773 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-e11d0f20-54f0-423d-b774-3f8a2112485e tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:47:11.261608 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-e11d0f20-54f0-423d-b774-3f8a2112485e tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] [instance: 62affd75-bad1-417a-aac7-3495d56d9f19] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:47:11.264973 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG dbcounter [-] [130263] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=130263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:47:11.274020 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-e11d0f20-54f0-423d-b774-3f8a2112485e tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:47:11.274543 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-e11d0f20-54f0-423d-b774-3f8a2112485e tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:47:11.275318 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-e11d0f20-54f0-423d-b774-3f8a2112485e tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:47:11.275926 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-e11d0f20-54f0-423d-b774-3f8a2112485e tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:47:11.479137 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-e11d0f20-54f0-423d-b774-3f8a2112485e tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:47:11.489884 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-e11d0f20-54f0-423d-b774-3f8a2112485e tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:47:11.491455 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-e11d0f20-54f0-423d-b774-3f8a2112485e tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:47:11.492572 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-e11d0f20-54f0-423d-b774-3f8a2112485e tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] 10.222.0.66 "GET /compute/v2.1/servers/62affd75-bad1-417a-aac7-3495d56d9f19" status: 200 len: 1407 microversion: 2.20 time: 0.236825 Aug 04 03:47:11.493121 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 448/900] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 03:47:11 2022] GET /compute/v2.1/servers/62affd75-bad1-417a-aac7-3495d56d9f19 => generated 1407 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 03:47:11.736198 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [req-74b08241-d2bb-4da6-bf09-24b0c2df608f req-5005a4ca-99af-4c9b-a648-8c8a46aada3b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62affd75-bad1-417a-aac7-3495d56d9f19", "tag": "de2fd866-0219-43e7-a73a-fd446fc3c7ba"}]} {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 03:47:11.747567 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [req-74b08241-d2bb-4da6-bf09-24b0c2df608f req-5005a4ca-99af-4c9b-a648-8c8a46aada3b service nova] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:47:11.748076 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [req-74b08241-d2bb-4da6-bf09-24b0c2df608f req-5005a4ca-99af-4c9b-a648-8c8a46aada3b service nova] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:47:11.766123 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.compute.server_external_events [req-74b08241-d2bb-4da6-bf09-24b0c2df608f req-5005a4ca-99af-4c9b-a648-8c8a46aada3b service nova] Creating event network-changed:de2fd866-0219-43e7-a73a-fd446fc3c7ba for instance 62affd75-bad1-417a-aac7-3495d56d9f19 on hv-cinder-73306 Aug 04 03:47:11.772796 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [req-74b08241-d2bb-4da6-bf09-24b0c2df608f req-5005a4ca-99af-4c9b-a648-8c8a46aada3b service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040302 Aug 04 03:47:11.772796 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 453/901] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 03:47:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 03:47:12.518473 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-4568722c-25c7-495a-b033-b45bd82be331 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:47:12.519830 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-4568722c-25c7-495a-b033-b45bd82be331 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] [instance: 62affd75-bad1-417a-aac7-3495d56d9f19] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:47:12.528449 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-4568722c-25c7-495a-b033-b45bd82be331 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:47:12.529804 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-4568722c-25c7-495a-b033-b45bd82be331 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:47:12.535458 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-4568722c-25c7-495a-b033-b45bd82be331 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:47:12.535458 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-4568722c-25c7-495a-b033-b45bd82be331 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:47:12.688228 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-4568722c-25c7-495a-b033-b45bd82be331 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:47:12.705631 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-4568722c-25c7-495a-b033-b45bd82be331 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:47:12.707642 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-4568722c-25c7-495a-b033-b45bd82be331 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:47:12.709022 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-4568722c-25c7-495a-b033-b45bd82be331 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] 10.222.0.66 "GET /compute/v2.1/servers/62affd75-bad1-417a-aac7-3495d56d9f19" status: 200 len: 1407 microversion: 2.20 time: 0.195814 Aug 04 03:47:12.710572 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 449/902] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 03:47:12 2022] GET /compute/v2.1/servers/62affd75-bad1-417a-aac7-3495d56d9f19 => generated 1407 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 03:47:13.736031 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-53f7e738-1e22-4b3d-83b6-6cd4401ee667 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:47:13.737691 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-53f7e738-1e22-4b3d-83b6-6cd4401ee667 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] [instance: 62affd75-bad1-417a-aac7-3495d56d9f19] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:47:13.744767 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-53f7e738-1e22-4b3d-83b6-6cd4401ee667 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:47:13.745240 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-53f7e738-1e22-4b3d-83b6-6cd4401ee667 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:47:13.746023 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-53f7e738-1e22-4b3d-83b6-6cd4401ee667 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:47:13.746461 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-53f7e738-1e22-4b3d-83b6-6cd4401ee667 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:47:14.007194 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-53f7e738-1e22-4b3d-83b6-6cd4401ee667 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:47:14.016029 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-53f7e738-1e22-4b3d-83b6-6cd4401ee667 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:47:14.017566 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-53f7e738-1e22-4b3d-83b6-6cd4401ee667 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:47:14.018684 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-53f7e738-1e22-4b3d-83b6-6cd4401ee667 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] 10.222.0.66 "GET /compute/v2.1/servers/62affd75-bad1-417a-aac7-3495d56d9f19" status: 200 len: 1407 microversion: 2.20 time: 0.288222 Aug 04 03:47:14.019239 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 454/903] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 03:47:13 2022] GET /compute/v2.1/servers/62affd75-bad1-417a-aac7-3495d56d9f19 => generated 1407 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 03:47:15.041924 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-b9a83f54-9ca7-4d9c-9132-025388bae184 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:47:15.044922 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-b9a83f54-9ca7-4d9c-9132-025388bae184 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] [instance: 62affd75-bad1-417a-aac7-3495d56d9f19] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:47:15.052911 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-b9a83f54-9ca7-4d9c-9132-025388bae184 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:47:15.053598 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-b9a83f54-9ca7-4d9c-9132-025388bae184 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:47:15.054665 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-b9a83f54-9ca7-4d9c-9132-025388bae184 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:47:15.055135 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-b9a83f54-9ca7-4d9c-9132-025388bae184 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:47:15.193592 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-b9a83f54-9ca7-4d9c-9132-025388bae184 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:47:15.201899 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-b9a83f54-9ca7-4d9c-9132-025388bae184 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:47:15.203488 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-b9a83f54-9ca7-4d9c-9132-025388bae184 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:47:15.204597 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-b9a83f54-9ca7-4d9c-9132-025388bae184 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] 10.222.0.66 "GET /compute/v2.1/servers/62affd75-bad1-417a-aac7-3495d56d9f19" status: 200 len: 1407 microversion: 2.20 time: 0.167120 Aug 04 03:47:15.205157 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 450/904] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 03:47:15 2022] GET /compute/v2.1/servers/62affd75-bad1-417a-aac7-3495d56d9f19 => generated 1407 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 03:47:16.227577 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-97ba0cc3-7e34-4570-bc27-3ae9864e2212 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:47:16.228185 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-97ba0cc3-7e34-4570-bc27-3ae9864e2212 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] [instance: 62affd75-bad1-417a-aac7-3495d56d9f19] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:47:16.235789 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-97ba0cc3-7e34-4570-bc27-3ae9864e2212 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:47:16.236242 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-97ba0cc3-7e34-4570-bc27-3ae9864e2212 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:47:16.237010 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-97ba0cc3-7e34-4570-bc27-3ae9864e2212 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:47:16.237486 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-97ba0cc3-7e34-4570-bc27-3ae9864e2212 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:47:16.376221 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-97ba0cc3-7e34-4570-bc27-3ae9864e2212 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:47:16.386203 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-97ba0cc3-7e34-4570-bc27-3ae9864e2212 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:47:16.388043 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-97ba0cc3-7e34-4570-bc27-3ae9864e2212 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:47:16.389187 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-97ba0cc3-7e34-4570-bc27-3ae9864e2212 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] 10.222.0.66 "GET /compute/v2.1/servers/62affd75-bad1-417a-aac7-3495d56d9f19" status: 200 len: 1407 microversion: 2.20 time: 0.165610 Aug 04 03:47:16.389848 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 455/905] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 03:47:16 2022] GET /compute/v2.1/servers/62affd75-bad1-417a-aac7-3495d56d9f19 => generated 1407 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 03:47:17.412892 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-7a79b422-3b95-44e8-a1a8-9be2b395e98f tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:47:17.413525 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-7a79b422-3b95-44e8-a1a8-9be2b395e98f tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] [instance: 62affd75-bad1-417a-aac7-3495d56d9f19] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:47:17.419979 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-7a79b422-3b95-44e8-a1a8-9be2b395e98f tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:47:17.420435 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-7a79b422-3b95-44e8-a1a8-9be2b395e98f tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:47:17.421297 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-7a79b422-3b95-44e8-a1a8-9be2b395e98f tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:47:17.421739 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-7a79b422-3b95-44e8-a1a8-9be2b395e98f tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:47:17.454916 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG dbcounter [-] [130263] Writing DB stats nova_cell0:SELECT=2 {{(pid=130263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:47:17.475364 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG dbcounter [-] [130263] Writing DB stats nova_cell0:SELECT=6 {{(pid=130263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:47:17.514838 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [req-4c7076b1-47db-45dc-a0df-15db446980be req-7de457a6-6a20-4d34-b51b-c12dabf9e1db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62affd75-bad1-417a-aac7-3495d56d9f19", "name": "network-vif-plugged", "status": "completed", "tag": "de2fd866-0219-43e7-a73a-fd446fc3c7ba"}]} {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 03:47:17.527043 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [req-4c7076b1-47db-45dc-a0df-15db446980be req-7de457a6-6a20-4d34-b51b-c12dabf9e1db service nova] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:47:17.527484 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [req-4c7076b1-47db-45dc-a0df-15db446980be req-7de457a6-6a20-4d34-b51b-c12dabf9e1db service nova] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:47:17.538601 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.compute.server_external_events [req-4c7076b1-47db-45dc-a0df-15db446980be req-7de457a6-6a20-4d34-b51b-c12dabf9e1db service nova] Creating event network-vif-plugged:de2fd866-0219-43e7-a73a-fd446fc3c7ba for instance 62affd75-bad1-417a-aac7-3495d56d9f19 on hv-cinder-73306 Aug 04 03:47:17.543378 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [req-4c7076b1-47db-45dc-a0df-15db446980be req-7de457a6-6a20-4d34-b51b-c12dabf9e1db service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033768 Aug 04 03:47:17.544022 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 456/906] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 03:47:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 03:47:17.558335 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-7a79b422-3b95-44e8-a1a8-9be2b395e98f tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:47:17.567309 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-7a79b422-3b95-44e8-a1a8-9be2b395e98f tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:47:17.568877 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-7a79b422-3b95-44e8-a1a8-9be2b395e98f tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:47:17.570006 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-7a79b422-3b95-44e8-a1a8-9be2b395e98f tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] 10.222.0.66 "GET /compute/v2.1/servers/62affd75-bad1-417a-aac7-3495d56d9f19" status: 200 len: 1407 microversion: 2.20 time: 0.161110 Aug 04 03:47:17.570573 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 451/907] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 03:47:17 2022] GET /compute/v2.1/servers/62affd75-bad1-417a-aac7-3495d56d9f19 => generated 1407 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 03:47:18.590678 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG dbcounter [-] [130262] Writing DB stats nova_cell0:SELECT=6 {{(pid=130262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:47:18.595725 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-8e95077c-c55a-42a2-9703-dd847c5dca2a tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:47:18.596442 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-8e95077c-c55a-42a2-9703-dd847c5dca2a tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] [instance: 62affd75-bad1-417a-aac7-3495d56d9f19] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:47:18.602565 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-8e95077c-c55a-42a2-9703-dd847c5dca2a tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:47:18.603005 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-8e95077c-c55a-42a2-9703-dd847c5dca2a tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:47:18.603758 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-8e95077c-c55a-42a2-9703-dd847c5dca2a tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:47:18.604189 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-8e95077c-c55a-42a2-9703-dd847c5dca2a tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:47:18.743376 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-8e95077c-c55a-42a2-9703-dd847c5dca2a tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:47:18.752053 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-8e95077c-c55a-42a2-9703-dd847c5dca2a tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:47:18.753576 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-8e95077c-c55a-42a2-9703-dd847c5dca2a tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:47:18.754674 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-8e95077c-c55a-42a2-9703-dd847c5dca2a tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] 10.222.0.66 "GET /compute/v2.1/servers/62affd75-bad1-417a-aac7-3495d56d9f19" status: 200 len: 1407 microversion: 2.20 time: 0.164938 Aug 04 03:47:18.755228 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 457/908] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 03:47:18 2022] GET /compute/v2.1/servers/62affd75-bad1-417a-aac7-3495d56d9f19 => generated 1407 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 03:47:19.776982 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-0d98710a-7f15-4a35-b91f-97a120c63c42 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:47:19.777618 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-0d98710a-7f15-4a35-b91f-97a120c63c42 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] [instance: 62affd75-bad1-417a-aac7-3495d56d9f19] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:47:19.784149 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-0d98710a-7f15-4a35-b91f-97a120c63c42 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:47:19.784628 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-0d98710a-7f15-4a35-b91f-97a120c63c42 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:47:19.785418 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-0d98710a-7f15-4a35-b91f-97a120c63c42 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:47:19.785857 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-0d98710a-7f15-4a35-b91f-97a120c63c42 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:47:19.918270 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-0d98710a-7f15-4a35-b91f-97a120c63c42 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:47:19.927109 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-0d98710a-7f15-4a35-b91f-97a120c63c42 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:47:19.928665 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-0d98710a-7f15-4a35-b91f-97a120c63c42 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:47:19.929829 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-0d98710a-7f15-4a35-b91f-97a120c63c42 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] 10.222.0.66 "GET /compute/v2.1/servers/62affd75-bad1-417a-aac7-3495d56d9f19" status: 200 len: 1599 microversion: 2.20 time: 0.156788 Aug 04 03:47:19.930378 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 452/909] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 03:47:19 2022] GET /compute/v2.1/servers/62affd75-bad1-417a-aac7-3495d56d9f19 => generated 1599 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 03:47:19.951771 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-36d70244-b724-4768-a82f-0ac5585b80d2 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:47:19.952318 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-36d70244-b724-4768-a82f-0ac5585b80d2 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] [instance: 62affd75-bad1-417a-aac7-3495d56d9f19] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:47:19.958957 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-36d70244-b724-4768-a82f-0ac5585b80d2 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:47:19.959401 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-36d70244-b724-4768-a82f-0ac5585b80d2 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:47:19.960159 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-36d70244-b724-4768-a82f-0ac5585b80d2 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:47:19.960589 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-36d70244-b724-4768-a82f-0ac5585b80d2 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:47:20.038939 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-36d70244-b724-4768-a82f-0ac5585b80d2 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] 10.222.0.66 "GET /compute/v2.1/servers/62affd75-bad1-417a-aac7-3495d56d9f19/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.091019 Aug 04 03:47:20.039524 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 458/910] 10.222.0.66 () {60 vars in 1316 bytes} [Thu Aug 4 03:47:19 2022] GET /compute/v2.1/servers/62affd75-bad1-417a-aac7-3495d56d9f19/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 03:47:21.017722 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [req-b01329ea-0347-4482-a6e8-09a7cb3d8d1f req-3bc39d7f-a7c7-412f-a5d9-e47e68ce3765 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62affd75-bad1-417a-aac7-3495d56d9f19", "tag": "de2fd866-0219-43e7-a73a-fd446fc3c7ba"}]} {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 03:47:21.028222 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [req-b01329ea-0347-4482-a6e8-09a7cb3d8d1f req-3bc39d7f-a7c7-412f-a5d9-e47e68ce3765 service nova] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:47:21.028668 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [req-b01329ea-0347-4482-a6e8-09a7cb3d8d1f req-3bc39d7f-a7c7-412f-a5d9-e47e68ce3765 service nova] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:47:21.032583 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG dbcounter [-] [130263] Writing DB stats nova_cell1:SELECT=100 {{(pid=130263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:47:21.039852 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.compute.server_external_events [req-b01329ea-0347-4482-a6e8-09a7cb3d8d1f req-3bc39d7f-a7c7-412f-a5d9-e47e68ce3765 service nova] Creating event network-changed:de2fd866-0219-43e7-a73a-fd446fc3c7ba for instance 62affd75-bad1-417a-aac7-3495d56d9f19 on hv-cinder-73306 Aug 04 03:47:21.044889 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [req-b01329ea-0347-4482-a6e8-09a7cb3d8d1f req-3bc39d7f-a7c7-412f-a5d9-e47e68ce3765 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031249 Aug 04 03:47:21.045522 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 453/911] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 03:47:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 03:47:56.310327 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG dbcounter [-] [130262] Writing DB stats nova_api:SELECT=15 {{(pid=130262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:47:56.311429 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG dbcounter [-] [130262] Writing DB stats nova_cell1:SELECT=42 {{(pid=130262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:47:56.312343 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG dbcounter [-] [130263] Writing DB stats nova_api:SELECT=11 {{(pid=130263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:47:56.315464 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-adedd20e-d248-418d-910e-65638e2c152c tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:47:56.315967 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-adedd20e-d248-418d-910e-65638e2c152c tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] [instance: d097d81a-1bae-45f2-a34f-444776c8e1cb] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:47:56.317345 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [req-a6248a0a-279e-41d7-999f-9e680ad00257 req-1c13c44c-55f4-4e42-a714-c2cb04862ed6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d097d81a-1bae-45f2-a34f-444776c8e1cb", "tag": "118548b5-15c3-4cd8-ab62-4c3490efe26d"}]} {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 03:47:56.323002 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-adedd20e-d248-418d-910e-65638e2c152c tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:47:56.323313 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-adedd20e-d248-418d-910e-65638e2c152c tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:47:56.324086 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-adedd20e-d248-418d-910e-65638e2c152c tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:47:56.324740 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-adedd20e-d248-418d-910e-65638e2c152c tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:47:56.329018 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [req-a6248a0a-279e-41d7-999f-9e680ad00257 req-1c13c44c-55f4-4e42-a714-c2cb04862ed6 service nova] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:47:56.329479 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [req-a6248a0a-279e-41d7-999f-9e680ad00257 req-1c13c44c-55f4-4e42-a714-c2cb04862ed6 service nova] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:47:56.342042 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.compute.server_external_events [req-a6248a0a-279e-41d7-999f-9e680ad00257 req-1c13c44c-55f4-4e42-a714-c2cb04862ed6 service nova] Creating event network-changed:118548b5-15c3-4cd8-ab62-4c3490efe26d for instance d097d81a-1bae-45f2-a34f-444776c8e1cb on hv-cinder-73306 Aug 04 03:47:56.347560 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [req-a6248a0a-279e-41d7-999f-9e680ad00257 req-1c13c44c-55f4-4e42-a714-c2cb04862ed6 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036684 Aug 04 03:47:56.351614 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 454/912] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 03:47:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 03:47:56.357499 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-adedd20e-d248-418d-910e-65638e2c152c tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] [instance: d097d81a-1bae-45f2-a34f-444776c8e1cb] Going to try to terminate instance {{(pid=130262) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 03:47:56.674066 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-adedd20e-d248-418d-910e-65638e2c152c tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] 10.222.0.66 "DELETE /compute/v2.1/servers/d097d81a-1bae-45f2-a34f-444776c8e1cb" status: 204 len: 0 microversion: 2.1 time: 0.365286 Aug 04 03:47:56.675196 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 459/913] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 03:47:56 2022] DELETE /compute/v2.1/servers/d097d81a-1bae-45f2-a34f-444776c8e1cb => generated 0 bytes in 368 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 03:47:56.687983 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-1b018364-d592-456b-b677-3a7bcf19fa33 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:47:56.688912 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-1b018364-d592-456b-b677-3a7bcf19fa33 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] [instance: d097d81a-1bae-45f2-a34f-444776c8e1cb] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:47:56.697642 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-1b018364-d592-456b-b677-3a7bcf19fa33 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:47:56.698089 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-1b018364-d592-456b-b677-3a7bcf19fa33 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:47:56.698899 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-1b018364-d592-456b-b677-3a7bcf19fa33 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:47:56.699333 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-1b018364-d592-456b-b677-3a7bcf19fa33 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:47:56.854487 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-1b018364-d592-456b-b677-3a7bcf19fa33 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc12077b11448a3b1ec2e7dbf2707ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf95e3e43d0e482ba4d27b769fb48628', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:47:56.862475 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-1b018364-d592-456b-b677-3a7bcf19fa33 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] 10.222.0.66 "GET /compute/v2.1/servers/d097d81a-1bae-45f2-a34f-444776c8e1cb" status: 200 len: 1566 microversion: 2.1 time: 0.181438 Aug 04 03:47:56.864041 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 455/914] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:47:56 2022] GET /compute/v2.1/servers/d097d81a-1bae-45f2-a34f-444776c8e1cb => generated 1566 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:47:57.884905 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-a23b06fc-a31f-41e2-b85d-4800521ba3ea tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:47:57.885618 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-a23b06fc-a31f-41e2-b85d-4800521ba3ea tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] [instance: d097d81a-1bae-45f2-a34f-444776c8e1cb] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:47:57.892020 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-a23b06fc-a31f-41e2-b85d-4800521ba3ea tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:47:57.892463 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-a23b06fc-a31f-41e2-b85d-4800521ba3ea tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:47:57.893241 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-a23b06fc-a31f-41e2-b85d-4800521ba3ea tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:47:57.893670 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-a23b06fc-a31f-41e2-b85d-4800521ba3ea tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:47:58.114557 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-a23b06fc-a31f-41e2-b85d-4800521ba3ea tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc12077b11448a3b1ec2e7dbf2707ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf95e3e43d0e482ba4d27b769fb48628', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:47:58.122578 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-a23b06fc-a31f-41e2-b85d-4800521ba3ea tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] 10.222.0.66 "GET /compute/v2.1/servers/d097d81a-1bae-45f2-a34f-444776c8e1cb" status: 200 len: 1566 microversion: 2.1 time: 0.242620 Aug 04 03:47:58.123157 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 460/915] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:47:57 2022] GET /compute/v2.1/servers/d097d81a-1bae-45f2-a34f-444776c8e1cb => generated 1566 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:47:59.094465 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [req-93aeb624-a212-4a85-9687-30ea20f65fdd req-148ad5a4-da6b-4a5f-8fc8-b9bf1a5951a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d097d81a-1bae-45f2-a34f-444776c8e1cb", "name": "network-vif-deleted", "tag": "118548b5-15c3-4cd8-ab62-4c3490efe26d"}]} {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 03:47:59.104439 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [req-93aeb624-a212-4a85-9687-30ea20f65fdd req-148ad5a4-da6b-4a5f-8fc8-b9bf1a5951a5 service nova] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:47:59.104897 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [req-93aeb624-a212-4a85-9687-30ea20f65fdd req-148ad5a4-da6b-4a5f-8fc8-b9bf1a5951a5 service nova] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:47:59.121039 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.compute.server_external_events [req-93aeb624-a212-4a85-9687-30ea20f65fdd req-148ad5a4-da6b-4a5f-8fc8-b9bf1a5951a5 service nova] Creating event network-vif-deleted:118548b5-15c3-4cd8-ab62-4c3490efe26d for instance d097d81a-1bae-45f2-a34f-444776c8e1cb on hv-cinder-73306 Aug 04 03:47:59.121486 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [req-93aeb624-a212-4a85-9687-30ea20f65fdd req-148ad5a4-da6b-4a5f-8fc8-b9bf1a5951a5 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030657 Aug 04 03:47:59.122061 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 456/916] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 03:47:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 03:47:59.143634 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-4d43336a-24c9-4970-9c5b-8400cfd1ab61 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:47:59.144281 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-4d43336a-24c9-4970-9c5b-8400cfd1ab61 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] [instance: d097d81a-1bae-45f2-a34f-444776c8e1cb] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:47:59.151160 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-4d43336a-24c9-4970-9c5b-8400cfd1ab61 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:47:59.151602 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-4d43336a-24c9-4970-9c5b-8400cfd1ab61 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:47:59.152356 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-4d43336a-24c9-4970-9c5b-8400cfd1ab61 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:47:59.152785 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-4d43336a-24c9-4970-9c5b-8400cfd1ab61 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:47:59.215674 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-4d43336a-24c9-4970-9c5b-8400cfd1ab61 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc12077b11448a3b1ec2e7dbf2707ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf95e3e43d0e482ba4d27b769fb48628', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:47:59.223254 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-4d43336a-24c9-4970-9c5b-8400cfd1ab61 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] 10.222.0.66 "GET /compute/v2.1/servers/d097d81a-1bae-45f2-a34f-444776c8e1cb" status: 200 len: 1380 microversion: 2.1 time: 0.083507 Aug 04 03:47:59.223819 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 461/917] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:47:59 2022] GET /compute/v2.1/servers/d097d81a-1bae-45f2-a34f-444776c8e1cb => generated 1380 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:48:00.245144 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-d1eefd05-8743-4a95-b37d-64f6fb163ae8 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:48:00.245896 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-d1eefd05-8743-4a95-b37d-64f6fb163ae8 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] [instance: d097d81a-1bae-45f2-a34f-444776c8e1cb] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:48:00.252597 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-d1eefd05-8743-4a95-b37d-64f6fb163ae8 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:48:00.254297 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-d1eefd05-8743-4a95-b37d-64f6fb163ae8 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:48:00.254297 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-d1eefd05-8743-4a95-b37d-64f6fb163ae8 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:48:00.254488 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-d1eefd05-8743-4a95-b37d-64f6fb163ae8 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:48:00.285596 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-d1eefd05-8743-4a95-b37d-64f6fb163ae8 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:48:00.285992 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-d1eefd05-8743-4a95-b37d-64f6fb163ae8 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:48:00.286425 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.objects.instance [None req-d1eefd05-8743-4a95-b37d-64f6fb163ae8 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lazy-loading 'fault' on Instance uuid d097d81a-1bae-45f2-a34f-444776c8e1cb {{(pid=130263) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 03:48:00.327774 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-d1eefd05-8743-4a95-b37d-64f6fb163ae8 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dcc12077b11448a3b1ec2e7dbf2707ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf95e3e43d0e482ba4d27b769fb48628', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:48:00.335344 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-d1eefd05-8743-4a95-b37d-64f6fb163ae8 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] 10.222.0.66 "GET /compute/v2.1/servers/d097d81a-1bae-45f2-a34f-444776c8e1cb" status: 200 len: 1223 microversion: 2.1 time: 0.095104 Aug 04 03:48:00.335968 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 457/918] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:48:00 2022] GET /compute/v2.1/servers/d097d81a-1bae-45f2-a34f-444776c8e1cb => generated 1223 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:48:01.359183 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-1f512fab-0fd2-438c-b50c-a55e669d6157 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:48:01.359796 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-1f512fab-0fd2-438c-b50c-a55e669d6157 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] [instance: d097d81a-1bae-45f2-a34f-444776c8e1cb] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:48:01.366286 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-1f512fab-0fd2-438c-b50c-a55e669d6157 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:48:01.366867 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-1f512fab-0fd2-438c-b50c-a55e669d6157 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:48:01.367632 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-1f512fab-0fd2-438c-b50c-a55e669d6157 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:48:01.368074 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-1f512fab-0fd2-438c-b50c-a55e669d6157 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:48:01.381400 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.wsgi [None req-1f512fab-0fd2-438c-b50c-a55e669d6157 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] HTTP exception thrown: Instance d097d81a-1bae-45f2-a34f-444776c8e1cb could not be found. Aug 04 03:48:01.383021 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-1f512fab-0fd2-438c-b50c-a55e669d6157 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Request method failure captured: Aug 04 03:48:01.383021 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: request: GET /compute/v2.1/servers/d097d81a-1bae-45f2-a34f-444776c8e1cb HTTP/1.1 Aug 04 03:48:01.383021 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: Accept: application/json Aug 04 03:48:01.383021 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: Accept-Encoding: identity Aug 04 03:48:01.383021 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: Connection: close Aug 04 03:48:01.383021 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: Content-Length: 0 Aug 04 03:48:01.383021 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: Content-Type: application/json Aug 04 03:48:01.383021 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: Host: 10.222.0.66 Aug 04 03:48:01.383021 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: Openstack-System-Scope: None Aug 04 03:48:01.383021 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: User-Agent: python-urllib3/1.26.11 Aug 04 03:48:01.383021 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Auth-Token: gAAAAABi6z_2E2SGyaYSr7MzNT5C9-MCYqIoV0wi0CabApO8vUrD4O2IV_clLUA5fkHm424vzBUqs4IKOqIwRzDe1EdEHFFf1sCnHfBorTfpwWqWQ3O67EwglISLf8-PkrLBvhFT_CKyOcHDOjVzX3iOEVhU8wKQL3dJp3jAIcRtD7YfKW-WA8c Aug 04 03:48:01.383021 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Domain-Id: None Aug 04 03:48:01.383021 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Domain-Name: None Aug 04 03:48:01.383021 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Identity-Status: Confirmed Aug 04 03:48:01.383021 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Is-Admin-Project: True Aug 04 03:48:01.383021 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Project-Domain-Id: default Aug 04 03:48:01.383021 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Project-Domain-Name: Default Aug 04 03:48:01.383021 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Project-Id: cf95e3e43d0e482ba4d27b769fb48628 Aug 04 03:48:01.383021 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Project-Name: tempest-TestShelveInstance-919494608 Aug 04 03:48:01.383021 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Role: member,reader Aug 04 03:48:01.383021 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Roles: member,reader Aug 04 03:48:01.384657 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/cf95e3e43d0e482ba4d27b769fb48628"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/cf95e3e43d0e482ba4d27b769fb48628"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/cf95e3e43d0e482ba4d27b769fb48628"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_cf95e3e43d0e482ba4d27b769fb48628"}]}] Aug 04 03:48:01.384657 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Tenant: tempest-TestShelveInstance-919494608 Aug 04 03:48:01.384657 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Tenant-Id: cf95e3e43d0e482ba4d27b769fb48628 Aug 04 03:48:01.384657 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Tenant-Name: tempest-TestShelveInstance-919494608 Aug 04 03:48:01.384657 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-User: tempest-TestShelveInstance-919494608-project Aug 04 03:48:01.384657 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-User-Domain-Id: default Aug 04 03:48:01.384657 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-User-Domain-Name: Default Aug 04 03:48:01.384657 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-User-Id: dcc12077b11448a3b1ec2e7dbf2707ef Aug 04 03:48:01.384657 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-User-Name: tempest-TestShelveInstance-919494608-project Aug 04 03:48:01.384657 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: method: > Aug 04 03:48:01.384657 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: exception: Instance d097d81a-1bae-45f2-a34f-444776c8e1cb could not be found. Aug 04 03:48:01.384657 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: action_args: {'id': 'd097d81a-1bae-45f2-a34f-444776c8e1cb'} Aug 04 03:48:01.385628 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 03:48:01.385628 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 03:48:01.385628 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 03:48:01.385628 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 03:48:01.385628 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 03:48:01.385628 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 03:48:01.385628 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 03:48:01.385628 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 03:48:01.385628 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 03:48:01.385628 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 03:48:01.385628 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d097d81a-1bae-45f2-a34f-444776c8e1cb could not be found. Aug 04 03:48:01.385628 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi Aug 04 03:48:01.385628 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 03:48:01.385628 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi Aug 04 03:48:01.385628 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 03:48:01.385628 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 03:48:01.385628 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 03:48:01.385628 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 03:48:01.385628 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 03:48:01.385628 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 03:48:01.386903 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 03:48:01.386903 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 03:48:01.386903 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 03:48:01.386903 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 03:48:01.386903 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 03:48:01.386903 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 03:48:01.386903 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 03:48:01.386903 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d097d81a-1bae-45f2-a34f-444776c8e1cb could not be found. Aug 04 03:48:01.386903 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi Aug 04 03:48:01.386903 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 03:48:01.386903 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi Aug 04 03:48:01.386903 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 03:48:01.386903 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 03:48:01.386903 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 03:48:01.386903 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 03:48:01.386903 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 03:48:01.386903 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d097d81a-1bae-45f2-a34f-444776c8e1cb could not be found. Aug 04 03:48:01.386903 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi Aug 04 03:48:01.388016 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-1f512fab-0fd2-438c-b50c-a55e669d6157 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Returning 404 to user: Instance d097d81a-1bae-45f2-a34f-444776c8e1cb could not be found. {{(pid=130262) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 03:48:01.388016 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-1f512fab-0fd2-438c-b50c-a55e669d6157 tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] 10.222.0.66 "GET /compute/v2.1/servers/d097d81a-1bae-45f2-a34f-444776c8e1cb" status: 404 len: 111 microversion: 2.1 time: 0.029436 Aug 04 03:48:01.388016 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 462/919] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:48:01 2022] GET /compute/v2.1/servers/d097d81a-1bae-45f2-a34f-444776c8e1cb => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 03:48:01.620785 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-0fbbda14-8703-4007-8c27-6866d60cb99b tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] Calling method '.version_select at 0x7f72e2f15a60>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:48:01.703016 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-0fbbda14-8703-4007-8c27-6866d60cb99b tempest-TestShelveInstance-919494608 tempest-TestShelveInstance-919494608-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1601506750" status: 202 len: 0 microversion: 2.1 time: 0.086115 Aug 04 03:48:01.703602 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 458/920] 10.222.0.66 () {58 vars in 1254 bytes} [Thu Aug 4 03:48:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1601506750 => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 03:48:31.006289 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-d67d9f98-65af-4f26-bded-e1148bb4a56e tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:48:31.006839 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-d67d9f98-65af-4f26-bded-e1148bb4a56e tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] [instance: 221108c9-a4b6-4e41-a9e5-a4e1461c991d] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:48:31.009186 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG dbcounter [-] [130262] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=130262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:48:31.009818 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG dbcounter [-] [130262] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:48:31.014630 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-d67d9f98-65af-4f26-bded-e1148bb4a56e tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:48:31.015114 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-d67d9f98-65af-4f26-bded-e1148bb4a56e tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:48:31.016226 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-d67d9f98-65af-4f26-bded-e1148bb4a56e tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:48:31.016669 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-d67d9f98-65af-4f26-bded-e1148bb4a56e tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:48:31.040212 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-d67d9f98-65af-4f26-bded-e1148bb4a56e tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] 10.222.0.66 "GET /compute/v2.1/servers/221108c9-a4b6-4e41-a9e5-a4e1461c991d/ips" status: 200 len: 146 microversion: 2.1 time: 0.037727 Aug 04 03:48:31.043969 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 463/921] 10.222.0.66 () {58 vars in 1248 bytes} [Thu Aug 4 03:48:31 2022] GET /compute/v2.1/servers/221108c9-a4b6-4e41-a9e5-a4e1461c991d/ips => generated 146 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 03:48:32.643330 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG dbcounter [-] [130263] Writing DB stats nova_cell1:SELECT=18 {{(pid=130263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:48:32.644172 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG dbcounter [-] [130263] Writing DB stats nova_api:SELECT=13,nova_api:DELETE=1 {{(pid=130263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:48:32.648344 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-8fb2ec82-3fc2-4162-b45f-15441eeedbdb tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "207a5bd2-15d4-4a56-a8d8-7f2600c4a0e9"}} {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 03:48:32.651301 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-8fb2ec82-3fc2-4162-b45f-15441eeedbdb tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] [instance: 221108c9-a4b6-4e41-a9e5-a4e1461c991d] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:48:32.660022 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-8fb2ec82-3fc2-4162-b45f-15441eeedbdb tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:48:32.660482 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-8fb2ec82-3fc2-4162-b45f-15441eeedbdb tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:48:32.661286 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-8fb2ec82-3fc2-4162-b45f-15441eeedbdb tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:48:32.661737 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-8fb2ec82-3fc2-4162-b45f-15441eeedbdb tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:48:33.407601 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-8fb2ec82-3fc2-4162-b45f-15441eeedbdb tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] 10.222.0.66 "POST /compute/v2.1/servers/221108c9-a4b6-4e41-a9e5-a4e1461c991d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.765479 Aug 04 03:48:33.408240 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 459/922] 10.222.0.66 () {60 vars in 1323 bytes} [Thu Aug 4 03:48:32 2022] POST /compute/v2.1/servers/221108c9-a4b6-4e41-a9e5-a4e1461c991d/os-volume_attachments => generated 194 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 03:48:36.431096 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-6a45af27-32c4-4bb6-a08f-71feba32f86d tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:48:36.431857 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-6a45af27-32c4-4bb6-a08f-71feba32f86d tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] [instance: 2ed39450-289e-4d51-b1b0-c5fe323e6201] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:48:36.439629 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-6a45af27-32c4-4bb6-a08f-71feba32f86d tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:48:36.440071 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-6a45af27-32c4-4bb6-a08f-71feba32f86d tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:48:36.440819 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-6a45af27-32c4-4bb6-a08f-71feba32f86d tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:48:36.441286 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-6a45af27-32c4-4bb6-a08f-71feba32f86d tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:48:36.464838 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-6a45af27-32c4-4bb6-a08f-71feba32f86d tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] 10.222.0.66 "GET /compute/v2.1/servers/2ed39450-289e-4d51-b1b0-c5fe323e6201/ips" status: 200 len: 150 microversion: 2.1 time: 0.038535 Aug 04 03:48:36.465419 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 464/923] 10.222.0.66 () {58 vars in 1248 bytes} [Thu Aug 4 03:48:36 2022] GET /compute/v2.1/servers/2ed39450-289e-4d51-b1b0-c5fe323e6201/ips => generated 150 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 03:48:38.111750 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-3fdfafdb-fdad-4719-b039-ea583c0ad9c0 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "45e6b8e9-4b14-4d48-b367-90f347efc55e"}} {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 03:48:38.114319 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-3fdfafdb-fdad-4719-b039-ea583c0ad9c0 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] [instance: 2ed39450-289e-4d51-b1b0-c5fe323e6201] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:48:38.120789 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-3fdfafdb-fdad-4719-b039-ea583c0ad9c0 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:48:38.121258 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-3fdfafdb-fdad-4719-b039-ea583c0ad9c0 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:48:38.122500 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-3fdfafdb-fdad-4719-b039-ea583c0ad9c0 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:48:38.122500 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-3fdfafdb-fdad-4719-b039-ea583c0ad9c0 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:48:38.830443 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-3fdfafdb-fdad-4719-b039-ea583c0ad9c0 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] 10.222.0.66 "POST /compute/v2.1/servers/2ed39450-289e-4d51-b1b0-c5fe323e6201/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.723199 Aug 04 03:48:38.831037 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 460/924] 10.222.0.66 () {60 vars in 1323 bytes} [Thu Aug 4 03:48:38 2022] POST /compute/v2.1/servers/2ed39450-289e-4d51-b1b0-c5fe323e6201/os-volume_attachments => generated 194 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 03:48:40.934271 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-81ac7d48-34b0-49cb-be34-c10d0f78407d tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:48:40.936541 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-81ac7d48-34b0-49cb-be34-c10d0f78407d tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] [instance: 221108c9-a4b6-4e41-a9e5-a4e1461c991d] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:48:40.944368 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-81ac7d48-34b0-49cb-be34-c10d0f78407d tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:48:40.944893 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-81ac7d48-34b0-49cb-be34-c10d0f78407d tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:48:40.945784 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-81ac7d48-34b0-49cb-be34-c10d0f78407d tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:48:40.946289 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-81ac7d48-34b0-49cb-be34-c10d0f78407d tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:48:40.978169 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-81ac7d48-34b0-49cb-be34-c10d0f78407d tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] 10.222.0.66 "GET /compute/v2.1/servers/221108c9-a4b6-4e41-a9e5-a4e1461c991d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048645 Aug 04 03:48:40.979634 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 465/925] 10.222.0.66 () {58 vars in 1302 bytes} [Thu Aug 4 03:48:40 2022] GET /compute/v2.1/servers/221108c9-a4b6-4e41-a9e5-a4e1461c991d/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 03:48:40.992096 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-22bc1e87-2cfe-4927-a5d1-563eb2f8c445 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:48:40.992096 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-22bc1e87-2cfe-4927-a5d1-563eb2f8c445 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] [instance: 221108c9-a4b6-4e41-a9e5-a4e1461c991d] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:48:40.998762 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-22bc1e87-2cfe-4927-a5d1-563eb2f8c445 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:48:40.999211 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-22bc1e87-2cfe-4927-a5d1-563eb2f8c445 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:48:40.999991 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-22bc1e87-2cfe-4927-a5d1-563eb2f8c445 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:48:41.000425 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-22bc1e87-2cfe-4927-a5d1-563eb2f8c445 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:48:41.029946 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-22bc1e87-2cfe-4927-a5d1-563eb2f8c445 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] 10.222.0.66 "GET /compute/v2.1/servers/221108c9-a4b6-4e41-a9e5-a4e1461c991d/os-volume_attachments/207a5bd2-15d4-4a56-a8d8-7f2600c4a0e9" status: 200 len: 194 microversion: 2.1 time: 0.043389 Aug 04 03:48:41.030525 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 461/926] 10.222.0.66 () {58 vars in 1413 bytes} [Thu Aug 4 03:48:40 2022] GET /compute/v2.1/servers/221108c9-a4b6-4e41-a9e5-a4e1461c991d/os-volume_attachments/207a5bd2-15d4-4a56-a8d8-7f2600c4a0e9 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 03:48:42.639289 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-197e205a-f52d-4ccb-b66c-d4c7e5a3b6e3 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "647b70af-b9d5-4482-bc34-b1a58d472bb3"}} {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 03:48:42.641631 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-197e205a-f52d-4ccb-b66c-d4c7e5a3b6e3 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] [instance: 221108c9-a4b6-4e41-a9e5-a4e1461c991d] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:48:42.648321 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-197e205a-f52d-4ccb-b66c-d4c7e5a3b6e3 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:48:42.651096 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-197e205a-f52d-4ccb-b66c-d4c7e5a3b6e3 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:48:42.651096 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-197e205a-f52d-4ccb-b66c-d4c7e5a3b6e3 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:48:42.651096 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-197e205a-f52d-4ccb-b66c-d4c7e5a3b6e3 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:48:43.395436 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-197e205a-f52d-4ccb-b66c-d4c7e5a3b6e3 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] 10.222.0.66 "POST /compute/v2.1/servers/221108c9-a4b6-4e41-a9e5-a4e1461c991d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.760395 Aug 04 03:48:43.396037 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 466/927] 10.222.0.66 () {60 vars in 1323 bytes} [Thu Aug 4 03:48:42 2022] POST /compute/v2.1/servers/221108c9-a4b6-4e41-a9e5-a4e1461c991d/os-volume_attachments => generated 194 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 03:48:48.483774 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-70f5a131-7539-4f23-8215-a287be92577f tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Action: 'create', calling method: .version_select at 0x7f72e80e30d0>, body: {"keypair": {"name": "tempest-keypair-2099035121", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJeOcPJGU0o2kG8HVcnF2uYLxpIyD4nP3885TRVoibjUV5ECXO4kUxhFO5udirENTRs0tycYALie408sWZC7Bg5E7id797lVJN1s7ikRlBhAn4eKwt5GTr6Bk3qhDSta5w=="}} {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 03:48:48.503258 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.quota [None req-70f5a131-7539-4f23-8215-a287be92577f tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Getting quotas for project a98f18ee8c7d4cfe9f4b879505ca6605. Resources: {'key_pairs'} {{(pid=130263) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 03:48:48.507251 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.quota [None req-70f5a131-7539-4f23-8215-a287be92577f tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Getting quotas for user ac99f60384fe4a119d019cedfe1d3557 and project a98f18ee8c7d4cfe9f4b879505ca6605. Resources: {'key_pairs'} {{(pid=130263) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 03:48:48.615983 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-70f5a131-7539-4f23-8215-a287be92577f tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.137570 Aug 04 03:48:48.616623 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 462/928] 10.222.0.66 () {60 vars in 1159 bytes} [Thu Aug 4 03:48:48 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 03:48:50.521662 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-31fa042c-611e-4a69-bc21-5518ae48ab21 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:48:50.522244 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-31fa042c-611e-4a69-bc21-5518ae48ab21 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] [instance: 62affd75-bad1-417a-aac7-3495d56d9f19] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:48:50.529730 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-31fa042c-611e-4a69-bc21-5518ae48ab21 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:48:50.530188 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-31fa042c-611e-4a69-bc21-5518ae48ab21 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:48:50.530961 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-31fa042c-611e-4a69-bc21-5518ae48ab21 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:48:50.531404 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-31fa042c-611e-4a69-bc21-5518ae48ab21 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:48:50.556319 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-31fa042c-611e-4a69-bc21-5518ae48ab21 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] 10.222.0.66 "GET /compute/v2.1/servers/62affd75-bad1-417a-aac7-3495d56d9f19/ips" status: 200 len: 152 microversion: 2.20 time: 0.039324 Aug 04 03:48:50.556894 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 467/929] 10.222.0.66 () {60 vars in 1289 bytes} [Thu Aug 4 03:48:50 2022] GET /compute/v2.1/servers/62affd75-bad1-417a-aac7-3495d56d9f19/ips => generated 152 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 03:48:51.113827 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-8da2735b-3ad4-453a-ac79-cc5b690eb823 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1984470516", "imageRef": "0208f4b3-1d2f-42e4-a9b4-528bf5066fe1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9a7b7e8a-baf9-483b-925f-a5723b52bbe6"}], "security_groups": [{"name": "tempest-securitygroup--1212617663"}], "key_name": "tempest-keypair-2099035121", "user_data": "}} {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 03:48:51.124702 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG dbcounter [-] [130263] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=130263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:48:51.223427 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.network.neutron [None req-8da2735b-3ad4-453a-ac79-cc5b690eb823 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] validate_networks() for [('9a7b7e8a-baf9-483b-925f-a5723b52bbe6', None, None, None, None, None)] {{(pid=130263) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 03:48:51.600104 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.virt.hardware [None req-8da2735b-3ad4-453a-ac79-cc5b690eb823 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Flavor limits 0:0:0 {{(pid=130263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 03:48:51.600533 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.virt.hardware [None req-8da2735b-3ad4-453a-ac79-cc5b690eb823 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Image limits 0:0:0 {{(pid=130263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 03:48:51.601013 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.virt.hardware [None req-8da2735b-3ad4-453a-ac79-cc5b690eb823 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Flavor pref 0:0:0 {{(pid=130263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 03:48:51.601458 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.virt.hardware [None req-8da2735b-3ad4-453a-ac79-cc5b690eb823 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Image pref 0:0:0 {{(pid=130263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 03:48:51.601876 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.virt.hardware [None req-8da2735b-3ad4-453a-ac79-cc5b690eb823 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 03:48:51.611594 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-8da2735b-3ad4-453a-ac79-cc5b690eb823 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:48:51.612049 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-8da2735b-3ad4-453a-ac79-cc5b690eb823 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:48:51.612857 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-8da2735b-3ad4-453a-ac79-cc5b690eb823 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:48:51.613331 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-8da2735b-3ad4-453a-ac79-cc5b690eb823 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:48:51.629801 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.quota [None req-8da2735b-3ad4-453a-ac79-cc5b690eb823 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Getting quotas for project a98f18ee8c7d4cfe9f4b879505ca6605. Resources: {'instances', 'ram', 'cores'} {{(pid=130263) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 03:48:51.633743 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.quota [None req-8da2735b-3ad4-453a-ac79-cc5b690eb823 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Getting quotas for user ac99f60384fe4a119d019cedfe1d3557 and project a98f18ee8c7d4cfe9f4b879505ca6605. Resources: {'instances', 'ram', 'cores'} {{(pid=130263) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 03:48:51.644632 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-8da2735b-3ad4-453a-ac79-cc5b690eb823 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Going to run 1 instances... {{(pid=130263) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 03:48:51.646895 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-8da2735b-3ad4-453a-ac79-cc5b690eb823 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] [instance: edb69fe3-e255-4e54-8e08-fff8bbc28d4f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0208f4b3-1d2f-42e4-a9b4-528bf5066fe1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130263) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 03:48:51.758595 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-8da2735b-3ad4-453a-ac79-cc5b690eb823 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.649326 Aug 04 03:48:51.759161 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 463/930] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 03:48:51 2022] POST /compute/v2.1/servers => generated 402 bytes in 651 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 03:48:51.769817 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-632caa2d-5c41-47ff-ac1f-377f04b5b4ad tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:48:51.770437 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-632caa2d-5c41-47ff-ac1f-377f04b5b4ad tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] [instance: edb69fe3-e255-4e54-8e08-fff8bbc28d4f] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:48:51.828265 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-632caa2d-5c41-47ff-ac1f-377f04b5b4ad tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac99f60384fe4a119d019cedfe1d3557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f18ee8c7d4cfe9f4b879505ca6605', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:48:51.834836 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-632caa2d-5c41-47ff-ac1f-377f04b5b4ad tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] 10.222.0.66 "GET /compute/v2.1/servers/edb69fe3-e255-4e54-8e08-fff8bbc28d4f" status: 200 len: 1242 microversion: 2.1 time: 0.068818 Aug 04 03:48:51.845835 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 468/931] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:48:51 2022] GET /compute/v2.1/servers/edb69fe3-e255-4e54-8e08-fff8bbc28d4f => generated 1242 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:48:52.651819 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-309fa973-7e46-4fac-a2bd-770fdb6e29a8 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 03:48:52.652469 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-309fa973-7e46-4fac-a2bd-770fdb6e29a8 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] [instance: 62affd75-bad1-417a-aac7-3495d56d9f19] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:48:52.659512 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-309fa973-7e46-4fac-a2bd-770fdb6e29a8 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:48:52.659963 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-309fa973-7e46-4fac-a2bd-770fdb6e29a8 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:48:52.660727 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-309fa973-7e46-4fac-a2bd-770fdb6e29a8 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:48:52.661170 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-309fa973-7e46-4fac-a2bd-770fdb6e29a8 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:48:52.685681 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.objects.instance [None req-309fa973-7e46-4fac-a2bd-770fdb6e29a8 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lazy-loading 'flavor' on Instance uuid 62affd75-bad1-417a-aac7-3495d56d9f19 {{(pid=130263) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 03:48:52.856552 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-2875426d-3149-4696-b7cd-a320ba3e4f04 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:48:52.857154 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-2875426d-3149-4696-b7cd-a320ba3e4f04 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] [instance: edb69fe3-e255-4e54-8e08-fff8bbc28d4f] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:48:52.864128 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-2875426d-3149-4696-b7cd-a320ba3e4f04 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:48:52.864580 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-2875426d-3149-4696-b7cd-a320ba3e4f04 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:48:52.865370 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-2875426d-3149-4696-b7cd-a320ba3e4f04 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:48:52.865808 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-2875426d-3149-4696-b7cd-a320ba3e4f04 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:48:52.929430 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-2875426d-3149-4696-b7cd-a320ba3e4f04 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac99f60384fe4a119d019cedfe1d3557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f18ee8c7d4cfe9f4b879505ca6605', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:48:52.941143 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-2875426d-3149-4696-b7cd-a320ba3e4f04 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] 10.222.0.66 "GET /compute/v2.1/servers/edb69fe3-e255-4e54-8e08-fff8bbc28d4f" status: 200 len: 1246 microversion: 2.1 time: 0.089123 Aug 04 03:48:52.941748 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 469/932] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:48:52 2022] GET /compute/v2.1/servers/edb69fe3-e255-4e54-8e08-fff8bbc28d4f => generated 1246 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 03:48:53.260245 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-309fa973-7e46-4fac-a2bd-770fdb6e29a8 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] 10.222.0.66 "POST /compute/v2.1/servers/62affd75-bad1-417a-aac7-3495d56d9f19/action" status: 202 len: 0 microversion: 2.20 time: 0.612638 Aug 04 03:48:53.260881 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 464/933] 10.222.0.66 () {62 vars in 1319 bytes} [Thu Aug 4 03:48:52 2022] POST /compute/v2.1/servers/62affd75-bad1-417a-aac7-3495d56d9f19/action => generated 0 bytes in 614 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 04 03:48:53.271559 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-a9bca76a-d09f-4482-8d99-2781879dd7dd tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:48:53.276219 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-a9bca76a-d09f-4482-8d99-2781879dd7dd tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] [instance: 62affd75-bad1-417a-aac7-3495d56d9f19] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:48:53.279193 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-a9bca76a-d09f-4482-8d99-2781879dd7dd tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:48:53.279639 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-a9bca76a-d09f-4482-8d99-2781879dd7dd tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:48:53.280401 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-a9bca76a-d09f-4482-8d99-2781879dd7dd tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:48:53.280831 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-a9bca76a-d09f-4482-8d99-2781879dd7dd tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:48:53.414564 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-a9bca76a-d09f-4482-8d99-2781879dd7dd tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:48:53.423020 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-a9bca76a-d09f-4482-8d99-2781879dd7dd tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:48:53.424577 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-a9bca76a-d09f-4482-8d99-2781879dd7dd tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:48:53.425800 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-a9bca76a-d09f-4482-8d99-2781879dd7dd tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] 10.222.0.66 "GET /compute/v2.1/servers/62affd75-bad1-417a-aac7-3495d56d9f19" status: 200 len: 1724 microversion: 2.20 time: 0.159194 Aug 04 03:48:53.426288 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 470/934] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 03:48:53 2022] GET /compute/v2.1/servers/62affd75-bad1-417a-aac7-3495d56d9f19 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 03:48:53.963372 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-d5dbbcea-c50c-4950-ae55-476e0cf4941f tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:48:53.964110 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-d5dbbcea-c50c-4950-ae55-476e0cf4941f tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] [instance: edb69fe3-e255-4e54-8e08-fff8bbc28d4f] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:48:53.971860 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-d5dbbcea-c50c-4950-ae55-476e0cf4941f tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:48:53.972318 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-d5dbbcea-c50c-4950-ae55-476e0cf4941f tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:48:53.973155 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-d5dbbcea-c50c-4950-ae55-476e0cf4941f tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:48:53.973634 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-d5dbbcea-c50c-4950-ae55-476e0cf4941f tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:48:54.038627 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-d5dbbcea-c50c-4950-ae55-476e0cf4941f tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac99f60384fe4a119d019cedfe1d3557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f18ee8c7d4cfe9f4b879505ca6605', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:48:54.046127 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-d5dbbcea-c50c-4950-ae55-476e0cf4941f tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] 10.222.0.66 "GET /compute/v2.1/servers/edb69fe3-e255-4e54-8e08-fff8bbc28d4f" status: 200 len: 1302 microversion: 2.1 time: 0.087515 Aug 04 03:48:54.046688 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 465/935] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:48:53 2022] GET /compute/v2.1/servers/edb69fe3-e255-4e54-8e08-fff8bbc28d4f => generated 1302 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 03:48:54.450127 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-3ebdc068-5483-47e7-8907-035337e4713c tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:48:54.450960 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-3ebdc068-5483-47e7-8907-035337e4713c tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] [instance: 62affd75-bad1-417a-aac7-3495d56d9f19] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:48:54.457381 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-3ebdc068-5483-47e7-8907-035337e4713c tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:48:54.457823 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-3ebdc068-5483-47e7-8907-035337e4713c tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:48:54.458580 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-3ebdc068-5483-47e7-8907-035337e4713c tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:48:54.459005 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-3ebdc068-5483-47e7-8907-035337e4713c tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:48:54.589660 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-3ebdc068-5483-47e7-8907-035337e4713c tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:48:54.597903 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-3ebdc068-5483-47e7-8907-035337e4713c tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:48:54.599404 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-3ebdc068-5483-47e7-8907-035337e4713c tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:48:54.600563 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-3ebdc068-5483-47e7-8907-035337e4713c tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] 10.222.0.66 "GET /compute/v2.1/servers/62affd75-bad1-417a-aac7-3495d56d9f19" status: 200 len: 1724 microversion: 2.20 time: 0.155347 Aug 04 03:48:54.601127 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 471/936] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 03:48:54 2022] GET /compute/v2.1/servers/62affd75-bad1-417a-aac7-3495d56d9f19 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 03:48:55.067306 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-3c66a016-8bbd-4939-b694-541722207b3c tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:48:55.069870 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-3c66a016-8bbd-4939-b694-541722207b3c tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] [instance: edb69fe3-e255-4e54-8e08-fff8bbc28d4f] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:48:55.079946 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-3c66a016-8bbd-4939-b694-541722207b3c tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:48:55.080622 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-3c66a016-8bbd-4939-b694-541722207b3c tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:48:55.081602 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-3c66a016-8bbd-4939-b694-541722207b3c tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:48:55.082138 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-3c66a016-8bbd-4939-b694-541722207b3c tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:48:55.158985 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-3c66a016-8bbd-4939-b694-541722207b3c tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac99f60384fe4a119d019cedfe1d3557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f18ee8c7d4cfe9f4b879505ca6605', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:48:55.168146 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-3c66a016-8bbd-4939-b694-541722207b3c tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] 10.222.0.66 "GET /compute/v2.1/servers/edb69fe3-e255-4e54-8e08-fff8bbc28d4f" status: 200 len: 1300 microversion: 2.1 time: 0.104748 Aug 04 03:48:55.178343 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 466/937] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:48:55 2022] GET /compute/v2.1/servers/edb69fe3-e255-4e54-8e08-fff8bbc28d4f => generated 1300 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:48:55.624062 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-754eb6ea-1168-412e-8b2f-b631c05a691e tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:48:55.625482 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-754eb6ea-1168-412e-8b2f-b631c05a691e tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] [instance: 62affd75-bad1-417a-aac7-3495d56d9f19] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:48:55.632295 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-754eb6ea-1168-412e-8b2f-b631c05a691e tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:48:55.632749 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-754eb6ea-1168-412e-8b2f-b631c05a691e tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:48:55.633599 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-754eb6ea-1168-412e-8b2f-b631c05a691e tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:48:55.634029 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-754eb6ea-1168-412e-8b2f-b631c05a691e tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:48:55.768828 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-754eb6ea-1168-412e-8b2f-b631c05a691e tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:48:55.777236 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-754eb6ea-1168-412e-8b2f-b631c05a691e tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:48:55.778776 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-754eb6ea-1168-412e-8b2f-b631c05a691e tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:48:55.779931 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-754eb6ea-1168-412e-8b2f-b631c05a691e tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] 10.222.0.66 "GET /compute/v2.1/servers/62affd75-bad1-417a-aac7-3495d56d9f19" status: 200 len: 1724 microversion: 2.20 time: 0.160080 Aug 04 03:48:55.780490 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 472/938] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 03:48:55 2022] GET /compute/v2.1/servers/62affd75-bad1-417a-aac7-3495d56d9f19 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 03:48:56.193295 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-3179a67f-d964-463c-9c88-4c57cd448284 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:48:56.194037 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-3179a67f-d964-463c-9c88-4c57cd448284 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] [instance: edb69fe3-e255-4e54-8e08-fff8bbc28d4f] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:48:56.202220 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-3179a67f-d964-463c-9c88-4c57cd448284 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:48:56.202779 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-3179a67f-d964-463c-9c88-4c57cd448284 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:48:56.203657 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-3179a67f-d964-463c-9c88-4c57cd448284 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:48:56.204196 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-3179a67f-d964-463c-9c88-4c57cd448284 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:48:56.268873 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-d365ea80-df77-4ed7-9624-b72526fef39f tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:48:56.271186 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-d365ea80-df77-4ed7-9624-b72526fef39f tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] [instance: 221108c9-a4b6-4e41-a9e5-a4e1461c991d] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:48:56.277423 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-d365ea80-df77-4ed7-9624-b72526fef39f tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:48:56.278130 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-d365ea80-df77-4ed7-9624-b72526fef39f tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:48:56.278918 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-d365ea80-df77-4ed7-9624-b72526fef39f tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:48:56.279362 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-d365ea80-df77-4ed7-9624-b72526fef39f tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:48:56.310327 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-d365ea80-df77-4ed7-9624-b72526fef39f tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] 10.222.0.66 "GET /compute/v2.1/servers/221108c9-a4b6-4e41-a9e5-a4e1461c991d/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045351 Aug 04 03:48:56.313874 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 473/939] 10.222.0.66 () {58 vars in 1302 bytes} [Thu Aug 4 03:48:56 2022] GET /compute/v2.1/servers/221108c9-a4b6-4e41-a9e5-a4e1461c991d/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 03:48:56.354477 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-3179a67f-d964-463c-9c88-4c57cd448284 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac99f60384fe4a119d019cedfe1d3557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f18ee8c7d4cfe9f4b879505ca6605', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:48:56.362470 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-3179a67f-d964-463c-9c88-4c57cd448284 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] 10.222.0.66 "GET /compute/v2.1/servers/edb69fe3-e255-4e54-8e08-fff8bbc28d4f" status: 200 len: 1368 microversion: 2.1 time: 0.176932 Aug 04 03:48:56.363018 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 467/940] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:48:56 2022] GET /compute/v2.1/servers/edb69fe3-e255-4e54-8e08-fff8bbc28d4f => generated 1368 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:48:56.425182 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [req-9a292ab5-192e-4a75-aa2f-e865d72ef086 req-fc4061fb-9a50-4a5a-848a-a3d3ccf9b47b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "edb69fe3-e255-4e54-8e08-fff8bbc28d4f", "tag": "c25e6478-642e-4e0b-ac56-ae850b56d17a"}]} {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 03:48:56.426016 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-d8f5faa3-fd81-41da-a633-dde7f96e83df tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:48:56.426714 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-d8f5faa3-fd81-41da-a633-dde7f96e83df tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] [instance: 221108c9-a4b6-4e41-a9e5-a4e1461c991d] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:48:56.433187 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-d8f5faa3-fd81-41da-a633-dde7f96e83df tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:48:56.433664 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-d8f5faa3-fd81-41da-a633-dde7f96e83df tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:48:56.434871 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-d8f5faa3-fd81-41da-a633-dde7f96e83df tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:48:56.435427 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [req-9a292ab5-192e-4a75-aa2f-e865d72ef086 req-fc4061fb-9a50-4a5a-848a-a3d3ccf9b47b service nova] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:48:56.435577 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-d8f5faa3-fd81-41da-a633-dde7f96e83df tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:48:56.436178 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [req-9a292ab5-192e-4a75-aa2f-e865d72ef086 req-fc4061fb-9a50-4a5a-848a-a3d3ccf9b47b service nova] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:48:56.449245 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.compute.server_external_events [req-9a292ab5-192e-4a75-aa2f-e865d72ef086 req-fc4061fb-9a50-4a5a-848a-a3d3ccf9b47b service nova] Creating event network-changed:c25e6478-642e-4e0b-ac56-ae850b56d17a for instance edb69fe3-e255-4e54-8e08-fff8bbc28d4f on hv-cinder-73306 Aug 04 03:48:56.457712 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [req-9a292ab5-192e-4a75-aa2f-e865d72ef086 req-fc4061fb-9a50-4a5a-848a-a3d3ccf9b47b service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036509 Aug 04 03:48:56.459072 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 468/941] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 03:48:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 03:48:56.468845 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-d8f5faa3-fd81-41da-a633-dde7f96e83df tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] 10.222.0.66 "GET /compute/v2.1/servers/221108c9-a4b6-4e41-a9e5-a4e1461c991d/os-volume_attachments/207a5bd2-15d4-4a56-a8d8-7f2600c4a0e9" status: 200 len: 194 microversion: 2.1 time: 0.047836 Aug 04 03:48:56.469714 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 474/942] 10.222.0.66 () {58 vars in 1413 bytes} [Thu Aug 4 03:48:56 2022] GET /compute/v2.1/servers/221108c9-a4b6-4e41-a9e5-a4e1461c991d/os-volume_attachments/207a5bd2-15d4-4a56-a8d8-7f2600c4a0e9 => generated 194 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 03:48:56.481340 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-3b9fed83-8d5e-4753-9cf6-f707bf7486ab tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:48:56.481980 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-3b9fed83-8d5e-4753-9cf6-f707bf7486ab tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] [instance: 221108c9-a4b6-4e41-a9e5-a4e1461c991d] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:48:56.488443 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-3b9fed83-8d5e-4753-9cf6-f707bf7486ab tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:48:56.488899 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-3b9fed83-8d5e-4753-9cf6-f707bf7486ab tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:48:56.489887 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-3b9fed83-8d5e-4753-9cf6-f707bf7486ab tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:48:56.490334 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-3b9fed83-8d5e-4753-9cf6-f707bf7486ab tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:48:56.579051 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.objects.instance [None req-3b9fed83-8d5e-4753-9cf6-f707bf7486ab tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lazy-loading 'services' on Instance uuid 221108c9-a4b6-4e41-a9e5-a4e1461c991d {{(pid=130263) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 03:48:56.803832 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-4d33d25c-1289-4324-84f9-bbcdc2649006 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:48:56.804417 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-4d33d25c-1289-4324-84f9-bbcdc2649006 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] [instance: 62affd75-bad1-417a-aac7-3495d56d9f19] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:48:56.810967 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-4d33d25c-1289-4324-84f9-bbcdc2649006 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:48:56.811947 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-4d33d25c-1289-4324-84f9-bbcdc2649006 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:48:56.812158 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-4d33d25c-1289-4324-84f9-bbcdc2649006 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:48:56.812584 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-4d33d25c-1289-4324-84f9-bbcdc2649006 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:48:56.837722 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-3b9fed83-8d5e-4753-9cf6-f707bf7486ab tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] 10.222.0.66 "DELETE /compute/v2.1/servers/221108c9-a4b6-4e41-a9e5-a4e1461c991d/os-volume_attachments/207a5bd2-15d4-4a56-a8d8-7f2600c4a0e9" status: 202 len: 0 microversion: 2.1 time: 0.360823 Aug 04 03:48:56.838578 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 469/943] 10.222.0.66 () {58 vars in 1416 bytes} [Thu Aug 4 03:48:56 2022] DELETE /compute/v2.1/servers/221108c9-a4b6-4e41-a9e5-a4e1461c991d/os-volume_attachments/207a5bd2-15d4-4a56-a8d8-7f2600c4a0e9 => generated 0 bytes in 363 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 03:48:56.962926 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-4d33d25c-1289-4324-84f9-bbcdc2649006 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:48:56.972383 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-4d33d25c-1289-4324-84f9-bbcdc2649006 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:48:56.974264 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-4d33d25c-1289-4324-84f9-bbcdc2649006 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:48:56.975626 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-4d33d25c-1289-4324-84f9-bbcdc2649006 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] 10.222.0.66 "GET /compute/v2.1/servers/62affd75-bad1-417a-aac7-3495d56d9f19" status: 200 len: 1724 microversion: 2.20 time: 0.175693 Aug 04 03:48:56.976351 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 475/944] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 03:48:56 2022] GET /compute/v2.1/servers/62affd75-bad1-417a-aac7-3495d56d9f19 => generated 1724 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 03:48:57.384507 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-5c30c4c4-e97b-478f-b12d-b8257a474b29 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:48:57.385383 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-5c30c4c4-e97b-478f-b12d-b8257a474b29 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] [instance: edb69fe3-e255-4e54-8e08-fff8bbc28d4f] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:48:57.392092 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-5c30c4c4-e97b-478f-b12d-b8257a474b29 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:48:57.392540 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-5c30c4c4-e97b-478f-b12d-b8257a474b29 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:48:57.393333 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-5c30c4c4-e97b-478f-b12d-b8257a474b29 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:48:57.393774 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-5c30c4c4-e97b-478f-b12d-b8257a474b29 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:48:57.528394 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-5c30c4c4-e97b-478f-b12d-b8257a474b29 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac99f60384fe4a119d019cedfe1d3557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f18ee8c7d4cfe9f4b879505ca6605', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:48:57.535836 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-5c30c4c4-e97b-478f-b12d-b8257a474b29 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] 10.222.0.66 "GET /compute/v2.1/servers/edb69fe3-e255-4e54-8e08-fff8bbc28d4f" status: 200 len: 1368 microversion: 2.1 time: 0.156049 Aug 04 03:48:57.536394 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 470/945] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:48:57 2022] GET /compute/v2.1/servers/edb69fe3-e255-4e54-8e08-fff8bbc28d4f => generated 1368 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:48:58.002643 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-7533cf22-7c4c-4d37-90b3-4afa12d0299f tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:48:58.003345 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-7533cf22-7c4c-4d37-90b3-4afa12d0299f tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] [instance: 62affd75-bad1-417a-aac7-3495d56d9f19] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:48:58.010021 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-7533cf22-7c4c-4d37-90b3-4afa12d0299f tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:48:58.010472 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-7533cf22-7c4c-4d37-90b3-4afa12d0299f tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:48:58.011237 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-7533cf22-7c4c-4d37-90b3-4afa12d0299f tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:48:58.011672 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-7533cf22-7c4c-4d37-90b3-4afa12d0299f tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:48:58.151717 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-7533cf22-7c4c-4d37-90b3-4afa12d0299f tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:48:58.159986 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-7533cf22-7c4c-4d37-90b3-4afa12d0299f tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:48:58.161580 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-7533cf22-7c4c-4d37-90b3-4afa12d0299f tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:48:58.162763 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-7533cf22-7c4c-4d37-90b3-4afa12d0299f tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] 10.222.0.66 "GET /compute/v2.1/servers/62affd75-bad1-417a-aac7-3495d56d9f19" status: 200 len: 1724 microversion: 2.20 time: 0.164062 Aug 04 03:48:58.163308 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 476/946] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 03:48:57 2022] GET /compute/v2.1/servers/62affd75-bad1-417a-aac7-3495d56d9f19 => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 03:48:58.556956 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-77e97867-34d6-4787-814a-b4573baef85f tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:48:58.557602 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-77e97867-34d6-4787-814a-b4573baef85f tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] [instance: edb69fe3-e255-4e54-8e08-fff8bbc28d4f] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:48:58.565471 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-77e97867-34d6-4787-814a-b4573baef85f tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:48:58.565923 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-77e97867-34d6-4787-814a-b4573baef85f tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:48:58.566684 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-77e97867-34d6-4787-814a-b4573baef85f tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:48:58.567118 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-77e97867-34d6-4787-814a-b4573baef85f tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:48:58.694297 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-77e97867-34d6-4787-814a-b4573baef85f tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac99f60384fe4a119d019cedfe1d3557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f18ee8c7d4cfe9f4b879505ca6605', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:48:58.701853 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-77e97867-34d6-4787-814a-b4573baef85f tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] 10.222.0.66 "GET /compute/v2.1/servers/edb69fe3-e255-4e54-8e08-fff8bbc28d4f" status: 200 len: 1368 microversion: 2.1 time: 0.148790 Aug 04 03:48:58.702416 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 471/947] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:48:58 2022] GET /compute/v2.1/servers/edb69fe3-e255-4e54-8e08-fff8bbc28d4f => generated 1368 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:48:59.026137 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-0e0e34c3-a32b-493b-9c09-193d73943bbc tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:48:59.026627 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-0e0e34c3-a32b-493b-9c09-193d73943bbc tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] [instance: 221108c9-a4b6-4e41-a9e5-a4e1461c991d] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:48:59.033657 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-0e0e34c3-a32b-493b-9c09-193d73943bbc tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:48:59.034112 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-0e0e34c3-a32b-493b-9c09-193d73943bbc tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:48:59.034881 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-0e0e34c3-a32b-493b-9c09-193d73943bbc tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:48:59.035318 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-0e0e34c3-a32b-493b-9c09-193d73943bbc tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:48:59.064085 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-0e0e34c3-a32b-493b-9c09-193d73943bbc tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] 10.222.0.66 "GET /compute/v2.1/servers/221108c9-a4b6-4e41-a9e5-a4e1461c991d/os-volume_attachments/647b70af-b9d5-4482-bc34-b1a58d472bb3" status: 200 len: 194 microversion: 2.1 time: 0.041872 Aug 04 03:48:59.064667 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 477/948] 10.222.0.66 () {58 vars in 1413 bytes} [Thu Aug 4 03:48:59 2022] GET /compute/v2.1/servers/221108c9-a4b6-4e41-a9e5-a4e1461c991d/os-volume_attachments/647b70af-b9d5-4482-bc34-b1a58d472bb3 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 03:48:59.074966 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-a1679814-2779-4583-a064-01c13bd0bdd6 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:48:59.075454 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-a1679814-2779-4583-a064-01c13bd0bdd6 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] [instance: 221108c9-a4b6-4e41-a9e5-a4e1461c991d] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:48:59.081410 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-a1679814-2779-4583-a064-01c13bd0bdd6 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:48:59.081859 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-a1679814-2779-4583-a064-01c13bd0bdd6 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:48:59.082613 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-a1679814-2779-4583-a064-01c13bd0bdd6 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:48:59.083052 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-a1679814-2779-4583-a064-01c13bd0bdd6 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:48:59.162717 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.objects.instance [None req-a1679814-2779-4583-a064-01c13bd0bdd6 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lazy-loading 'services' on Instance uuid 221108c9-a4b6-4e41-a9e5-a4e1461c991d {{(pid=130263) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 03:48:59.186770 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-6d2ca1a2-7fd7-4658-a7d8-d9c3655668de tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:48:59.187371 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-6d2ca1a2-7fd7-4658-a7d8-d9c3655668de tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] [instance: 62affd75-bad1-417a-aac7-3495d56d9f19] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:48:59.193473 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-6d2ca1a2-7fd7-4658-a7d8-d9c3655668de tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:48:59.193921 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-6d2ca1a2-7fd7-4658-a7d8-d9c3655668de tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:48:59.194677 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-6d2ca1a2-7fd7-4658-a7d8-d9c3655668de tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:48:59.195103 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-6d2ca1a2-7fd7-4658-a7d8-d9c3655668de tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:48:59.328833 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-6d2ca1a2-7fd7-4658-a7d8-d9c3655668de tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:48:59.336790 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-6d2ca1a2-7fd7-4658-a7d8-d9c3655668de tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:48:59.338333 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-6d2ca1a2-7fd7-4658-a7d8-d9c3655668de tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:48:59.339476 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-6d2ca1a2-7fd7-4658-a7d8-d9c3655668de tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] 10.222.0.66 "GET /compute/v2.1/servers/62affd75-bad1-417a-aac7-3495d56d9f19" status: 200 len: 1724 microversion: 2.20 time: 0.157694 Aug 04 03:48:59.340080 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 478/949] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 03:48:59 2022] GET /compute/v2.1/servers/62affd75-bad1-417a-aac7-3495d56d9f19 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 03:48:59.431361 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-a1679814-2779-4583-a064-01c13bd0bdd6 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] 10.222.0.66 "DELETE /compute/v2.1/servers/221108c9-a4b6-4e41-a9e5-a4e1461c991d/os-volume_attachments/647b70af-b9d5-4482-bc34-b1a58d472bb3" status: 202 len: 0 microversion: 2.1 time: 0.360116 Aug 04 03:48:59.431944 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 472/950] 10.222.0.66 () {58 vars in 1416 bytes} [Thu Aug 4 03:48:59 2022] DELETE /compute/v2.1/servers/221108c9-a4b6-4e41-a9e5-a4e1461c991d/os-volume_attachments/647b70af-b9d5-4482-bc34-b1a58d472bb3 => generated 0 bytes in 361 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 03:48:59.722269 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-94bc8fa4-3ddc-4cda-97a4-0d77ba239b23 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:48:59.722876 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-94bc8fa4-3ddc-4cda-97a4-0d77ba239b23 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] [instance: edb69fe3-e255-4e54-8e08-fff8bbc28d4f] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:48:59.728942 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-94bc8fa4-3ddc-4cda-97a4-0d77ba239b23 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:48:59.729426 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-94bc8fa4-3ddc-4cda-97a4-0d77ba239b23 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:48:59.730579 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-94bc8fa4-3ddc-4cda-97a4-0d77ba239b23 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:48:59.731558 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-94bc8fa4-3ddc-4cda-97a4-0d77ba239b23 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:48:59.860225 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-94bc8fa4-3ddc-4cda-97a4-0d77ba239b23 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac99f60384fe4a119d019cedfe1d3557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f18ee8c7d4cfe9f4b879505ca6605', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:48:59.867546 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-94bc8fa4-3ddc-4cda-97a4-0d77ba239b23 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] 10.222.0.66 "GET /compute/v2.1/servers/edb69fe3-e255-4e54-8e08-fff8bbc28d4f" status: 200 len: 1368 microversion: 2.1 time: 0.149105 Aug 04 03:48:59.868139 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 479/951] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:48:59 2022] GET /compute/v2.1/servers/edb69fe3-e255-4e54-8e08-fff8bbc28d4f => generated 1368 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:49:00.363718 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-8143871c-38ce-4021-87fc-97199d6d60db tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:49:00.364410 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-8143871c-38ce-4021-87fc-97199d6d60db tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] [instance: 62affd75-bad1-417a-aac7-3495d56d9f19] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:49:00.372715 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-8143871c-38ce-4021-87fc-97199d6d60db tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:49:00.373860 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-8143871c-38ce-4021-87fc-97199d6d60db tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:49:00.378017 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-8143871c-38ce-4021-87fc-97199d6d60db tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:49:00.378017 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-8143871c-38ce-4021-87fc-97199d6d60db tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:49:00.519895 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-8143871c-38ce-4021-87fc-97199d6d60db tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:49:00.526405 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-8143871c-38ce-4021-87fc-97199d6d60db tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:49:00.528677 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-8143871c-38ce-4021-87fc-97199d6d60db tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:49:00.530074 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-8143871c-38ce-4021-87fc-97199d6d60db tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] 10.222.0.66 "GET /compute/v2.1/servers/62affd75-bad1-417a-aac7-3495d56d9f19" status: 200 len: 1724 microversion: 2.20 time: 0.171151 Aug 04 03:49:00.530635 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 473/952] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 03:49:00 2022] GET /compute/v2.1/servers/62affd75-bad1-417a-aac7-3495d56d9f19 => generated 1724 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 03:49:00.888457 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-c8b804d6-c59d-4ab9-b111-d2db28a20360 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:49:00.889136 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-c8b804d6-c59d-4ab9-b111-d2db28a20360 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] [instance: edb69fe3-e255-4e54-8e08-fff8bbc28d4f] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:49:00.895489 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-c8b804d6-c59d-4ab9-b111-d2db28a20360 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:49:00.895932 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-c8b804d6-c59d-4ab9-b111-d2db28a20360 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:49:00.896683 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-c8b804d6-c59d-4ab9-b111-d2db28a20360 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:49:00.897111 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-c8b804d6-c59d-4ab9-b111-d2db28a20360 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:49:00.901076 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG dbcounter [-] [130262] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=130262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:49:01.034271 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-c8b804d6-c59d-4ab9-b111-d2db28a20360 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac99f60384fe4a119d019cedfe1d3557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f18ee8c7d4cfe9f4b879505ca6605', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:49:01.043061 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-c8b804d6-c59d-4ab9-b111-d2db28a20360 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] 10.222.0.66 "GET /compute/v2.1/servers/edb69fe3-e255-4e54-8e08-fff8bbc28d4f" status: 200 len: 1368 microversion: 2.1 time: 0.158908 Aug 04 03:49:01.044205 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 480/953] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:49:00 2022] GET /compute/v2.1/servers/edb69fe3-e255-4e54-8e08-fff8bbc28d4f => generated 1368 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:49:01.554531 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-07f5e75d-590d-45de-8e02-5bc4fe808aa9 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:49:01.555046 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-07f5e75d-590d-45de-8e02-5bc4fe808aa9 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] [instance: 62affd75-bad1-417a-aac7-3495d56d9f19] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:49:01.562834 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-07f5e75d-590d-45de-8e02-5bc4fe808aa9 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:49:01.563370 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-07f5e75d-590d-45de-8e02-5bc4fe808aa9 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:49:01.564090 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-07f5e75d-590d-45de-8e02-5bc4fe808aa9 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:49:01.564538 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-07f5e75d-590d-45de-8e02-5bc4fe808aa9 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:49:01.621021 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG dbcounter [-] [130263] Writing DB stats nova_cell0:SELECT=2 {{(pid=130263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:49:01.640986 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG dbcounter [-] [130263] Writing DB stats nova_cell0:SELECT=10 {{(pid=130263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:49:01.675810 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-41874bb6-41ed-45fe-b8eb-36b20922a5d7 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:49:01.678026 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-41874bb6-41ed-45fe-b8eb-36b20922a5d7 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] [instance: 221108c9-a4b6-4e41-a9e5-a4e1461c991d] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:49:01.684321 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-41874bb6-41ed-45fe-b8eb-36b20922a5d7 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:49:01.684750 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-41874bb6-41ed-45fe-b8eb-36b20922a5d7 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:49:01.685571 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-41874bb6-41ed-45fe-b8eb-36b20922a5d7 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:49:01.686032 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-41874bb6-41ed-45fe-b8eb-36b20922a5d7 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:49:01.700415 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-07f5e75d-590d-45de-8e02-5bc4fe808aa9 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:49:01.708783 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-07f5e75d-590d-45de-8e02-5bc4fe808aa9 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:49:01.710330 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-07f5e75d-590d-45de-8e02-5bc4fe808aa9 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:49:01.711512 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-07f5e75d-590d-45de-8e02-5bc4fe808aa9 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] 10.222.0.66 "GET /compute/v2.1/servers/62affd75-bad1-417a-aac7-3495d56d9f19" status: 200 len: 1724 microversion: 2.20 time: 0.161039 Aug 04 03:49:01.712069 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 474/954] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 03:49:01 2022] GET /compute/v2.1/servers/62affd75-bad1-417a-aac7-3495d56d9f19 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 03:49:01.715461 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-41874bb6-41ed-45fe-b8eb-36b20922a5d7 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] 10.222.0.66 "GET /compute/v2.1/servers/221108c9-a4b6-4e41-a9e5-a4e1461c991d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044622 Aug 04 03:49:01.716051 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 481/955] 10.222.0.66 () {58 vars in 1302 bytes} [Thu Aug 4 03:49:01 2022] GET /compute/v2.1/servers/221108c9-a4b6-4e41-a9e5-a4e1461c991d/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 03:49:01.828518 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-2a1d0d25-e78c-4be8-ab3d-9be6dc5d4ef8 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:49:01.830847 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-2a1d0d25-e78c-4be8-ab3d-9be6dc5d4ef8 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] [instance: 221108c9-a4b6-4e41-a9e5-a4e1461c991d] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:49:01.837438 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-2a1d0d25-e78c-4be8-ab3d-9be6dc5d4ef8 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:49:01.837893 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-2a1d0d25-e78c-4be8-ab3d-9be6dc5d4ef8 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:49:01.838661 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-2a1d0d25-e78c-4be8-ab3d-9be6dc5d4ef8 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:49:01.839099 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-2a1d0d25-e78c-4be8-ab3d-9be6dc5d4ef8 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:49:01.869281 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-2a1d0d25-e78c-4be8-ab3d-9be6dc5d4ef8 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] 10.222.0.66 "GET /compute/v2.1/servers/221108c9-a4b6-4e41-a9e5-a4e1461c991d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044944 Aug 04 03:49:01.869844 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 475/956] 10.222.0.66 () {58 vars in 1302 bytes} [Thu Aug 4 03:49:01 2022] GET /compute/v2.1/servers/221108c9-a4b6-4e41-a9e5-a4e1461c991d/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 03:49:01.932363 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-0fd41486-3203-4252-8ebc-6eab0d098dd4 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:49:01.932875 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-0fd41486-3203-4252-8ebc-6eab0d098dd4 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] [instance: 221108c9-a4b6-4e41-a9e5-a4e1461c991d] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:49:01.935021 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG dbcounter [-] [130262] Writing DB stats nova_cell0:SELECT=2 {{(pid=130262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:49:01.940594 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-0fd41486-3203-4252-8ebc-6eab0d098dd4 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:49:01.941037 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-0fd41486-3203-4252-8ebc-6eab0d098dd4 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:49:01.941836 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-0fd41486-3203-4252-8ebc-6eab0d098dd4 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:49:01.942284 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-0fd41486-3203-4252-8ebc-6eab0d098dd4 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:49:01.967179 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-0fd41486-3203-4252-8ebc-6eab0d098dd4 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] [instance: 221108c9-a4b6-4e41-a9e5-a4e1461c991d] Going to try to terminate instance {{(pid=130262) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 03:49:02.064032 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-e805e975-7b7e-453d-926c-18009abc54af tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:49:02.064608 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-e805e975-7b7e-453d-926c-18009abc54af tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] [instance: edb69fe3-e255-4e54-8e08-fff8bbc28d4f] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:49:02.070651 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-e805e975-7b7e-453d-926c-18009abc54af tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:49:02.071297 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-e805e975-7b7e-453d-926c-18009abc54af tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:49:02.072239 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-e805e975-7b7e-453d-926c-18009abc54af tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:49:02.073037 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-e805e975-7b7e-453d-926c-18009abc54af tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:49:02.215965 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-e805e975-7b7e-453d-926c-18009abc54af tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac99f60384fe4a119d019cedfe1d3557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f18ee8c7d4cfe9f4b879505ca6605', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:49:02.224481 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-e805e975-7b7e-453d-926c-18009abc54af tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] 10.222.0.66 "GET /compute/v2.1/servers/edb69fe3-e255-4e54-8e08-fff8bbc28d4f" status: 200 len: 1368 microversion: 2.1 time: 0.164468 Aug 04 03:49:02.225492 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 476/957] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:49:02 2022] GET /compute/v2.1/servers/edb69fe3-e255-4e54-8e08-fff8bbc28d4f => generated 1368 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 03:49:02.245006 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [req-15e57c17-d4de-44af-82e1-104b26167f07 req-c07d3820-ed6c-49d2-a8bf-ee5aa28b5d53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "edb69fe3-e255-4e54-8e08-fff8bbc28d4f", "name": "network-vif-plugged", "status": "completed", "tag": "c25e6478-642e-4e0b-ac56-ae850b56d17a"}]} {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 03:49:02.255652 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [req-15e57c17-d4de-44af-82e1-104b26167f07 req-c07d3820-ed6c-49d2-a8bf-ee5aa28b5d53 service nova] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:49:02.256103 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [req-15e57c17-d4de-44af-82e1-104b26167f07 req-c07d3820-ed6c-49d2-a8bf-ee5aa28b5d53 service nova] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:49:02.268906 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.compute.server_external_events [req-15e57c17-d4de-44af-82e1-104b26167f07 req-c07d3820-ed6c-49d2-a8bf-ee5aa28b5d53 service nova] Creating event network-vif-plugged:c25e6478-642e-4e0b-ac56-ae850b56d17a for instance edb69fe3-e255-4e54-8e08-fff8bbc28d4f on hv-cinder-73306 Aug 04 03:49:02.273827 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [req-15e57c17-d4de-44af-82e1-104b26167f07 req-c07d3820-ed6c-49d2-a8bf-ee5aa28b5d53 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033987 Aug 04 03:49:02.274429 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 477/958] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 03:49:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 03:49:02.300845 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-0fd41486-3203-4252-8ebc-6eab0d098dd4 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] 10.222.0.66 "DELETE /compute/v2.1/servers/221108c9-a4b6-4e41-a9e5-a4e1461c991d" status: 204 len: 0 microversion: 2.1 time: 0.371927 Aug 04 03:49:02.301623 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 482/959] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 03:49:01 2022] DELETE /compute/v2.1/servers/221108c9-a4b6-4e41-a9e5-a4e1461c991d => generated 0 bytes in 374 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 03:49:02.310274 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-9a558a2d-be59-4b95-b6f1-218604163114 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:49:02.311013 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-9a558a2d-be59-4b95-b6f1-218604163114 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] [instance: 221108c9-a4b6-4e41-a9e5-a4e1461c991d] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:49:02.317594 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-9a558a2d-be59-4b95-b6f1-218604163114 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:49:02.317985 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-9a558a2d-be59-4b95-b6f1-218604163114 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:49:02.318749 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-9a558a2d-be59-4b95-b6f1-218604163114 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:49:02.319184 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-9a558a2d-be59-4b95-b6f1-218604163114 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:49:02.323346 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG dbcounter [-] [130263] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=130263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:49:02.452304 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-9a558a2d-be59-4b95-b6f1-218604163114 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dba436d0a67433f8c8ae7cd40d3f795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46b8dc64007429b805971d4c6f5b471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:49:02.459792 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-9a558a2d-be59-4b95-b6f1-218604163114 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] 10.222.0.66 "GET /compute/v2.1/servers/221108c9-a4b6-4e41-a9e5-a4e1461c991d" status: 200 len: 1675 microversion: 2.1 time: 0.153675 Aug 04 03:49:02.460394 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 478/960] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:49:02 2022] GET /compute/v2.1/servers/221108c9-a4b6-4e41-a9e5-a4e1461c991d => generated 1675 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:49:02.736462 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-bae1a74f-9674-4996-b4ea-8e3f512f0451 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:49:02.737239 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-bae1a74f-9674-4996-b4ea-8e3f512f0451 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] [instance: 62affd75-bad1-417a-aac7-3495d56d9f19] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:49:02.743162 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-bae1a74f-9674-4996-b4ea-8e3f512f0451 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:49:02.743609 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-bae1a74f-9674-4996-b4ea-8e3f512f0451 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:49:02.744363 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-bae1a74f-9674-4996-b4ea-8e3f512f0451 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:49:02.744826 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-bae1a74f-9674-4996-b4ea-8e3f512f0451 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:49:02.876411 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-bae1a74f-9674-4996-b4ea-8e3f512f0451 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:49:02.884342 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-bae1a74f-9674-4996-b4ea-8e3f512f0451 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:49:02.885881 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-bae1a74f-9674-4996-b4ea-8e3f512f0451 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:49:02.887032 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-bae1a74f-9674-4996-b4ea-8e3f512f0451 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] 10.222.0.66 "GET /compute/v2.1/servers/62affd75-bad1-417a-aac7-3495d56d9f19" status: 200 len: 1724 microversion: 2.20 time: 0.154984 Aug 04 03:49:02.887575 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 483/961] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 03:49:02 2022] GET /compute/v2.1/servers/62affd75-bad1-417a-aac7-3495d56d9f19 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 03:49:03.246495 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-a3b05852-6d14-4639-a831-463494cdb731 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:49:03.247533 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-a3b05852-6d14-4639-a831-463494cdb731 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] [instance: edb69fe3-e255-4e54-8e08-fff8bbc28d4f] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:49:03.250025 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG dbcounter [-] [130263] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=4 {{(pid=130263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:49:03.255142 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-a3b05852-6d14-4639-a831-463494cdb731 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:49:03.255595 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-a3b05852-6d14-4639-a831-463494cdb731 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:49:03.256365 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-a3b05852-6d14-4639-a831-463494cdb731 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:49:03.256811 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-a3b05852-6d14-4639-a831-463494cdb731 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:49:03.390806 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-a3b05852-6d14-4639-a831-463494cdb731 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac99f60384fe4a119d019cedfe1d3557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f18ee8c7d4cfe9f4b879505ca6605', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:49:03.399198 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-a3b05852-6d14-4639-a831-463494cdb731 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] 10.222.0.66 "GET /compute/v2.1/servers/edb69fe3-e255-4e54-8e08-fff8bbc28d4f" status: 200 len: 1368 microversion: 2.1 time: 0.156924 Aug 04 03:49:03.399781 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 479/962] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:49:03 2022] GET /compute/v2.1/servers/edb69fe3-e255-4e54-8e08-fff8bbc28d4f => generated 1368 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:49:03.481528 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-94f0648e-9295-4295-9aea-616e9117cd80 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:49:03.482068 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-94f0648e-9295-4295-9aea-616e9117cd80 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] [instance: 221108c9-a4b6-4e41-a9e5-a4e1461c991d] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:49:03.489553 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-94f0648e-9295-4295-9aea-616e9117cd80 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:49:03.489985 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-94f0648e-9295-4295-9aea-616e9117cd80 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:49:03.490743 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-94f0648e-9295-4295-9aea-616e9117cd80 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:49:03.491178 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-94f0648e-9295-4295-9aea-616e9117cd80 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:49:03.619207 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-94f0648e-9295-4295-9aea-616e9117cd80 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dba436d0a67433f8c8ae7cd40d3f795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46b8dc64007429b805971d4c6f5b471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:49:03.627409 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-94f0648e-9295-4295-9aea-616e9117cd80 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] 10.222.0.66 "GET /compute/v2.1/servers/221108c9-a4b6-4e41-a9e5-a4e1461c991d" status: 200 len: 1675 microversion: 2.1 time: 0.150100 Aug 04 03:49:03.627966 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 484/963] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:49:03 2022] GET /compute/v2.1/servers/221108c9-a4b6-4e41-a9e5-a4e1461c991d => generated 1675 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:49:03.910644 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-88df49e0-9bb0-4b67-bec4-010f01cb31b1 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:49:03.911257 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-88df49e0-9bb0-4b67-bec4-010f01cb31b1 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] [instance: 62affd75-bad1-417a-aac7-3495d56d9f19] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:49:03.918107 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-88df49e0-9bb0-4b67-bec4-010f01cb31b1 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:49:03.918559 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-88df49e0-9bb0-4b67-bec4-010f01cb31b1 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:49:03.919314 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-88df49e0-9bb0-4b67-bec4-010f01cb31b1 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:49:03.919748 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-88df49e0-9bb0-4b67-bec4-010f01cb31b1 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:49:04.051996 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-88df49e0-9bb0-4b67-bec4-010f01cb31b1 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:49:04.059789 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-88df49e0-9bb0-4b67-bec4-010f01cb31b1 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:49:04.062039 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-88df49e0-9bb0-4b67-bec4-010f01cb31b1 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:49:04.063208 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-88df49e0-9bb0-4b67-bec4-010f01cb31b1 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] 10.222.0.66 "GET /compute/v2.1/servers/62affd75-bad1-417a-aac7-3495d56d9f19" status: 200 len: 1724 microversion: 2.20 time: 0.156491 Aug 04 03:49:04.063762 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 480/964] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 03:49:03 2022] GET /compute/v2.1/servers/62affd75-bad1-417a-aac7-3495d56d9f19 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 03:49:04.420820 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-a20b2a33-6b48-457c-8f6a-ed3538f0b6af tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:49:04.421633 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-a20b2a33-6b48-457c-8f6a-ed3538f0b6af tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] [instance: edb69fe3-e255-4e54-8e08-fff8bbc28d4f] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:49:04.427810 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-a20b2a33-6b48-457c-8f6a-ed3538f0b6af tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:49:04.428199 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-a20b2a33-6b48-457c-8f6a-ed3538f0b6af tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:49:04.428954 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-a20b2a33-6b48-457c-8f6a-ed3538f0b6af tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:49:04.429463 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-a20b2a33-6b48-457c-8f6a-ed3538f0b6af tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:49:04.557296 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-a20b2a33-6b48-457c-8f6a-ed3538f0b6af tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac99f60384fe4a119d019cedfe1d3557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f18ee8c7d4cfe9f4b879505ca6605', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:49:04.565164 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-a20b2a33-6b48-457c-8f6a-ed3538f0b6af tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] 10.222.0.66 "GET /compute/v2.1/servers/edb69fe3-e255-4e54-8e08-fff8bbc28d4f" status: 200 len: 1368 microversion: 2.1 time: 0.148779 Aug 04 03:49:04.565728 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 485/965] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:49:04 2022] GET /compute/v2.1/servers/edb69fe3-e255-4e54-8e08-fff8bbc28d4f => generated 1368 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:49:04.648582 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-59a74221-c320-4cef-9bcf-aa363ff3c8e9 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:49:04.649226 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-59a74221-c320-4cef-9bcf-aa363ff3c8e9 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] [instance: 221108c9-a4b6-4e41-a9e5-a4e1461c991d] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:49:04.656190 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-59a74221-c320-4cef-9bcf-aa363ff3c8e9 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:49:04.656639 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-59a74221-c320-4cef-9bcf-aa363ff3c8e9 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:49:04.657419 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-59a74221-c320-4cef-9bcf-aa363ff3c8e9 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:49:04.657856 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-59a74221-c320-4cef-9bcf-aa363ff3c8e9 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:49:04.786958 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-59a74221-c320-4cef-9bcf-aa363ff3c8e9 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dba436d0a67433f8c8ae7cd40d3f795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46b8dc64007429b805971d4c6f5b471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:49:04.794574 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-59a74221-c320-4cef-9bcf-aa363ff3c8e9 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] 10.222.0.66 "GET /compute/v2.1/servers/221108c9-a4b6-4e41-a9e5-a4e1461c991d" status: 200 len: 1675 microversion: 2.1 time: 0.149971 Aug 04 03:49:04.795146 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 481/966] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:49:04 2022] GET /compute/v2.1/servers/221108c9-a4b6-4e41-a9e5-a4e1461c991d => generated 1675 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:49:05.085494 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-ffce70ce-c6a7-4e8a-bfd1-6a0e6f3d7274 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:49:05.093715 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-ffce70ce-c6a7-4e8a-bfd1-6a0e6f3d7274 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] [instance: 62affd75-bad1-417a-aac7-3495d56d9f19] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:49:05.093715 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-ffce70ce-c6a7-4e8a-bfd1-6a0e6f3d7274 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:49:05.093715 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-ffce70ce-c6a7-4e8a-bfd1-6a0e6f3d7274 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:49:05.094025 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-ffce70ce-c6a7-4e8a-bfd1-6a0e6f3d7274 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:49:05.094341 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-ffce70ce-c6a7-4e8a-bfd1-6a0e6f3d7274 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:49:05.222187 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-ffce70ce-c6a7-4e8a-bfd1-6a0e6f3d7274 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:49:05.230426 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-ffce70ce-c6a7-4e8a-bfd1-6a0e6f3d7274 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:49:05.231916 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-ffce70ce-c6a7-4e8a-bfd1-6a0e6f3d7274 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:49:05.233139 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-ffce70ce-c6a7-4e8a-bfd1-6a0e6f3d7274 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] 10.222.0.66 "GET /compute/v2.1/servers/62affd75-bad1-417a-aac7-3495d56d9f19" status: 200 len: 1724 microversion: 2.20 time: 0.151491 Aug 04 03:49:05.234507 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 486/967] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 03:49:05 2022] GET /compute/v2.1/servers/62affd75-bad1-417a-aac7-3495d56d9f19 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 03:49:05.586319 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-50cb67e1-6249-447b-815c-aa849c22c062 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:49:05.586943 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-50cb67e1-6249-447b-815c-aa849c22c062 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] [instance: edb69fe3-e255-4e54-8e08-fff8bbc28d4f] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:49:05.593538 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-50cb67e1-6249-447b-815c-aa849c22c062 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:49:05.593997 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-50cb67e1-6249-447b-815c-aa849c22c062 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:49:05.594804 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-50cb67e1-6249-447b-815c-aa849c22c062 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:49:05.595247 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-50cb67e1-6249-447b-815c-aa849c22c062 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:49:05.724940 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-50cb67e1-6249-447b-815c-aa849c22c062 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac99f60384fe4a119d019cedfe1d3557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f18ee8c7d4cfe9f4b879505ca6605', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:49:05.732266 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-50cb67e1-6249-447b-815c-aa849c22c062 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] 10.222.0.66 "GET /compute/v2.1/servers/edb69fe3-e255-4e54-8e08-fff8bbc28d4f" status: 200 len: 1368 microversion: 2.1 time: 0.149881 Aug 04 03:49:05.733401 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 482/968] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:49:05 2022] GET /compute/v2.1/servers/edb69fe3-e255-4e54-8e08-fff8bbc28d4f => generated 1368 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:49:05.816084 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-858e3bfd-a716-4283-ab70-13f357042364 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:49:05.816693 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-858e3bfd-a716-4283-ab70-13f357042364 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] [instance: 221108c9-a4b6-4e41-a9e5-a4e1461c991d] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:49:05.823079 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-858e3bfd-a716-4283-ab70-13f357042364 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:49:05.823785 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-858e3bfd-a716-4283-ab70-13f357042364 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:49:05.824343 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-858e3bfd-a716-4283-ab70-13f357042364 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:49:05.824784 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-858e3bfd-a716-4283-ab70-13f357042364 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:49:05.896770 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-858e3bfd-a716-4283-ab70-13f357042364 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dba436d0a67433f8c8ae7cd40d3f795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46b8dc64007429b805971d4c6f5b471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:49:05.904723 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-858e3bfd-a716-4283-ab70-13f357042364 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] 10.222.0.66 "GET /compute/v2.1/servers/221108c9-a4b6-4e41-a9e5-a4e1461c991d" status: 200 len: 1607 microversion: 2.1 time: 0.092431 Aug 04 03:49:05.905833 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 487/969] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:49:05 2022] GET /compute/v2.1/servers/221108c9-a4b6-4e41-a9e5-a4e1461c991d => generated 1607 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:49:06.177562 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [req-8bcc0d07-e40e-4703-a091-5fba25889d4a req-cbc340d8-d16e-465a-90c7-d3d12accce2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "221108c9-a4b6-4e41-a9e5-a4e1461c991d", "name": "network-vif-deleted", "tag": "fbd5776e-e5bb-4524-bca5-b312018f5f7d"}]} {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 03:49:06.187563 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [req-8bcc0d07-e40e-4703-a091-5fba25889d4a req-cbc340d8-d16e-465a-90c7-d3d12accce2b service nova] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:49:06.188248 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [req-8bcc0d07-e40e-4703-a091-5fba25889d4a req-cbc340d8-d16e-465a-90c7-d3d12accce2b service nova] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:49:06.200232 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.compute.server_external_events [req-8bcc0d07-e40e-4703-a091-5fba25889d4a req-cbc340d8-d16e-465a-90c7-d3d12accce2b service nova] Creating event network-vif-deleted:fbd5776e-e5bb-4524-bca5-b312018f5f7d for instance 221108c9-a4b6-4e41-a9e5-a4e1461c991d on hv-cinder-73306 Aug 04 03:49:06.206074 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [req-8bcc0d07-e40e-4703-a091-5fba25889d4a req-cbc340d8-d16e-465a-90c7-d3d12accce2b service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032204 Aug 04 03:49:06.206721 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 483/970] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 03:49:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 03:49:06.255916 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-b79145da-bb09-4513-9885-05930ac9b65c tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:49:06.256531 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-b79145da-bb09-4513-9885-05930ac9b65c tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] [instance: 62affd75-bad1-417a-aac7-3495d56d9f19] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:49:06.263611 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-b79145da-bb09-4513-9885-05930ac9b65c tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:49:06.264124 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-b79145da-bb09-4513-9885-05930ac9b65c tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:49:06.265706 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-b79145da-bb09-4513-9885-05930ac9b65c tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:49:06.266193 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-b79145da-bb09-4513-9885-05930ac9b65c tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:49:06.428040 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-b79145da-bb09-4513-9885-05930ac9b65c tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:49:06.438061 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-b79145da-bb09-4513-9885-05930ac9b65c tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:49:06.439680 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-b79145da-bb09-4513-9885-05930ac9b65c tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:49:06.440857 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-b79145da-bb09-4513-9885-05930ac9b65c tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] 10.222.0.66 "GET /compute/v2.1/servers/62affd75-bad1-417a-aac7-3495d56d9f19" status: 200 len: 1745 microversion: 2.20 time: 0.188850 Aug 04 03:49:06.441841 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 488/971] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 03:49:06 2022] GET /compute/v2.1/servers/62affd75-bad1-417a-aac7-3495d56d9f19 => generated 1745 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 03:49:06.754896 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-30c4b5ce-5164-4060-b5eb-c1ca56542e4c tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:49:06.755593 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-30c4b5ce-5164-4060-b5eb-c1ca56542e4c tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] [instance: edb69fe3-e255-4e54-8e08-fff8bbc28d4f] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:49:06.762113 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-30c4b5ce-5164-4060-b5eb-c1ca56542e4c tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:49:06.767244 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-30c4b5ce-5164-4060-b5eb-c1ca56542e4c tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:49:06.767244 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-30c4b5ce-5164-4060-b5eb-c1ca56542e4c tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:49:06.767244 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-30c4b5ce-5164-4060-b5eb-c1ca56542e4c tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:49:06.902913 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-30c4b5ce-5164-4060-b5eb-c1ca56542e4c tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac99f60384fe4a119d019cedfe1d3557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f18ee8c7d4cfe9f4b879505ca6605', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:49:06.911013 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-30c4b5ce-5164-4060-b5eb-c1ca56542e4c tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] 10.222.0.66 "GET /compute/v2.1/servers/edb69fe3-e255-4e54-8e08-fff8bbc28d4f" status: 200 len: 1558 microversion: 2.1 time: 0.160840 Aug 04 03:49:06.911587 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 484/972] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:49:06 2022] GET /compute/v2.1/servers/edb69fe3-e255-4e54-8e08-fff8bbc28d4f => generated 1558 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:49:06.926506 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-7c087e25-a3d5-44d4-b47d-e601c4d1af2c tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:49:06.927958 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-7c087e25-a3d5-44d4-b47d-e601c4d1af2c tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] [instance: 221108c9-a4b6-4e41-a9e5-a4e1461c991d] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:49:06.933455 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-da0f4a7a-2d67-4d02-9c80-c94c668c8554 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:49:06.934062 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-da0f4a7a-2d67-4d02-9c80-c94c668c8554 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] [instance: edb69fe3-e255-4e54-8e08-fff8bbc28d4f] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:49:06.934219 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-7c087e25-a3d5-44d4-b47d-e601c4d1af2c tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:49:06.934848 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-7c087e25-a3d5-44d4-b47d-e601c4d1af2c tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:49:06.935798 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-7c087e25-a3d5-44d4-b47d-e601c4d1af2c tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:49:06.936583 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-7c087e25-a3d5-44d4-b47d-e601c4d1af2c tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:49:06.941016 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-da0f4a7a-2d67-4d02-9c80-c94c668c8554 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:49:06.941644 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-da0f4a7a-2d67-4d02-9c80-c94c668c8554 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:49:06.942422 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-da0f4a7a-2d67-4d02-9c80-c94c668c8554 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:49:06.943027 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-da0f4a7a-2d67-4d02-9c80-c94c668c8554 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:49:06.971899 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-7c087e25-a3d5-44d4-b47d-e601c4d1af2c tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:49:06.972341 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-7c087e25-a3d5-44d4-b47d-e601c4d1af2c tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:49:06.972717 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.objects.instance [None req-7c087e25-a3d5-44d4-b47d-e601c4d1af2c tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lazy-loading 'fault' on Instance uuid 221108c9-a4b6-4e41-a9e5-a4e1461c991d {{(pid=130262) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 03:49:07.053343 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-7c087e25-a3d5-44d4-b47d-e601c4d1af2c tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6dba436d0a67433f8c8ae7cd40d3f795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f46b8dc64007429b805971d4c6f5b471', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:49:07.067835 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-7c087e25-a3d5-44d4-b47d-e601c4d1af2c tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] 10.222.0.66 "GET /compute/v2.1/servers/221108c9-a4b6-4e41-a9e5-a4e1461c991d" status: 200 len: 1328 microversion: 2.1 time: 0.144906 Aug 04 03:49:07.070345 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 489/973] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:49:06 2022] GET /compute/v2.1/servers/221108c9-a4b6-4e41-a9e5-a4e1461c991d => generated 1328 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:49:07.075409 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-da0f4a7a-2d67-4d02-9c80-c94c668c8554 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] 10.222.0.66 "GET /compute/v2.1/servers/edb69fe3-e255-4e54-8e08-fff8bbc28d4f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.146519 Aug 04 03:49:07.076072 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 485/974] 10.222.0.66 () {58 vars in 1275 bytes} [Thu Aug 4 03:49:06 2022] GET /compute/v2.1/servers/edb69fe3-e255-4e54-8e08-fff8bbc28d4f/os-interface => generated 284 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 03:49:07.466051 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-165f1ee7-9ec6-4ac3-9754-c6247bfcda37 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:49:07.466979 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-165f1ee7-9ec6-4ac3-9754-c6247bfcda37 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] [instance: 62affd75-bad1-417a-aac7-3495d56d9f19] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:49:07.473653 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-165f1ee7-9ec6-4ac3-9754-c6247bfcda37 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:49:07.474102 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-165f1ee7-9ec6-4ac3-9754-c6247bfcda37 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:49:07.474853 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-165f1ee7-9ec6-4ac3-9754-c6247bfcda37 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:49:07.475338 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-165f1ee7-9ec6-4ac3-9754-c6247bfcda37 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:49:07.655962 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-165f1ee7-9ec6-4ac3-9754-c6247bfcda37 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:49:07.663851 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-165f1ee7-9ec6-4ac3-9754-c6247bfcda37 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:49:07.665361 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-165f1ee7-9ec6-4ac3-9754-c6247bfcda37 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:49:07.666518 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-165f1ee7-9ec6-4ac3-9754-c6247bfcda37 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] 10.222.0.66 "GET /compute/v2.1/servers/62affd75-bad1-417a-aac7-3495d56d9f19" status: 200 len: 1745 microversion: 2.20 time: 0.204580 Aug 04 03:49:07.671197 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 490/975] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 03:49:07 2022] GET /compute/v2.1/servers/62affd75-bad1-417a-aac7-3495d56d9f19 => generated 1745 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 03:49:08.091155 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-b69c0773-8f83-4769-bced-8c4061598d0f tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:49:08.092051 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-b69c0773-8f83-4769-bced-8c4061598d0f tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] [instance: 221108c9-a4b6-4e41-a9e5-a4e1461c991d] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:49:08.104782 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-b69c0773-8f83-4769-bced-8c4061598d0f tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:49:08.105926 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-b69c0773-8f83-4769-bced-8c4061598d0f tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:49:08.106921 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-b69c0773-8f83-4769-bced-8c4061598d0f tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:49:08.107702 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-b69c0773-8f83-4769-bced-8c4061598d0f tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:49:08.132291 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.wsgi [None req-b69c0773-8f83-4769-bced-8c4061598d0f tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] HTTP exception thrown: Instance 221108c9-a4b6-4e41-a9e5-a4e1461c991d could not be found. Aug 04 03:49:08.141509 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [req-63b31e9d-84ea-46ef-ac9d-48c812ee54b6 req-8a1cabc8-3435-4d5f-aa24-17858d61ae77 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "edb69fe3-e255-4e54-8e08-fff8bbc28d4f", "tag": "c25e6478-642e-4e0b-ac56-ae850b56d17a"}]} {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 03:49:08.142683 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-b69c0773-8f83-4769-bced-8c4061598d0f tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Request method failure captured: Aug 04 03:49:08.142683 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: request: GET /compute/v2.1/servers/221108c9-a4b6-4e41-a9e5-a4e1461c991d HTTP/1.1 Aug 04 03:49:08.142683 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Accept: application/json Aug 04 03:49:08.142683 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Accept-Encoding: identity Aug 04 03:49:08.142683 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Connection: close Aug 04 03:49:08.142683 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Content-Length: 0 Aug 04 03:49:08.142683 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Content-Type: application/json Aug 04 03:49:08.142683 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Host: 10.222.0.66 Aug 04 03:49:08.142683 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Openstack-System-Scope: None Aug 04 03:49:08.142683 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: User-Agent: python-urllib3/1.26.11 Aug 04 03:49:08.142683 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Auth-Token: gAAAAABi6z9jjstLclSJhOUwTHf-ODCHOvyWYm-xiPGzTzYakNhh-XvfvUtN3VVw_rz9X8BxEZkSKeY1v-8BIr2pnIu_eB5LVFcULBBlXUhgFA2XNAhbiitHkPcF_YXvqofes1l3smLOqF7WJlDo1bBSfDCGzi4nCS4paxuU8y7pqn-SrPAYoNA Aug 04 03:49:08.142683 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Domain-Id: None Aug 04 03:49:08.142683 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Domain-Name: None Aug 04 03:49:08.142683 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Identity-Status: Confirmed Aug 04 03:49:08.142683 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Is-Admin-Project: True Aug 04 03:49:08.142683 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Project-Domain-Id: default Aug 04 03:49:08.142683 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Project-Domain-Name: Default Aug 04 03:49:08.142683 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Project-Id: f46b8dc64007429b805971d4c6f5b471 Aug 04 03:49:08.142683 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Project-Name: tempest-AttachVolumeTestJSON-422253214 Aug 04 03:49:08.142683 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Role: member,reader Aug 04 03:49:08.142683 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Roles: member,reader Aug 04 03:49:08.144324 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/f46b8dc64007429b805971d4c6f5b471"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f46b8dc64007429b805971d4c6f5b471"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f46b8dc64007429b805971d4c6f5b471"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_f46b8dc64007429b805971d4c6f5b471"}]}] Aug 04 03:49:08.144324 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Tenant: tempest-AttachVolumeTestJSON-422253214 Aug 04 03:49:08.144324 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Tenant-Id: f46b8dc64007429b805971d4c6f5b471 Aug 04 03:49:08.144324 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Tenant-Name: tempest-AttachVolumeTestJSON-422253214 Aug 04 03:49:08.144324 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-User: tempest-AttachVolumeTestJSON-422253214-project Aug 04 03:49:08.144324 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-User-Domain-Id: default Aug 04 03:49:08.144324 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-User-Domain-Name: Default Aug 04 03:49:08.144324 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-User-Id: 6dba436d0a67433f8c8ae7cd40d3f795 Aug 04 03:49:08.144324 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-User-Name: tempest-AttachVolumeTestJSON-422253214-project Aug 04 03:49:08.144324 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: method: > Aug 04 03:49:08.144324 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: exception: Instance 221108c9-a4b6-4e41-a9e5-a4e1461c991d could not be found. Aug 04 03:49:08.144324 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: action_args: {'id': '221108c9-a4b6-4e41-a9e5-a4e1461c991d'} Aug 04 03:49:08.145228 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 03:49:08.145228 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 03:49:08.145228 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 03:49:08.145228 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 03:49:08.145228 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 03:49:08.145228 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 03:49:08.145228 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 03:49:08.145228 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 03:49:08.145228 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 03:49:08.145228 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 03:49:08.145228 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 221108c9-a4b6-4e41-a9e5-a4e1461c991d could not be found. Aug 04 03:49:08.145228 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Aug 04 03:49:08.145228 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 03:49:08.145228 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Aug 04 03:49:08.145228 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 03:49:08.145228 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 03:49:08.145228 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 03:49:08.145228 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 03:49:08.145228 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 03:49:08.145228 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 03:49:08.146738 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 03:49:08.146738 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 03:49:08.146738 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 03:49:08.146738 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 03:49:08.146738 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 03:49:08.146738 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 03:49:08.146738 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 03:49:08.146738 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 221108c9-a4b6-4e41-a9e5-a4e1461c991d could not be found. Aug 04 03:49:08.146738 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Aug 04 03:49:08.146738 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 03:49:08.146738 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Aug 04 03:49:08.146738 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 03:49:08.146738 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 03:49:08.146738 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 03:49:08.146738 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 03:49:08.146738 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 03:49:08.146738 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 221108c9-a4b6-4e41-a9e5-a4e1461c991d could not be found. Aug 04 03:49:08.146738 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Aug 04 03:49:08.148080 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-b69c0773-8f83-4769-bced-8c4061598d0f tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Returning 404 to user: Instance 221108c9-a4b6-4e41-a9e5-a4e1461c991d could not be found. {{(pid=130263) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 03:49:08.148080 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-b69c0773-8f83-4769-bced-8c4061598d0f tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] 10.222.0.66 "GET /compute/v2.1/servers/221108c9-a4b6-4e41-a9e5-a4e1461c991d" status: 404 len: 111 microversion: 2.1 time: 0.058156 Aug 04 03:49:08.148080 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 486/976] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:49:08 2022] GET /compute/v2.1/servers/221108c9-a4b6-4e41-a9e5-a4e1461c991d => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 03:49:08.152903 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-cb346081-419e-4d7e-8d6b-b8b722b09f2b tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Calling method '.version_select at 0x7f72e80a6a60>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:49:08.162877 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [req-63b31e9d-84ea-46ef-ac9d-48c812ee54b6 req-8a1cabc8-3435-4d5f-aa24-17858d61ae77 service nova] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:49:08.169891 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [req-63b31e9d-84ea-46ef-ac9d-48c812ee54b6 req-8a1cabc8-3435-4d5f-aa24-17858d61ae77 service nova] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:49:08.178699 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.compute.server_external_events [req-63b31e9d-84ea-46ef-ac9d-48c812ee54b6 req-8a1cabc8-3435-4d5f-aa24-17858d61ae77 service nova] Creating event network-changed:c25e6478-642e-4e0b-ac56-ae850b56d17a for instance edb69fe3-e255-4e54-8e08-fff8bbc28d4f on hv-cinder-73306 Aug 04 03:49:08.184382 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [req-63b31e9d-84ea-46ef-ac9d-48c812ee54b6 req-8a1cabc8-3435-4d5f-aa24-17858d61ae77 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049336 Aug 04 03:49:08.185177 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 491/977] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 03:49:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 03:49:08.240632 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-cb346081-419e-4d7e-8d6b-b8b722b09f2b tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1668471969" status: 202 len: 0 microversion: 2.1 time: 0.090246 Aug 04 03:49:08.242516 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 487/978] 10.222.0.66 () {58 vars in 1221 bytes} [Thu Aug 4 03:49:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1668471969 => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 03:49:08.245570 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [req-0ea63b58-3b39-431a-9ea4-99f1dbfeba11 req-eed4b818-34b0-497e-8003-ca78c783702b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62affd75-bad1-417a-aac7-3495d56d9f19", "name": "network-vif-plugged", "status": "completed", "tag": "de2fd866-0219-43e7-a73a-fd446fc3c7ba"}]} {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 03:49:08.257012 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [req-0ea63b58-3b39-431a-9ea4-99f1dbfeba11 req-eed4b818-34b0-497e-8003-ca78c783702b service nova] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:49:08.257788 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [req-0ea63b58-3b39-431a-9ea4-99f1dbfeba11 req-eed4b818-34b0-497e-8003-ca78c783702b service nova] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:49:08.271581 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.compute.server_external_events [req-0ea63b58-3b39-431a-9ea4-99f1dbfeba11 req-eed4b818-34b0-497e-8003-ca78c783702b service nova] Creating event network-vif-plugged:de2fd866-0219-43e7-a73a-fd446fc3c7ba for instance 62affd75-bad1-417a-aac7-3495d56d9f19 on hv-cinder-73306 Aug 04 03:49:08.276901 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [req-0ea63b58-3b39-431a-9ea4-99f1dbfeba11 req-eed4b818-34b0-497e-8003-ca78c783702b service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035331 Aug 04 03:49:08.278123 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 492/979] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 03:49:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 03:49:08.691667 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-91aec8ad-2f3c-4f70-8ae0-b946fb5ee082 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:49:08.693104 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-91aec8ad-2f3c-4f70-8ae0-b946fb5ee082 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] [instance: 62affd75-bad1-417a-aac7-3495d56d9f19] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:49:08.700997 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-91aec8ad-2f3c-4f70-8ae0-b946fb5ee082 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:49:08.701994 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-91aec8ad-2f3c-4f70-8ae0-b946fb5ee082 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:49:08.705947 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-91aec8ad-2f3c-4f70-8ae0-b946fb5ee082 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:49:08.706429 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-91aec8ad-2f3c-4f70-8ae0-b946fb5ee082 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:49:08.877810 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-91aec8ad-2f3c-4f70-8ae0-b946fb5ee082 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:49:08.886999 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-91aec8ad-2f3c-4f70-8ae0-b946fb5ee082 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:49:08.888526 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-91aec8ad-2f3c-4f70-8ae0-b946fb5ee082 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:49:08.889788 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-91aec8ad-2f3c-4f70-8ae0-b946fb5ee082 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] 10.222.0.66 "GET /compute/v2.1/servers/62affd75-bad1-417a-aac7-3495d56d9f19" status: 200 len: 1745 microversion: 2.20 time: 0.203462 Aug 04 03:49:08.890341 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 488/980] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 03:49:08 2022] GET /compute/v2.1/servers/62affd75-bad1-417a-aac7-3495d56d9f19 => generated 1745 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 03:49:09.912890 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-fac7396d-9865-4788-b47b-a5ec8fe1d874 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:49:09.913603 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-fac7396d-9865-4788-b47b-a5ec8fe1d874 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] [instance: 62affd75-bad1-417a-aac7-3495d56d9f19] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:49:09.919748 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-fac7396d-9865-4788-b47b-a5ec8fe1d874 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:49:09.920844 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-fac7396d-9865-4788-b47b-a5ec8fe1d874 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:49:09.921786 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-fac7396d-9865-4788-b47b-a5ec8fe1d874 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:49:09.922222 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-fac7396d-9865-4788-b47b-a5ec8fe1d874 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:49:10.051013 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-fac7396d-9865-4788-b47b-a5ec8fe1d874 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:49:10.058896 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-fac7396d-9865-4788-b47b-a5ec8fe1d874 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:49:10.060391 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-fac7396d-9865-4788-b47b-a5ec8fe1d874 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:49:10.062225 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-fac7396d-9865-4788-b47b-a5ec8fe1d874 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] 10.222.0.66 "GET /compute/v2.1/servers/62affd75-bad1-417a-aac7-3495d56d9f19" status: 200 len: 1745 microversion: 2.20 time: 0.154058 Aug 04 03:49:10.062778 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 493/981] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 03:49:09 2022] GET /compute/v2.1/servers/62affd75-bad1-417a-aac7-3495d56d9f19 => generated 1745 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 03:49:11.084882 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-44b79912-d561-451a-94a5-96ef72f6299e tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:49:11.085525 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-44b79912-d561-451a-94a5-96ef72f6299e tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] [instance: 62affd75-bad1-417a-aac7-3495d56d9f19] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:49:11.091722 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-44b79912-d561-451a-94a5-96ef72f6299e tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:49:11.092350 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-44b79912-d561-451a-94a5-96ef72f6299e tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:49:11.093075 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-44b79912-d561-451a-94a5-96ef72f6299e tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:49:11.093540 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-44b79912-d561-451a-94a5-96ef72f6299e tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:49:11.227447 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-44b79912-d561-451a-94a5-96ef72f6299e tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:49:11.235882 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-44b79912-d561-451a-94a5-96ef72f6299e tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:49:11.237438 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-44b79912-d561-451a-94a5-96ef72f6299e tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:49:11.238606 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-44b79912-d561-451a-94a5-96ef72f6299e tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] 10.222.0.66 "GET /compute/v2.1/servers/62affd75-bad1-417a-aac7-3495d56d9f19" status: 200 len: 1745 microversion: 2.20 time: 0.157672 Aug 04 03:49:11.239168 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 489/982] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 03:49:11 2022] GET /compute/v2.1/servers/62affd75-bad1-417a-aac7-3495d56d9f19 => generated 1745 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 03:49:12.262121 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-325ad9ae-5079-4657-8d6a-7536e9bcf3dd tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:49:12.262726 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-325ad9ae-5079-4657-8d6a-7536e9bcf3dd tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] [instance: 62affd75-bad1-417a-aac7-3495d56d9f19] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:49:12.265880 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG dbcounter [-] [130262] Writing DB stats nova_api:SELECT=72,nova_api:UPDATE=1 {{(pid=130262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:49:12.270712 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-325ad9ae-5079-4657-8d6a-7536e9bcf3dd tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:49:12.275653 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-325ad9ae-5079-4657-8d6a-7536e9bcf3dd tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:49:12.275653 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-325ad9ae-5079-4657-8d6a-7536e9bcf3dd tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:49:12.275653 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-325ad9ae-5079-4657-8d6a-7536e9bcf3dd tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:49:12.551686 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-325ad9ae-5079-4657-8d6a-7536e9bcf3dd tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:49:12.559508 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-325ad9ae-5079-4657-8d6a-7536e9bcf3dd tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:49:12.561170 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-325ad9ae-5079-4657-8d6a-7536e9bcf3dd tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:49:12.562538 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-325ad9ae-5079-4657-8d6a-7536e9bcf3dd tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] 10.222.0.66 "GET /compute/v2.1/servers/62affd75-bad1-417a-aac7-3495d56d9f19" status: 200 len: 1745 microversion: 2.20 time: 0.304284 Aug 04 03:49:12.563095 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 494/983] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 03:49:12 2022] GET /compute/v2.1/servers/62affd75-bad1-417a-aac7-3495d56d9f19 => generated 1745 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 03:49:13.585743 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-0fca4eb0-4236-49bd-b94d-65017e9a6f6a tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:49:13.586294 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-0fca4eb0-4236-49bd-b94d-65017e9a6f6a tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] [instance: 62affd75-bad1-417a-aac7-3495d56d9f19] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:49:13.593105 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-0fca4eb0-4236-49bd-b94d-65017e9a6f6a tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:49:13.593616 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-0fca4eb0-4236-49bd-b94d-65017e9a6f6a tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:49:13.594400 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-0fca4eb0-4236-49bd-b94d-65017e9a6f6a tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:49:13.594843 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-0fca4eb0-4236-49bd-b94d-65017e9a6f6a tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:49:13.723116 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-0fca4eb0-4236-49bd-b94d-65017e9a6f6a tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:49:13.731300 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-0fca4eb0-4236-49bd-b94d-65017e9a6f6a tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:49:13.732811 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-0fca4eb0-4236-49bd-b94d-65017e9a6f6a tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:49:13.734679 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-0fca4eb0-4236-49bd-b94d-65017e9a6f6a tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] 10.222.0.66 "GET /compute/v2.1/servers/62affd75-bad1-417a-aac7-3495d56d9f19" status: 200 len: 1745 microversion: 2.20 time: 0.152422 Aug 04 03:49:13.735230 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 490/984] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 03:49:13 2022] GET /compute/v2.1/servers/62affd75-bad1-417a-aac7-3495d56d9f19 => generated 1745 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 03:49:14.756857 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-6287b033-7cbb-445d-ad1e-b72eece1f9a2 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:49:14.757494 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-6287b033-7cbb-445d-ad1e-b72eece1f9a2 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] [instance: 62affd75-bad1-417a-aac7-3495d56d9f19] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:49:14.763973 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-6287b033-7cbb-445d-ad1e-b72eece1f9a2 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:49:14.764415 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-6287b033-7cbb-445d-ad1e-b72eece1f9a2 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:49:14.765331 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-6287b033-7cbb-445d-ad1e-b72eece1f9a2 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:49:14.765882 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-6287b033-7cbb-445d-ad1e-b72eece1f9a2 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:49:14.894474 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-6287b033-7cbb-445d-ad1e-b72eece1f9a2 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:49:14.902310 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-6287b033-7cbb-445d-ad1e-b72eece1f9a2 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:49:14.903819 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-6287b033-7cbb-445d-ad1e-b72eece1f9a2 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:49:14.904962 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-6287b033-7cbb-445d-ad1e-b72eece1f9a2 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] 10.222.0.66 "GET /compute/v2.1/servers/62affd75-bad1-417a-aac7-3495d56d9f19" status: 200 len: 1745 microversion: 2.20 time: 0.151931 Aug 04 03:49:14.905567 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 495/985] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 03:49:14 2022] GET /compute/v2.1/servers/62affd75-bad1-417a-aac7-3495d56d9f19 => generated 1745 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 03:49:15.928590 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-a003e57d-1a9e-413a-b78a-22be188bcbb3 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:49:15.929192 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-a003e57d-1a9e-413a-b78a-22be188bcbb3 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] [instance: 62affd75-bad1-417a-aac7-3495d56d9f19] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:49:15.935780 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-a003e57d-1a9e-413a-b78a-22be188bcbb3 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:49:15.936231 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-a003e57d-1a9e-413a-b78a-22be188bcbb3 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:49:15.936983 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-a003e57d-1a9e-413a-b78a-22be188bcbb3 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:49:15.937439 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-a003e57d-1a9e-413a-b78a-22be188bcbb3 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:49:16.085972 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-a003e57d-1a9e-413a-b78a-22be188bcbb3 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:49:16.094886 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-a003e57d-1a9e-413a-b78a-22be188bcbb3 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:49:16.096457 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-a003e57d-1a9e-413a-b78a-22be188bcbb3 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:49:16.097785 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-a003e57d-1a9e-413a-b78a-22be188bcbb3 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] 10.222.0.66 "GET /compute/v2.1/servers/62affd75-bad1-417a-aac7-3495d56d9f19" status: 200 len: 1745 microversion: 2.20 time: 0.173141 Aug 04 03:49:16.098364 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 491/986] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 03:49:15 2022] GET /compute/v2.1/servers/62affd75-bad1-417a-aac7-3495d56d9f19 => generated 1745 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 03:49:17.045364 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-fb6ca853-d7f2-4315-888c-6e827ec06d2a tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:49:17.045853 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-fb6ca853-d7f2-4315-888c-6e827ec06d2a tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] [instance: 221108c9-a4b6-4e41-a9e5-a4e1461c991d] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:49:17.053127 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-fb6ca853-d7f2-4315-888c-6e827ec06d2a tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:49:17.053730 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-fb6ca853-d7f2-4315-888c-6e827ec06d2a tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:49:17.054452 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-fb6ca853-d7f2-4315-888c-6e827ec06d2a tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:49:17.054866 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-fb6ca853-d7f2-4315-888c-6e827ec06d2a tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:49:17.058979 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG dbcounter [-] [130262] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:49:17.068770 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.wsgi [None req-fb6ca853-d7f2-4315-888c-6e827ec06d2a tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] HTTP exception thrown: Instance 221108c9-a4b6-4e41-a9e5-a4e1461c991d could not be found. Aug 04 03:49:17.070530 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-fb6ca853-d7f2-4315-888c-6e827ec06d2a tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Request method failure captured: Aug 04 03:49:17.070530 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: request: DELETE /compute/v2.1/servers/221108c9-a4b6-4e41-a9e5-a4e1461c991d HTTP/1.1 Aug 04 03:49:17.070530 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: Accept: application/json Aug 04 03:49:17.070530 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: Accept-Encoding: identity Aug 04 03:49:17.070530 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: Connection: close Aug 04 03:49:17.070530 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: Content-Length: 0 Aug 04 03:49:17.070530 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: Content-Type: application/json Aug 04 03:49:17.070530 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: Host: 10.222.0.66 Aug 04 03:49:17.070530 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: Openstack-System-Scope: None Aug 04 03:49:17.070530 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: User-Agent: python-urllib3/1.26.11 Aug 04 03:49:17.070530 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Auth-Token: gAAAAABi6z9jjstLclSJhOUwTHf-ODCHOvyWYm-xiPGzTzYakNhh-XvfvUtN3VVw_rz9X8BxEZkSKeY1v-8BIr2pnIu_eB5LVFcULBBlXUhgFA2XNAhbiitHkPcF_YXvqofes1l3smLOqF7WJlDo1bBSfDCGzi4nCS4paxuU8y7pqn-SrPAYoNA Aug 04 03:49:17.070530 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Domain-Id: None Aug 04 03:49:17.070530 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Domain-Name: None Aug 04 03:49:17.070530 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Identity-Status: Confirmed Aug 04 03:49:17.070530 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Is-Admin-Project: True Aug 04 03:49:17.070530 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Project-Domain-Id: default Aug 04 03:49:17.070530 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Project-Domain-Name: Default Aug 04 03:49:17.070530 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Project-Id: f46b8dc64007429b805971d4c6f5b471 Aug 04 03:49:17.070530 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Project-Name: tempest-AttachVolumeTestJSON-422253214 Aug 04 03:49:17.070530 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Role: member,reader Aug 04 03:49:17.070530 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Roles: member,reader Aug 04 03:49:17.071917 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/f46b8dc64007429b805971d4c6f5b471"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f46b8dc64007429b805971d4c6f5b471"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f46b8dc64007429b805971d4c6f5b471"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_f46b8dc64007429b805971d4c6f5b471"}]}] Aug 04 03:49:17.071917 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Tenant: tempest-AttachVolumeTestJSON-422253214 Aug 04 03:49:17.071917 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Tenant-Id: f46b8dc64007429b805971d4c6f5b471 Aug 04 03:49:17.071917 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Tenant-Name: tempest-AttachVolumeTestJSON-422253214 Aug 04 03:49:17.071917 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-User: tempest-AttachVolumeTestJSON-422253214-project Aug 04 03:49:17.071917 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-User-Domain-Id: default Aug 04 03:49:17.071917 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-User-Domain-Name: Default Aug 04 03:49:17.071917 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-User-Id: 6dba436d0a67433f8c8ae7cd40d3f795 Aug 04 03:49:17.071917 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-User-Name: tempest-AttachVolumeTestJSON-422253214-project Aug 04 03:49:17.071917 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: method: > Aug 04 03:49:17.071917 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: exception: Instance 221108c9-a4b6-4e41-a9e5-a4e1461c991d could not be found. Aug 04 03:49:17.071917 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: action_args: {'id': '221108c9-a4b6-4e41-a9e5-a4e1461c991d'} Aug 04 03:49:17.072836 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 03:49:17.072836 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 03:49:17.072836 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 03:49:17.072836 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 03:49:17.072836 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 03:49:17.072836 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 03:49:17.072836 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 03:49:17.072836 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 03:49:17.072836 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 03:49:17.072836 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 03:49:17.072836 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 221108c9-a4b6-4e41-a9e5-a4e1461c991d could not be found. Aug 04 03:49:17.072836 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi Aug 04 03:49:17.072836 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 03:49:17.072836 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi Aug 04 03:49:17.072836 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 03:49:17.072836 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 03:49:17.072836 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 03:49:17.072836 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 03:49:17.072836 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 03:49:17.072836 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 03:49:17.074370 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 03:49:17.074370 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 03:49:17.074370 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 03:49:17.074370 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 03:49:17.074370 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 03:49:17.074370 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 03:49:17.074370 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 03:49:17.074370 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 03:49:17.074370 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 03:49:17.074370 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 221108c9-a4b6-4e41-a9e5-a4e1461c991d could not be found. Aug 04 03:49:17.074370 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi Aug 04 03:49:17.074370 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 03:49:17.074370 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi Aug 04 03:49:17.074370 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 03:49:17.074370 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 03:49:17.074370 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 03:49:17.074370 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 03:49:17.074370 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 03:49:17.074370 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 221108c9-a4b6-4e41-a9e5-a4e1461c991d could not be found. Aug 04 03:49:17.074370 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi Aug 04 03:49:17.076027 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-fb6ca853-d7f2-4315-888c-6e827ec06d2a tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Returning 404 to user: Instance 221108c9-a4b6-4e41-a9e5-a4e1461c991d could not be found. {{(pid=130262) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 03:49:17.076027 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-fb6ca853-d7f2-4315-888c-6e827ec06d2a tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] 10.222.0.66 "DELETE /compute/v2.1/servers/221108c9-a4b6-4e41-a9e5-a4e1461c991d" status: 404 len: 111 microversion: 2.1 time: 0.030512 Aug 04 03:49:17.076027 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 496/987] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 03:49:17 2022] DELETE /compute/v2.1/servers/221108c9-a4b6-4e41-a9e5-a4e1461c991d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 03:49:17.080988 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-33d26ba2-144c-4af2-a8c3-a0a1eaf7a740 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:49:17.081534 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-33d26ba2-144c-4af2-a8c3-a0a1eaf7a740 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] [instance: 221108c9-a4b6-4e41-a9e5-a4e1461c991d] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:49:17.096208 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-33d26ba2-144c-4af2-a8c3-a0a1eaf7a740 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:49:17.097943 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-33d26ba2-144c-4af2-a8c3-a0a1eaf7a740 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:49:17.097943 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-33d26ba2-144c-4af2-a8c3-a0a1eaf7a740 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:49:17.097943 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-33d26ba2-144c-4af2-a8c3-a0a1eaf7a740 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:49:17.112878 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.wsgi [None req-33d26ba2-144c-4af2-a8c3-a0a1eaf7a740 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] HTTP exception thrown: Instance 221108c9-a4b6-4e41-a9e5-a4e1461c991d could not be found. Aug 04 03:49:17.114467 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-33d26ba2-144c-4af2-a8c3-a0a1eaf7a740 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Request method failure captured: Aug 04 03:49:17.114467 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: request: GET /compute/v2.1/servers/221108c9-a4b6-4e41-a9e5-a4e1461c991d HTTP/1.1 Aug 04 03:49:17.114467 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Accept: application/json Aug 04 03:49:17.114467 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Accept-Encoding: identity Aug 04 03:49:17.114467 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Connection: close Aug 04 03:49:17.114467 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Content-Length: 0 Aug 04 03:49:17.114467 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Content-Type: application/json Aug 04 03:49:17.114467 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Host: 10.222.0.66 Aug 04 03:49:17.114467 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Openstack-System-Scope: None Aug 04 03:49:17.114467 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: User-Agent: python-urllib3/1.26.11 Aug 04 03:49:17.114467 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Auth-Token: gAAAAABi6z9jjstLclSJhOUwTHf-ODCHOvyWYm-xiPGzTzYakNhh-XvfvUtN3VVw_rz9X8BxEZkSKeY1v-8BIr2pnIu_eB5LVFcULBBlXUhgFA2XNAhbiitHkPcF_YXvqofes1l3smLOqF7WJlDo1bBSfDCGzi4nCS4paxuU8y7pqn-SrPAYoNA Aug 04 03:49:17.114467 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Domain-Id: None Aug 04 03:49:17.114467 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Domain-Name: None Aug 04 03:49:17.114467 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Identity-Status: Confirmed Aug 04 03:49:17.114467 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Is-Admin-Project: True Aug 04 03:49:17.114467 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Project-Domain-Id: default Aug 04 03:49:17.114467 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Project-Domain-Name: Default Aug 04 03:49:17.114467 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Project-Id: f46b8dc64007429b805971d4c6f5b471 Aug 04 03:49:17.114467 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Project-Name: tempest-AttachVolumeTestJSON-422253214 Aug 04 03:49:17.114467 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Role: member,reader Aug 04 03:49:17.114467 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Roles: member,reader Aug 04 03:49:17.116446 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/f46b8dc64007429b805971d4c6f5b471"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f46b8dc64007429b805971d4c6f5b471"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f46b8dc64007429b805971d4c6f5b471"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_f46b8dc64007429b805971d4c6f5b471"}]}] Aug 04 03:49:17.116446 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Tenant: tempest-AttachVolumeTestJSON-422253214 Aug 04 03:49:17.116446 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Tenant-Id: f46b8dc64007429b805971d4c6f5b471 Aug 04 03:49:17.116446 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Tenant-Name: tempest-AttachVolumeTestJSON-422253214 Aug 04 03:49:17.116446 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-User: tempest-AttachVolumeTestJSON-422253214-project Aug 04 03:49:17.116446 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-User-Domain-Id: default Aug 04 03:49:17.116446 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-User-Domain-Name: Default Aug 04 03:49:17.116446 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-User-Id: 6dba436d0a67433f8c8ae7cd40d3f795 Aug 04 03:49:17.116446 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-User-Name: tempest-AttachVolumeTestJSON-422253214-project Aug 04 03:49:17.116446 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: method: > Aug 04 03:49:17.116446 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: exception: Instance 221108c9-a4b6-4e41-a9e5-a4e1461c991d could not be found. Aug 04 03:49:17.116446 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: action_args: {'id': '221108c9-a4b6-4e41-a9e5-a4e1461c991d'} Aug 04 03:49:17.117325 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 03:49:17.117325 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 03:49:17.117325 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 03:49:17.117325 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 03:49:17.117325 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 03:49:17.117325 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 03:49:17.117325 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 03:49:17.117325 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 03:49:17.117325 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 03:49:17.117325 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 03:49:17.117325 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 221108c9-a4b6-4e41-a9e5-a4e1461c991d could not be found. Aug 04 03:49:17.117325 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Aug 04 03:49:17.117325 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 03:49:17.117325 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Aug 04 03:49:17.117325 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 03:49:17.117325 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 03:49:17.117325 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 03:49:17.117325 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 03:49:17.117325 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 03:49:17.117325 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 03:49:17.118498 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 03:49:17.118498 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 03:49:17.118498 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 03:49:17.118498 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 03:49:17.118498 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 03:49:17.118498 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 03:49:17.118498 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 03:49:17.118498 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 221108c9-a4b6-4e41-a9e5-a4e1461c991d could not be found. Aug 04 03:49:17.118498 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Aug 04 03:49:17.118498 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 03:49:17.118498 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Aug 04 03:49:17.118498 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 03:49:17.118498 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 03:49:17.118498 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 03:49:17.118498 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 03:49:17.118498 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 03:49:17.118498 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 221108c9-a4b6-4e41-a9e5-a4e1461c991d could not be found. Aug 04 03:49:17.118498 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Aug 04 03:49:17.120135 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-33d26ba2-144c-4af2-a8c3-a0a1eaf7a740 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Returning 404 to user: Instance 221108c9-a4b6-4e41-a9e5-a4e1461c991d could not be found. {{(pid=130263) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 03:49:17.120135 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-33d26ba2-144c-4af2-a8c3-a0a1eaf7a740 tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] 10.222.0.66 "GET /compute/v2.1/servers/221108c9-a4b6-4e41-a9e5-a4e1461c991d" status: 404 len: 111 microversion: 2.1 time: 0.039432 Aug 04 03:49:17.120135 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 492/988] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:49:17 2022] GET /compute/v2.1/servers/221108c9-a4b6-4e41-a9e5-a4e1461c991d => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 03:49:17.127377 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-08d1461b-db87-4355-9ad3-2f250f1b3602 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:49:17.127377 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-08d1461b-db87-4355-9ad3-2f250f1b3602 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] [instance: 62affd75-bad1-417a-aac7-3495d56d9f19] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:49:17.131232 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-08d1461b-db87-4355-9ad3-2f250f1b3602 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:49:17.131717 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-08d1461b-db87-4355-9ad3-2f250f1b3602 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:49:17.132543 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-08d1461b-db87-4355-9ad3-2f250f1b3602 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:49:17.132986 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-08d1461b-db87-4355-9ad3-2f250f1b3602 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:49:17.277377 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-08d1461b-db87-4355-9ad3-2f250f1b3602 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:49:17.286137 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-08d1461b-db87-4355-9ad3-2f250f1b3602 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:49:17.287639 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-08d1461b-db87-4355-9ad3-2f250f1b3602 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:49:17.288799 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-08d1461b-db87-4355-9ad3-2f250f1b3602 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] 10.222.0.66 "GET /compute/v2.1/servers/62affd75-bad1-417a-aac7-3495d56d9f19" status: 200 len: 1740 microversion: 2.20 time: 0.171045 Aug 04 03:49:17.289400 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 497/989] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 03:49:17 2022] GET /compute/v2.1/servers/62affd75-bad1-417a-aac7-3495d56d9f19 => generated 1740 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 03:49:18.270028 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 03:49:18.270667 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: Thu Aug 4 03:49:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 03:49:18.316422 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-adc59f00-2ccf-4058-a3b8-6e46bca29dfa tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:49:18.317695 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-adc59f00-2ccf-4058-a3b8-6e46bca29dfa tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] [instance: 62affd75-bad1-417a-aac7-3495d56d9f19] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:49:18.325934 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-adc59f00-2ccf-4058-a3b8-6e46bca29dfa tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:49:18.326646 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-adc59f00-2ccf-4058-a3b8-6e46bca29dfa tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:49:18.330604 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-adc59f00-2ccf-4058-a3b8-6e46bca29dfa tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:49:18.331061 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-adc59f00-2ccf-4058-a3b8-6e46bca29dfa tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:49:18.517794 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-adc59f00-2ccf-4058-a3b8-6e46bca29dfa tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:49:18.526104 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-adc59f00-2ccf-4058-a3b8-6e46bca29dfa tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:49:18.527852 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-adc59f00-2ccf-4058-a3b8-6e46bca29dfa tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:49:18.529020 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-adc59f00-2ccf-4058-a3b8-6e46bca29dfa tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] 10.222.0.66 "GET /compute/v2.1/servers/62affd75-bad1-417a-aac7-3495d56d9f19" status: 200 len: 1740 microversion: 2.20 time: 0.219567 Aug 04 03:49:18.529818 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 493/990] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 03:49:18 2022] GET /compute/v2.1/servers/62affd75-bad1-417a-aac7-3495d56d9f19 => generated 1740 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 03:49:19.553560 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-c6512a72-ba77-4731-9b18-825bbb99b3e9 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:49:19.554200 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-c6512a72-ba77-4731-9b18-825bbb99b3e9 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] [instance: 62affd75-bad1-417a-aac7-3495d56d9f19] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:49:19.560741 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-c6512a72-ba77-4731-9b18-825bbb99b3e9 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:49:19.561193 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-c6512a72-ba77-4731-9b18-825bbb99b3e9 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:49:19.561979 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-c6512a72-ba77-4731-9b18-825bbb99b3e9 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:49:19.562419 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-c6512a72-ba77-4731-9b18-825bbb99b3e9 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:49:19.695613 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-c6512a72-ba77-4731-9b18-825bbb99b3e9 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:49:19.703465 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-c6512a72-ba77-4731-9b18-825bbb99b3e9 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:49:19.704960 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-c6512a72-ba77-4731-9b18-825bbb99b3e9 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:49:19.706731 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-c6512a72-ba77-4731-9b18-825bbb99b3e9 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] 10.222.0.66 "GET /compute/v2.1/servers/62affd75-bad1-417a-aac7-3495d56d9f19" status: 200 len: 1740 microversion: 2.20 time: 0.157098 Aug 04 03:49:19.707269 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 498/991] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 03:49:19 2022] GET /compute/v2.1/servers/62affd75-bad1-417a-aac7-3495d56d9f19 => generated 1740 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 03:49:20.731903 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-c373cede-869a-4925-af7a-6ce6cbd56fc1 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:49:20.732767 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-c373cede-869a-4925-af7a-6ce6cbd56fc1 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] [instance: 62affd75-bad1-417a-aac7-3495d56d9f19] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:49:20.740743 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-c373cede-869a-4925-af7a-6ce6cbd56fc1 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:49:20.741239 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-c373cede-869a-4925-af7a-6ce6cbd56fc1 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:49:20.742001 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-c373cede-869a-4925-af7a-6ce6cbd56fc1 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:49:20.742445 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-c373cede-869a-4925-af7a-6ce6cbd56fc1 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:49:20.906638 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-c373cede-869a-4925-af7a-6ce6cbd56fc1 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:49:20.915521 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-c373cede-869a-4925-af7a-6ce6cbd56fc1 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:49:20.917064 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-c373cede-869a-4925-af7a-6ce6cbd56fc1 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:49:20.918325 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-c373cede-869a-4925-af7a-6ce6cbd56fc1 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] 10.222.0.66 "GET /compute/v2.1/servers/62affd75-bad1-417a-aac7-3495d56d9f19" status: 200 len: 1740 microversion: 2.20 time: 0.190914 Aug 04 03:49:20.918972 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 494/992] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 03:49:20 2022] GET /compute/v2.1/servers/62affd75-bad1-417a-aac7-3495d56d9f19 => generated 1740 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 03:49:21.111161 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-acc63195-0434-4955-b327-3eb831556f95 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-828761131", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-908000990", "security_groups": [{"name": "tempest-secgroup-smoke-212095973"}], "block_device_mapping_v2": [{"uuid": "640065af-b660-4f80-a2b8-4ef89d7d80dd", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "8d050520-b725-42ec-a591-c1de472eb260"}]}} {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 03:49:21.244130 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.network.neutron [None req-acc63195-0434-4955-b327-3eb831556f95 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] validate_networks() for [('8d050520-b725-42ec-a591-c1de472eb260', None, None, None, None, None)] {{(pid=130262) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 03:49:21.583270 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-b52981c1-1463-41cc-a6ff-4d5e1623406d tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:49:21.583757 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-b52981c1-1463-41cc-a6ff-4d5e1623406d tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] [instance: 9307fdad-ca63-449d-bc5c-7e9e167c59f3] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:49:21.590853 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-b52981c1-1463-41cc-a6ff-4d5e1623406d tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:49:21.591672 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-b52981c1-1463-41cc-a6ff-4d5e1623406d tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:49:21.592686 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-b52981c1-1463-41cc-a6ff-4d5e1623406d tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:49:21.593370 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-b52981c1-1463-41cc-a6ff-4d5e1623406d tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:49:21.609709 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.wsgi [None req-b52981c1-1463-41cc-a6ff-4d5e1623406d tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] HTTP exception thrown: Instance 9307fdad-ca63-449d-bc5c-7e9e167c59f3 could not be found. Aug 04 03:49:21.612010 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-b52981c1-1463-41cc-a6ff-4d5e1623406d tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Request method failure captured: Aug 04 03:49:21.612010 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: request: DELETE /compute/v2.1/servers/9307fdad-ca63-449d-bc5c-7e9e167c59f3 HTTP/1.1 Aug 04 03:49:21.612010 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Accept: application/json Aug 04 03:49:21.612010 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Accept-Encoding: identity Aug 04 03:49:21.612010 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Connection: close Aug 04 03:49:21.612010 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Content-Length: 0 Aug 04 03:49:21.612010 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Content-Type: application/json Aug 04 03:49:21.612010 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Host: 10.222.0.66 Aug 04 03:49:21.612010 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Openstack-System-Scope: None Aug 04 03:49:21.612010 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: User-Agent: python-urllib3/1.26.11 Aug 04 03:49:21.612010 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Auth-Token: gAAAAABi6z9jjstLclSJhOUwTHf-ODCHOvyWYm-xiPGzTzYakNhh-XvfvUtN3VVw_rz9X8BxEZkSKeY1v-8BIr2pnIu_eB5LVFcULBBlXUhgFA2XNAhbiitHkPcF_YXvqofes1l3smLOqF7WJlDo1bBSfDCGzi4nCS4paxuU8y7pqn-SrPAYoNA Aug 04 03:49:21.612010 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Domain-Id: None Aug 04 03:49:21.612010 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Domain-Name: None Aug 04 03:49:21.612010 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Identity-Status: Confirmed Aug 04 03:49:21.612010 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Is-Admin-Project: True Aug 04 03:49:21.612010 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Project-Domain-Id: default Aug 04 03:49:21.612010 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Project-Domain-Name: Default Aug 04 03:49:21.612010 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Project-Id: f46b8dc64007429b805971d4c6f5b471 Aug 04 03:49:21.612010 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Project-Name: tempest-AttachVolumeTestJSON-422253214 Aug 04 03:49:21.612010 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Role: member,reader Aug 04 03:49:21.612010 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Roles: member,reader Aug 04 03:49:21.613339 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/f46b8dc64007429b805971d4c6f5b471"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f46b8dc64007429b805971d4c6f5b471"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f46b8dc64007429b805971d4c6f5b471"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_f46b8dc64007429b805971d4c6f5b471"}]}] Aug 04 03:49:21.613339 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Tenant: tempest-AttachVolumeTestJSON-422253214 Aug 04 03:49:21.613339 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Tenant-Id: f46b8dc64007429b805971d4c6f5b471 Aug 04 03:49:21.613339 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Tenant-Name: tempest-AttachVolumeTestJSON-422253214 Aug 04 03:49:21.613339 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-User: tempest-AttachVolumeTestJSON-422253214-project Aug 04 03:49:21.613339 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-User-Domain-Id: default Aug 04 03:49:21.613339 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-User-Domain-Name: Default Aug 04 03:49:21.613339 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-User-Id: 6dba436d0a67433f8c8ae7cd40d3f795 Aug 04 03:49:21.613339 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-User-Name: tempest-AttachVolumeTestJSON-422253214-project Aug 04 03:49:21.613339 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: method: > Aug 04 03:49:21.613339 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: exception: Instance 9307fdad-ca63-449d-bc5c-7e9e167c59f3 could not be found. Aug 04 03:49:21.613339 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: action_args: {'id': '9307fdad-ca63-449d-bc5c-7e9e167c59f3'} Aug 04 03:49:21.614038 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 03:49:21.614038 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 03:49:21.614038 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 03:49:21.614038 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 03:49:21.614038 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 03:49:21.614038 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 03:49:21.614038 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 03:49:21.614038 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 03:49:21.614038 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 03:49:21.614038 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 03:49:21.614038 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9307fdad-ca63-449d-bc5c-7e9e167c59f3 could not be found. Aug 04 03:49:21.614038 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Aug 04 03:49:21.614038 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 03:49:21.614038 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Aug 04 03:49:21.614038 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 03:49:21.614038 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 03:49:21.614038 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 03:49:21.614038 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 03:49:21.614038 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 03:49:21.614038 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 03:49:21.615183 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 03:49:21.615183 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 03:49:21.615183 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 03:49:21.615183 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 03:49:21.615183 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 03:49:21.615183 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 03:49:21.615183 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 03:49:21.615183 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 03:49:21.615183 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 03:49:21.615183 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9307fdad-ca63-449d-bc5c-7e9e167c59f3 could not be found. Aug 04 03:49:21.615183 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Aug 04 03:49:21.615183 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 03:49:21.615183 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Aug 04 03:49:21.615183 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 03:49:21.615183 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 03:49:21.615183 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 03:49:21.615183 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 03:49:21.615183 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 03:49:21.615183 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9307fdad-ca63-449d-bc5c-7e9e167c59f3 could not be found. Aug 04 03:49:21.615183 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Aug 04 03:49:21.617971 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-b52981c1-1463-41cc-a6ff-4d5e1623406d tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Returning 404 to user: Instance 9307fdad-ca63-449d-bc5c-7e9e167c59f3 could not be found. {{(pid=130263) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 03:49:21.619237 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-b52981c1-1463-41cc-a6ff-4d5e1623406d tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] 10.222.0.66 "DELETE /compute/v2.1/servers/9307fdad-ca63-449d-bc5c-7e9e167c59f3" status: 404 len: 111 microversion: 2.1 time: 0.039693 Aug 04 03:49:21.620325 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 495/993] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 03:49:21 2022] DELETE /compute/v2.1/servers/9307fdad-ca63-449d-bc5c-7e9e167c59f3 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 03:49:21.632088 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-70ebb8da-865f-4b23-bc0e-42571da27aaf tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:49:21.632716 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-70ebb8da-865f-4b23-bc0e-42571da27aaf tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] [instance: 9307fdad-ca63-449d-bc5c-7e9e167c59f3] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:49:21.641061 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-70ebb8da-865f-4b23-bc0e-42571da27aaf tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:49:21.641585 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-70ebb8da-865f-4b23-bc0e-42571da27aaf tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:49:21.642395 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-70ebb8da-865f-4b23-bc0e-42571da27aaf tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:49:21.643057 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-70ebb8da-865f-4b23-bc0e-42571da27aaf tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:49:21.662411 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.wsgi [None req-70ebb8da-865f-4b23-bc0e-42571da27aaf tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] HTTP exception thrown: Instance 9307fdad-ca63-449d-bc5c-7e9e167c59f3 could not be found. Aug 04 03:49:21.664751 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-70ebb8da-865f-4b23-bc0e-42571da27aaf tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Request method failure captured: Aug 04 03:49:21.664751 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: request: GET /compute/v2.1/servers/9307fdad-ca63-449d-bc5c-7e9e167c59f3 HTTP/1.1 Aug 04 03:49:21.664751 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Accept: application/json Aug 04 03:49:21.664751 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Accept-Encoding: identity Aug 04 03:49:21.664751 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Connection: close Aug 04 03:49:21.664751 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Content-Length: 0 Aug 04 03:49:21.664751 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Content-Type: application/json Aug 04 03:49:21.664751 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Host: 10.222.0.66 Aug 04 03:49:21.664751 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Openstack-System-Scope: None Aug 04 03:49:21.664751 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: User-Agent: python-urllib3/1.26.11 Aug 04 03:49:21.664751 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Auth-Token: gAAAAABi6z9jjstLclSJhOUwTHf-ODCHOvyWYm-xiPGzTzYakNhh-XvfvUtN3VVw_rz9X8BxEZkSKeY1v-8BIr2pnIu_eB5LVFcULBBlXUhgFA2XNAhbiitHkPcF_YXvqofes1l3smLOqF7WJlDo1bBSfDCGzi4nCS4paxuU8y7pqn-SrPAYoNA Aug 04 03:49:21.664751 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Domain-Id: None Aug 04 03:49:21.664751 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Domain-Name: None Aug 04 03:49:21.664751 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Identity-Status: Confirmed Aug 04 03:49:21.664751 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Is-Admin-Project: True Aug 04 03:49:21.664751 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Project-Domain-Id: default Aug 04 03:49:21.664751 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Project-Domain-Name: Default Aug 04 03:49:21.664751 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Project-Id: f46b8dc64007429b805971d4c6f5b471 Aug 04 03:49:21.664751 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Project-Name: tempest-AttachVolumeTestJSON-422253214 Aug 04 03:49:21.664751 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Role: member,reader Aug 04 03:49:21.664751 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Roles: member,reader Aug 04 03:49:21.666099 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/f46b8dc64007429b805971d4c6f5b471"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f46b8dc64007429b805971d4c6f5b471"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/f46b8dc64007429b805971d4c6f5b471"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_f46b8dc64007429b805971d4c6f5b471"}]}] Aug 04 03:49:21.666099 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Tenant: tempest-AttachVolumeTestJSON-422253214 Aug 04 03:49:21.666099 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Tenant-Id: f46b8dc64007429b805971d4c6f5b471 Aug 04 03:49:21.666099 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Tenant-Name: tempest-AttachVolumeTestJSON-422253214 Aug 04 03:49:21.666099 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-User: tempest-AttachVolumeTestJSON-422253214-project Aug 04 03:49:21.666099 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-User-Domain-Id: default Aug 04 03:49:21.666099 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-User-Domain-Name: Default Aug 04 03:49:21.666099 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-User-Id: 6dba436d0a67433f8c8ae7cd40d3f795 Aug 04 03:49:21.666099 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-User-Name: tempest-AttachVolumeTestJSON-422253214-project Aug 04 03:49:21.666099 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: method: > Aug 04 03:49:21.666099 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: exception: Instance 9307fdad-ca63-449d-bc5c-7e9e167c59f3 could not be found. Aug 04 03:49:21.666099 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: action_args: {'id': '9307fdad-ca63-449d-bc5c-7e9e167c59f3'} Aug 04 03:49:21.666826 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 03:49:21.666826 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 03:49:21.666826 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 03:49:21.666826 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 03:49:21.666826 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 03:49:21.666826 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 03:49:21.666826 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 03:49:21.666826 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 03:49:21.666826 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 03:49:21.666826 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 03:49:21.666826 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9307fdad-ca63-449d-bc5c-7e9e167c59f3 could not be found. Aug 04 03:49:21.666826 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Aug 04 03:49:21.666826 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 03:49:21.666826 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Aug 04 03:49:21.666826 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 03:49:21.666826 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 03:49:21.666826 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 03:49:21.666826 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 03:49:21.666826 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 03:49:21.666826 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 03:49:21.667972 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 03:49:21.667972 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 03:49:21.667972 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 03:49:21.667972 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 03:49:21.667972 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 03:49:21.667972 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 03:49:21.667972 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 03:49:21.667972 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9307fdad-ca63-449d-bc5c-7e9e167c59f3 could not be found. Aug 04 03:49:21.667972 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Aug 04 03:49:21.667972 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 03:49:21.667972 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Aug 04 03:49:21.667972 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 03:49:21.667972 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 03:49:21.667972 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 03:49:21.667972 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 03:49:21.667972 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 03:49:21.667972 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9307fdad-ca63-449d-bc5c-7e9e167c59f3 could not be found. Aug 04 03:49:21.667972 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Aug 04 03:49:21.670901 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-70ebb8da-865f-4b23-bc0e-42571da27aaf tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] Returning 404 to user: Instance 9307fdad-ca63-449d-bc5c-7e9e167c59f3 could not be found. {{(pid=130263) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 03:49:21.672307 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-70ebb8da-865f-4b23-bc0e-42571da27aaf tempest-AttachVolumeTestJSON-422253214 tempest-AttachVolumeTestJSON-422253214-project] 10.222.0.66 "GET /compute/v2.1/servers/9307fdad-ca63-449d-bc5c-7e9e167c59f3" status: 404 len: 111 microversion: 2.1 time: 0.047787 Aug 04 03:49:21.690957 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 496/994] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:49:21 2022] GET /compute/v2.1/servers/9307fdad-ca63-449d-bc5c-7e9e167c59f3 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 04 03:49:21.944085 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-c80cf22e-adb6-4511-9bbb-1f8201f51ec2 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:49:21.944984 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-c80cf22e-adb6-4511-9bbb-1f8201f51ec2 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] [instance: 62affd75-bad1-417a-aac7-3495d56d9f19] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:49:21.945095 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.virt.hardware [None req-acc63195-0434-4955-b327-3eb831556f95 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Flavor limits 0:0:0 {{(pid=130262) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 03:49:21.945632 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.virt.hardware [None req-acc63195-0434-4955-b327-3eb831556f95 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Image limits 0:0:0 {{(pid=130262) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 03:49:21.946184 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.virt.hardware [None req-acc63195-0434-4955-b327-3eb831556f95 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Flavor pref 0:0:0 {{(pid=130262) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 03:49:21.947180 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.virt.hardware [None req-acc63195-0434-4955-b327-3eb831556f95 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Image pref 0:0:0 {{(pid=130262) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 03:49:21.947180 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.virt.hardware [None req-acc63195-0434-4955-b327-3eb831556f95 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130262) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 03:49:21.952445 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-c80cf22e-adb6-4511-9bbb-1f8201f51ec2 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:49:21.952869 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-c80cf22e-adb6-4511-9bbb-1f8201f51ec2 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:49:21.953688 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-c80cf22e-adb6-4511-9bbb-1f8201f51ec2 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:49:21.954136 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-c80cf22e-adb6-4511-9bbb-1f8201f51ec2 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:49:21.958484 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-acc63195-0434-4955-b327-3eb831556f95 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:49:21.959001 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-acc63195-0434-4955-b327-3eb831556f95 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:49:21.959885 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-acc63195-0434-4955-b327-3eb831556f95 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:49:21.960497 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-acc63195-0434-4955-b327-3eb831556f95 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:49:21.981794 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.quota [None req-acc63195-0434-4955-b327-3eb831556f95 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Getting quotas for project 32813adc26c64016b99c9c5fd838d391. Resources: {'instances', 'ram', 'cores'} {{(pid=130262) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 03:49:21.986152 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.quota [None req-acc63195-0434-4955-b327-3eb831556f95 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Getting quotas for user ac48e585c133487dadbe0a1e095bfde0 and project 32813adc26c64016b99c9c5fd838d391. Resources: {'instances', 'ram', 'cores'} {{(pid=130262) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 03:49:22.221949 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-acc63195-0434-4955-b327-3eb831556f95 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Going to run 1 instances... {{(pid=130262) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 03:49:22.224145 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-acc63195-0434-4955-b327-3eb831556f95 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] [instance: 9c94175f-2d56-454e-a834-4f54bf9df739] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='640065af-b660-4f80-a2b8-4ef89d7d80dd',volume_size=None,volume_type=None)] {{(pid=130262) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 03:49:22.292947 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-c80cf22e-adb6-4511-9bbb-1f8201f51ec2 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:49:22.301836 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-c80cf22e-adb6-4511-9bbb-1f8201f51ec2 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:49:22.303364 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-c80cf22e-adb6-4511-9bbb-1f8201f51ec2 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:49:22.304542 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-c80cf22e-adb6-4511-9bbb-1f8201f51ec2 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] 10.222.0.66 "GET /compute/v2.1/servers/62affd75-bad1-417a-aac7-3495d56d9f19" status: 200 len: 1740 microversion: 2.20 time: 0.365165 Aug 04 03:49:22.305135 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 497/995] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 03:49:21 2022] GET /compute/v2.1/servers/62affd75-bad1-417a-aac7-3495d56d9f19 => generated 1740 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 03:49:22.835729 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-acc63195-0434-4955-b327-3eb831556f95 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.728604 Aug 04 03:49:22.837094 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 499/996] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 03:49:21 2022] POST /compute/v2.1/servers => generated 405 bytes in 1731 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 03:49:22.856919 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-42446115-9360-43b0-b04b-e63db01f6ce0 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:49:22.857372 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-42446115-9360-43b0-b04b-e63db01f6ce0 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] [instance: 9c94175f-2d56-454e-a834-4f54bf9df739] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:49:22.938875 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-42446115-9360-43b0-b04b-e63db01f6ce0 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac48e585c133487dadbe0a1e095bfde0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32813adc26c64016b99c9c5fd838d391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:49:22.946564 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-42446115-9360-43b0-b04b-e63db01f6ce0 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] 10.222.0.66 "GET /compute/v2.1/servers/9c94175f-2d56-454e-a834-4f54bf9df739" status: 200 len: 1093 microversion: 2.1 time: 0.102165 Aug 04 03:49:22.964196 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 498/997] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:49:22 2022] GET /compute/v2.1/servers/9c94175f-2d56-454e-a834-4f54bf9df739 => generated 1093 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:49:23.329110 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-87453384-a268-4de7-9e30-1f04926dd30b tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:49:23.331947 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-87453384-a268-4de7-9e30-1f04926dd30b tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] [instance: 62affd75-bad1-417a-aac7-3495d56d9f19] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:49:23.340233 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-87453384-a268-4de7-9e30-1f04926dd30b tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:49:23.344927 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-87453384-a268-4de7-9e30-1f04926dd30b tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:49:23.344927 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-87453384-a268-4de7-9e30-1f04926dd30b tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:49:23.344927 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-87453384-a268-4de7-9e30-1f04926dd30b tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:49:23.600043 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-87453384-a268-4de7-9e30-1f04926dd30b tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:49:23.615922 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-87453384-a268-4de7-9e30-1f04926dd30b tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:49:23.619029 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-87453384-a268-4de7-9e30-1f04926dd30b tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:49:23.620502 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-87453384-a268-4de7-9e30-1f04926dd30b tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] 10.222.0.66 "GET /compute/v2.1/servers/62affd75-bad1-417a-aac7-3495d56d9f19" status: 200 len: 1740 microversion: 2.20 time: 0.295889 Aug 04 03:49:23.628376 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 500/998] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 03:49:23 2022] GET /compute/v2.1/servers/62affd75-bad1-417a-aac7-3495d56d9f19 => generated 1740 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 03:49:23.973673 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-3bd1dd2e-8706-40fa-88da-5962a01a23fd tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:49:23.975331 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-3bd1dd2e-8706-40fa-88da-5962a01a23fd tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] [instance: 9c94175f-2d56-454e-a834-4f54bf9df739] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:49:23.994234 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-3bd1dd2e-8706-40fa-88da-5962a01a23fd tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:49:23.994884 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-3bd1dd2e-8706-40fa-88da-5962a01a23fd tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:49:23.996451 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-3bd1dd2e-8706-40fa-88da-5962a01a23fd tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:49:23.998653 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-3bd1dd2e-8706-40fa-88da-5962a01a23fd tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:49:24.117637 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-3bd1dd2e-8706-40fa-88da-5962a01a23fd tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac48e585c133487dadbe0a1e095bfde0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32813adc26c64016b99c9c5fd838d391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:49:24.133022 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-3bd1dd2e-8706-40fa-88da-5962a01a23fd tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] 10.222.0.66 "GET /compute/v2.1/servers/9c94175f-2d56-454e-a834-4f54bf9df739" status: 200 len: 1143 microversion: 2.1 time: 0.165605 Aug 04 03:49:24.134395 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 499/999] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:49:23 2022] GET /compute/v2.1/servers/9c94175f-2d56-454e-a834-4f54bf9df739 => generated 1143 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:49:24.649019 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-aae75d3d-38dd-4194-8d95-ccf5337b67ba tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:49:24.649678 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-aae75d3d-38dd-4194-8d95-ccf5337b67ba tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] [instance: 62affd75-bad1-417a-aac7-3495d56d9f19] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:49:24.657954 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-aae75d3d-38dd-4194-8d95-ccf5337b67ba tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:49:24.659241 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-aae75d3d-38dd-4194-8d95-ccf5337b67ba tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:49:24.660342 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-aae75d3d-38dd-4194-8d95-ccf5337b67ba tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:49:24.660960 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-aae75d3d-38dd-4194-8d95-ccf5337b67ba tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:49:24.868187 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-aae75d3d-38dd-4194-8d95-ccf5337b67ba tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:49:24.879611 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-aae75d3d-38dd-4194-8d95-ccf5337b67ba tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:49:24.881594 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-aae75d3d-38dd-4194-8d95-ccf5337b67ba tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:49:24.884721 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-aae75d3d-38dd-4194-8d95-ccf5337b67ba tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] 10.222.0.66 "GET /compute/v2.1/servers/62affd75-bad1-417a-aac7-3495d56d9f19" status: 200 len: 1740 microversion: 2.20 time: 0.244576 Aug 04 03:49:24.912623 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 501/1000] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 03:49:24 2022] GET /compute/v2.1/servers/62affd75-bad1-417a-aac7-3495d56d9f19 => generated 1740 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 03:49:25.154669 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-15de4536-b622-46a2-975e-38d3c51b9a10 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:49:25.155293 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-15de4536-b622-46a2-975e-38d3c51b9a10 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] [instance: 9c94175f-2d56-454e-a834-4f54bf9df739] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:49:25.173820 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-15de4536-b622-46a2-975e-38d3c51b9a10 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:49:25.177914 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-15de4536-b622-46a2-975e-38d3c51b9a10 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:49:25.179058 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-15de4536-b622-46a2-975e-38d3c51b9a10 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:49:25.180855 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-15de4536-b622-46a2-975e-38d3c51b9a10 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:49:25.212494 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG dbcounter [-] [130263] Writing DB stats nova_cell1:SELECT=100 {{(pid=130263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:49:25.289931 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-15de4536-b622-46a2-975e-38d3c51b9a10 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac48e585c133487dadbe0a1e095bfde0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32813adc26c64016b99c9c5fd838d391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:49:25.298802 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-15de4536-b622-46a2-975e-38d3c51b9a10 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] 10.222.0.66 "GET /compute/v2.1/servers/9c94175f-2d56-454e-a834-4f54bf9df739" status: 200 len: 1199 microversion: 2.1 time: 0.148537 Aug 04 03:49:25.302577 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 500/1001] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:49:25 2022] GET /compute/v2.1/servers/9c94175f-2d56-454e-a834-4f54bf9df739 => generated 1199 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:49:25.908070 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-41fb12b7-3543-475a-9345-ad067f9870e8 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:49:25.909370 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-41fb12b7-3543-475a-9345-ad067f9870e8 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] [instance: 62affd75-bad1-417a-aac7-3495d56d9f19] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:49:25.916755 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-41fb12b7-3543-475a-9345-ad067f9870e8 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:49:25.917236 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-41fb12b7-3543-475a-9345-ad067f9870e8 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:49:25.918018 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-41fb12b7-3543-475a-9345-ad067f9870e8 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:49:25.918462 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-41fb12b7-3543-475a-9345-ad067f9870e8 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:49:26.162476 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-41fb12b7-3543-475a-9345-ad067f9870e8 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:49:26.175403 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-41fb12b7-3543-475a-9345-ad067f9870e8 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:49:26.180900 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-41fb12b7-3543-475a-9345-ad067f9870e8 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:49:26.190454 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-41fb12b7-3543-475a-9345-ad067f9870e8 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] 10.222.0.66 "GET /compute/v2.1/servers/62affd75-bad1-417a-aac7-3495d56d9f19" status: 200 len: 1740 microversion: 2.20 time: 0.285385 Aug 04 03:49:26.190911 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 502/1002] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 03:49:25 2022] GET /compute/v2.1/servers/62affd75-bad1-417a-aac7-3495d56d9f19 => generated 1740 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 03:49:26.335249 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-bfc45ad2-5bec-4127-8b83-a2b000c93489 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:49:26.336048 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-bfc45ad2-5bec-4127-8b83-a2b000c93489 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] [instance: 9c94175f-2d56-454e-a834-4f54bf9df739] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:49:26.347116 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-bfc45ad2-5bec-4127-8b83-a2b000c93489 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:49:26.347116 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-bfc45ad2-5bec-4127-8b83-a2b000c93489 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:49:26.347454 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-bfc45ad2-5bec-4127-8b83-a2b000c93489 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:49:26.361475 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-bfc45ad2-5bec-4127-8b83-a2b000c93489 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:49:26.776105 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-bfc45ad2-5bec-4127-8b83-a2b000c93489 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac48e585c133487dadbe0a1e095bfde0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32813adc26c64016b99c9c5fd838d391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:49:26.784821 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-bfc45ad2-5bec-4127-8b83-a2b000c93489 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] 10.222.0.66 "GET /compute/v2.1/servers/9c94175f-2d56-454e-a834-4f54bf9df739" status: 200 len: 1276 microversion: 2.1 time: 0.454093 Aug 04 03:49:26.785428 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 501/1003] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:49:26 2022] GET /compute/v2.1/servers/9c94175f-2d56-454e-a834-4f54bf9df739 => generated 1276 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:49:27.214731 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-8f984fd5-4fb8-4bf3-9b30-6cad01a82d1c tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:49:27.215344 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-8f984fd5-4fb8-4bf3-9b30-6cad01a82d1c tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] [instance: 62affd75-bad1-417a-aac7-3495d56d9f19] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:49:27.225124 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-8f984fd5-4fb8-4bf3-9b30-6cad01a82d1c tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:49:27.225715 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-8f984fd5-4fb8-4bf3-9b30-6cad01a82d1c tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:49:27.226519 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-8f984fd5-4fb8-4bf3-9b30-6cad01a82d1c tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:49:27.228458 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-8f984fd5-4fb8-4bf3-9b30-6cad01a82d1c tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:49:27.417810 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-8f984fd5-4fb8-4bf3-9b30-6cad01a82d1c tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:49:27.422788 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-8f984fd5-4fb8-4bf3-9b30-6cad01a82d1c tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:49:27.424494 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-8f984fd5-4fb8-4bf3-9b30-6cad01a82d1c tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:49:27.426794 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-8f984fd5-4fb8-4bf3-9b30-6cad01a82d1c tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] 10.222.0.66 "GET /compute/v2.1/servers/62affd75-bad1-417a-aac7-3495d56d9f19" status: 200 len: 1740 microversion: 2.20 time: 0.216037 Aug 04 03:49:27.427480 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 503/1004] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 03:49:27 2022] GET /compute/v2.1/servers/62affd75-bad1-417a-aac7-3495d56d9f19 => generated 1740 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 03:49:27.807947 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-0b9e17c6-9970-4f6e-9f44-a452c6292bba tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:49:27.808684 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-0b9e17c6-9970-4f6e-9f44-a452c6292bba tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] [instance: 9c94175f-2d56-454e-a834-4f54bf9df739] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:49:27.816571 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-0b9e17c6-9970-4f6e-9f44-a452c6292bba tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:49:27.819344 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-0b9e17c6-9970-4f6e-9f44-a452c6292bba tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:49:27.825987 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-0b9e17c6-9970-4f6e-9f44-a452c6292bba tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:49:27.827606 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-0b9e17c6-9970-4f6e-9f44-a452c6292bba tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:49:28.054734 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-0b9e17c6-9970-4f6e-9f44-a452c6292bba tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac48e585c133487dadbe0a1e095bfde0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32813adc26c64016b99c9c5fd838d391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:49:28.063394 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-0b9e17c6-9970-4f6e-9f44-a452c6292bba tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] 10.222.0.66 "GET /compute/v2.1/servers/9c94175f-2d56-454e-a834-4f54bf9df739" status: 200 len: 1264 microversion: 2.1 time: 0.261021 Aug 04 03:49:28.064037 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 502/1005] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:49:27 2022] GET /compute/v2.1/servers/9c94175f-2d56-454e-a834-4f54bf9df739 => generated 1264 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 03:49:28.113874 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [req-4aab8b18-6578-41a1-991c-ed2fc6c284bf req-81fa86eb-5c9e-4082-bdad-9e563a007cbd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c94175f-2d56-454e-a834-4f54bf9df739", "tag": "f138a127-97be-4818-9ebe-61a13e12b1e2"}]} {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 03:49:28.125306 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [req-4aab8b18-6578-41a1-991c-ed2fc6c284bf req-81fa86eb-5c9e-4082-bdad-9e563a007cbd service nova] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:49:28.125749 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [req-4aab8b18-6578-41a1-991c-ed2fc6c284bf req-81fa86eb-5c9e-4082-bdad-9e563a007cbd service nova] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:49:28.143886 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.compute.server_external_events [req-4aab8b18-6578-41a1-991c-ed2fc6c284bf req-81fa86eb-5c9e-4082-bdad-9e563a007cbd service nova] Creating event network-changed:f138a127-97be-4818-9ebe-61a13e12b1e2 for instance 9c94175f-2d56-454e-a834-4f54bf9df739 on hv-cinder-73306 Aug 04 03:49:28.150599 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [req-4aab8b18-6578-41a1-991c-ed2fc6c284bf req-81fa86eb-5c9e-4082-bdad-9e563a007cbd service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041594 Aug 04 03:49:28.151886 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 504/1006] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 03:49:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 03:49:28.453969 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-84a7aa17-a2dc-45ba-89f5-fb40920df061 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:49:28.457003 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-84a7aa17-a2dc-45ba-89f5-fb40920df061 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] [instance: 62affd75-bad1-417a-aac7-3495d56d9f19] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:49:28.464039 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-84a7aa17-a2dc-45ba-89f5-fb40920df061 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:49:28.464819 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-84a7aa17-a2dc-45ba-89f5-fb40920df061 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:49:28.465875 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-84a7aa17-a2dc-45ba-89f5-fb40920df061 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:49:28.466678 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-84a7aa17-a2dc-45ba-89f5-fb40920df061 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:49:28.700897 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-84a7aa17-a2dc-45ba-89f5-fb40920df061 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:49:28.711664 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-84a7aa17-a2dc-45ba-89f5-fb40920df061 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:49:28.714647 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-84a7aa17-a2dc-45ba-89f5-fb40920df061 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:49:28.716905 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-84a7aa17-a2dc-45ba-89f5-fb40920df061 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] 10.222.0.66 "GET /compute/v2.1/servers/62affd75-bad1-417a-aac7-3495d56d9f19" status: 200 len: 1740 microversion: 2.20 time: 0.266766 Aug 04 03:49:28.748305 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 503/1007] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 03:49:28 2022] GET /compute/v2.1/servers/62affd75-bad1-417a-aac7-3495d56d9f19 => generated 1740 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 03:49:29.085074 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-9be4a684-1053-4488-91a7-b93dcbb0de73 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:49:29.085894 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-9be4a684-1053-4488-91a7-b93dcbb0de73 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] [instance: 9c94175f-2d56-454e-a834-4f54bf9df739] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:49:29.095071 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-9be4a684-1053-4488-91a7-b93dcbb0de73 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:49:29.095816 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-9be4a684-1053-4488-91a7-b93dcbb0de73 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:49:29.096702 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-9be4a684-1053-4488-91a7-b93dcbb0de73 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:49:29.097136 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-9be4a684-1053-4488-91a7-b93dcbb0de73 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:49:29.286631 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-9be4a684-1053-4488-91a7-b93dcbb0de73 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac48e585c133487dadbe0a1e095bfde0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32813adc26c64016b99c9c5fd838d391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:49:29.294435 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-9be4a684-1053-4488-91a7-b93dcbb0de73 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] 10.222.0.66 "GET /compute/v2.1/servers/9c94175f-2d56-454e-a834-4f54bf9df739" status: 200 len: 1264 microversion: 2.1 time: 0.213990 Aug 04 03:49:29.295288 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 505/1008] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:49:29 2022] GET /compute/v2.1/servers/9c94175f-2d56-454e-a834-4f54bf9df739 => generated 1264 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:49:29.741220 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-a4f59536-202c-469c-ad81-9d73cb5c10f5 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:49:29.741867 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-a4f59536-202c-469c-ad81-9d73cb5c10f5 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] [instance: 62affd75-bad1-417a-aac7-3495d56d9f19] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:49:29.748679 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-a4f59536-202c-469c-ad81-9d73cb5c10f5 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:49:29.752110 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-a4f59536-202c-469c-ad81-9d73cb5c10f5 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:49:29.752110 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-a4f59536-202c-469c-ad81-9d73cb5c10f5 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:49:29.752110 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-a4f59536-202c-469c-ad81-9d73cb5c10f5 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:49:29.925710 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-a4f59536-202c-469c-ad81-9d73cb5c10f5 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:49:29.934092 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-a4f59536-202c-469c-ad81-9d73cb5c10f5 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:49:29.935578 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-a4f59536-202c-469c-ad81-9d73cb5c10f5 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:49:29.946596 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-a4f59536-202c-469c-ad81-9d73cb5c10f5 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] 10.222.0.66 "GET /compute/v2.1/servers/62affd75-bad1-417a-aac7-3495d56d9f19" status: 200 len: 1740 microversion: 2.20 time: 0.210506 Aug 04 03:49:29.947184 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 504/1009] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 03:49:29 2022] GET /compute/v2.1/servers/62affd75-bad1-417a-aac7-3495d56d9f19 => generated 1740 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 03:49:30.321111 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-34afdce8-753a-4556-a662-1c16e7078a90 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:49:30.321758 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-34afdce8-753a-4556-a662-1c16e7078a90 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] [instance: 9c94175f-2d56-454e-a834-4f54bf9df739] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:49:30.330017 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-34afdce8-753a-4556-a662-1c16e7078a90 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:49:30.330613 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-34afdce8-753a-4556-a662-1c16e7078a90 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:49:30.331540 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-34afdce8-753a-4556-a662-1c16e7078a90 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:49:30.332044 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-34afdce8-753a-4556-a662-1c16e7078a90 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:49:30.597650 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-34afdce8-753a-4556-a662-1c16e7078a90 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac48e585c133487dadbe0a1e095bfde0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32813adc26c64016b99c9c5fd838d391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:49:30.597650 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-34afdce8-753a-4556-a662-1c16e7078a90 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] 10.222.0.66 "GET /compute/v2.1/servers/9c94175f-2d56-454e-a834-4f54bf9df739" status: 200 len: 1264 microversion: 2.1 time: 0.178750 Aug 04 03:49:30.597650 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 506/1010] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:49:30 2022] GET /compute/v2.1/servers/9c94175f-2d56-454e-a834-4f54bf9df739 => generated 1264 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:49:30.971650 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-a99f38bc-2368-457e-b522-a4b1274ec6a7 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:49:30.973969 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-a99f38bc-2368-457e-b522-a4b1274ec6a7 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] [instance: 62affd75-bad1-417a-aac7-3495d56d9f19] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:49:30.985094 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-a99f38bc-2368-457e-b522-a4b1274ec6a7 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:49:30.988675 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-a99f38bc-2368-457e-b522-a4b1274ec6a7 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:49:30.990550 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-a99f38bc-2368-457e-b522-a4b1274ec6a7 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:49:30.994114 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-a99f38bc-2368-457e-b522-a4b1274ec6a7 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:49:31.230998 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-a99f38bc-2368-457e-b522-a4b1274ec6a7 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:49:31.241017 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-a99f38bc-2368-457e-b522-a4b1274ec6a7 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:49:31.242704 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-a99f38bc-2368-457e-b522-a4b1274ec6a7 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:49:31.244154 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-a99f38bc-2368-457e-b522-a4b1274ec6a7 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] 10.222.0.66 "GET /compute/v2.1/servers/62affd75-bad1-417a-aac7-3495d56d9f19" status: 200 len: 1740 microversion: 2.20 time: 0.276481 Aug 04 03:49:31.247086 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 505/1011] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 03:49:30 2022] GET /compute/v2.1/servers/62affd75-bad1-417a-aac7-3495d56d9f19 => generated 1740 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 03:49:31.614934 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-3d1e0189-1484-477d-a750-e1b36946e713 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:49:31.615669 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-3d1e0189-1484-477d-a750-e1b36946e713 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] [instance: 9c94175f-2d56-454e-a834-4f54bf9df739] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:49:31.622424 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-3d1e0189-1484-477d-a750-e1b36946e713 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:49:31.622884 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-3d1e0189-1484-477d-a750-e1b36946e713 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:49:31.623773 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-3d1e0189-1484-477d-a750-e1b36946e713 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:49:31.624272 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-3d1e0189-1484-477d-a750-e1b36946e713 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:49:31.780771 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-3d1e0189-1484-477d-a750-e1b36946e713 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac48e585c133487dadbe0a1e095bfde0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32813adc26c64016b99c9c5fd838d391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:49:31.788765 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-3d1e0189-1484-477d-a750-e1b36946e713 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] 10.222.0.66 "GET /compute/v2.1/servers/9c94175f-2d56-454e-a834-4f54bf9df739" status: 200 len: 1264 microversion: 2.1 time: 0.178281 Aug 04 03:49:31.789365 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 507/1012] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:49:31 2022] GET /compute/v2.1/servers/9c94175f-2d56-454e-a834-4f54bf9df739 => generated 1264 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:49:32.267194 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-386c139f-da47-44cd-921c-ab6883abcc4e tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:49:32.267855 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-386c139f-da47-44cd-921c-ab6883abcc4e tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] [instance: 62affd75-bad1-417a-aac7-3495d56d9f19] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:49:32.275072 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-386c139f-da47-44cd-921c-ab6883abcc4e tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:49:32.275516 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-386c139f-da47-44cd-921c-ab6883abcc4e tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:49:32.276265 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-386c139f-da47-44cd-921c-ab6883abcc4e tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:49:32.276696 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-386c139f-da47-44cd-921c-ab6883abcc4e tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:49:32.405408 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-386c139f-da47-44cd-921c-ab6883abcc4e tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:49:32.413529 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-386c139f-da47-44cd-921c-ab6883abcc4e tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:49:32.415051 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-386c139f-da47-44cd-921c-ab6883abcc4e tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:49:32.416211 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-386c139f-da47-44cd-921c-ab6883abcc4e tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] 10.222.0.66 "GET /compute/v2.1/servers/62affd75-bad1-417a-aac7-3495d56d9f19" status: 200 len: 1740 microversion: 2.20 time: 0.152997 Aug 04 03:49:32.416773 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 506/1013] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 03:49:32 2022] GET /compute/v2.1/servers/62affd75-bad1-417a-aac7-3495d56d9f19 => generated 1740 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 03:49:32.810193 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-9838caf2-a760-4ead-801c-b5ca0e42e4d0 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:49:32.810715 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-9838caf2-a760-4ead-801c-b5ca0e42e4d0 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] [instance: 9c94175f-2d56-454e-a834-4f54bf9df739] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:49:32.812625 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG dbcounter [-] [130262] Writing DB stats nova_cell0:SELECT=2 {{(pid=130262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:49:32.813327 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG dbcounter [-] [130262] Writing DB stats nova_cell0:SELECT=6 {{(pid=130262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:49:32.819401 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-9838caf2-a760-4ead-801c-b5ca0e42e4d0 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:49:32.819856 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-9838caf2-a760-4ead-801c-b5ca0e42e4d0 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:49:32.820748 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-9838caf2-a760-4ead-801c-b5ca0e42e4d0 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:49:32.821193 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-9838caf2-a760-4ead-801c-b5ca0e42e4d0 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:49:32.958801 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-9838caf2-a760-4ead-801c-b5ca0e42e4d0 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac48e585c133487dadbe0a1e095bfde0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32813adc26c64016b99c9c5fd838d391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:49:32.966227 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-9838caf2-a760-4ead-801c-b5ca0e42e4d0 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] 10.222.0.66 "GET /compute/v2.1/servers/9c94175f-2d56-454e-a834-4f54bf9df739" status: 200 len: 1264 microversion: 2.1 time: 0.160151 Aug 04 03:49:32.966777 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 508/1014] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:49:32 2022] GET /compute/v2.1/servers/9c94175f-2d56-454e-a834-4f54bf9df739 => generated 1264 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:49:33.438944 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-e72c18cb-5791-417e-99fe-6157dd074a1e tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:49:33.439511 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-e72c18cb-5791-417e-99fe-6157dd074a1e tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] [instance: 62affd75-bad1-417a-aac7-3495d56d9f19] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:49:33.441476 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG dbcounter [-] [130263] Writing DB stats nova_cell0:SELECT=2 {{(pid=130263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:49:33.460617 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-e72c18cb-5791-417e-99fe-6157dd074a1e tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:49:33.461070 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-e72c18cb-5791-417e-99fe-6157dd074a1e tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:49:33.461887 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-e72c18cb-5791-417e-99fe-6157dd074a1e tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:49:33.467493 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-e72c18cb-5791-417e-99fe-6157dd074a1e tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:49:33.595783 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-e72c18cb-5791-417e-99fe-6157dd074a1e tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:49:33.604494 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-e72c18cb-5791-417e-99fe-6157dd074a1e tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:49:33.606273 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-e72c18cb-5791-417e-99fe-6157dd074a1e tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:49:33.607427 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-e72c18cb-5791-417e-99fe-6157dd074a1e tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] 10.222.0.66 "GET /compute/v2.1/servers/62affd75-bad1-417a-aac7-3495d56d9f19" status: 200 len: 1722 microversion: 2.20 time: 0.172483 Aug 04 03:49:33.607973 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 507/1015] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 03:49:33 2022] GET /compute/v2.1/servers/62affd75-bad1-417a-aac7-3495d56d9f19 => generated 1722 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 03:49:33.988579 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-314d0d93-2cf1-452c-98ba-f0035d78b643 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:49:33.989186 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-314d0d93-2cf1-452c-98ba-f0035d78b643 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] [instance: 9c94175f-2d56-454e-a834-4f54bf9df739] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:49:33.996235 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-314d0d93-2cf1-452c-98ba-f0035d78b643 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:49:33.996682 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-314d0d93-2cf1-452c-98ba-f0035d78b643 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:49:33.997473 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-314d0d93-2cf1-452c-98ba-f0035d78b643 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:49:33.997910 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-314d0d93-2cf1-452c-98ba-f0035d78b643 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:49:34.127504 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-314d0d93-2cf1-452c-98ba-f0035d78b643 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac48e585c133487dadbe0a1e095bfde0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32813adc26c64016b99c9c5fd838d391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:49:34.135780 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-314d0d93-2cf1-452c-98ba-f0035d78b643 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] 10.222.0.66 "GET /compute/v2.1/servers/9c94175f-2d56-454e-a834-4f54bf9df739" status: 200 len: 1264 microversion: 2.1 time: 0.151639 Aug 04 03:49:34.136337 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 509/1016] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:49:33 2022] GET /compute/v2.1/servers/9c94175f-2d56-454e-a834-4f54bf9df739 => generated 1264 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:49:34.631400 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-69ebf520-426f-438f-b05e-85efdf16168a tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:49:34.632069 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-69ebf520-426f-438f-b05e-85efdf16168a tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] [instance: 62affd75-bad1-417a-aac7-3495d56d9f19] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:49:34.634434 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG dbcounter [-] [130263] Writing DB stats nova_api:SELECT=61,nova_api:DELETE=1 {{(pid=130263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:49:34.639142 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-69ebf520-426f-438f-b05e-85efdf16168a tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:49:34.639589 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-69ebf520-426f-438f-b05e-85efdf16168a tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:49:34.640345 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-69ebf520-426f-438f-b05e-85efdf16168a tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:49:34.640779 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-69ebf520-426f-438f-b05e-85efdf16168a tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:49:34.774678 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-69ebf520-426f-438f-b05e-85efdf16168a tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:49:34.783233 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-69ebf520-426f-438f-b05e-85efdf16168a tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:49:34.785454 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-69ebf520-426f-438f-b05e-85efdf16168a tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:49:34.786599 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-69ebf520-426f-438f-b05e-85efdf16168a tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] 10.222.0.66 "GET /compute/v2.1/servers/62affd75-bad1-417a-aac7-3495d56d9f19" status: 200 len: 1722 microversion: 2.20 time: 0.159489 Aug 04 03:49:34.787160 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 508/1017] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 03:49:34 2022] GET /compute/v2.1/servers/62affd75-bad1-417a-aac7-3495d56d9f19 => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 03:49:35.156261 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-fecfd030-0867-4998-857f-862228df48ba tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:49:35.156906 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-fecfd030-0867-4998-857f-862228df48ba tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] [instance: 9c94175f-2d56-454e-a834-4f54bf9df739] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:49:35.163354 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-fecfd030-0867-4998-857f-862228df48ba tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:49:35.163805 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-fecfd030-0867-4998-857f-862228df48ba tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:49:35.164575 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-fecfd030-0867-4998-857f-862228df48ba tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:49:35.165011 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-fecfd030-0867-4998-857f-862228df48ba tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:49:35.297973 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-fecfd030-0867-4998-857f-862228df48ba tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac48e585c133487dadbe0a1e095bfde0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32813adc26c64016b99c9c5fd838d391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:49:35.305393 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-fecfd030-0867-4998-857f-862228df48ba tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] 10.222.0.66 "GET /compute/v2.1/servers/9c94175f-2d56-454e-a834-4f54bf9df739" status: 200 len: 1264 microversion: 2.1 time: 0.152973 Aug 04 03:49:35.305944 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 510/1018] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:49:35 2022] GET /compute/v2.1/servers/9c94175f-2d56-454e-a834-4f54bf9df739 => generated 1264 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:49:35.809973 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-5dc1f002-5060-4bc9-bb25-a5c2aaa7bdd3 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:49:35.810591 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-5dc1f002-5060-4bc9-bb25-a5c2aaa7bdd3 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] [instance: 62affd75-bad1-417a-aac7-3495d56d9f19] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:49:35.817875 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-5dc1f002-5060-4bc9-bb25-a5c2aaa7bdd3 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:49:35.818309 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-5dc1f002-5060-4bc9-bb25-a5c2aaa7bdd3 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:49:35.819075 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-5dc1f002-5060-4bc9-bb25-a5c2aaa7bdd3 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:49:35.819519 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-5dc1f002-5060-4bc9-bb25-a5c2aaa7bdd3 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:49:35.951318 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-5dc1f002-5060-4bc9-bb25-a5c2aaa7bdd3 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:49:35.959580 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-5dc1f002-5060-4bc9-bb25-a5c2aaa7bdd3 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:49:35.961172 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-5dc1f002-5060-4bc9-bb25-a5c2aaa7bdd3 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:49:35.962364 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-5dc1f002-5060-4bc9-bb25-a5c2aaa7bdd3 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] 10.222.0.66 "GET /compute/v2.1/servers/62affd75-bad1-417a-aac7-3495d56d9f19" status: 200 len: 1725 microversion: 2.20 time: 0.156821 Aug 04 03:49:35.962930 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 509/1019] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 03:49:35 2022] GET /compute/v2.1/servers/62affd75-bad1-417a-aac7-3495d56d9f19 => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 03:49:35.989841 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-ed0446fd-3c0f-4460-8811-df198f131f31 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6a4f3611-d667-4810-8f68-6d2a3db55b28"}} {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 03:49:35.992304 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-ed0446fd-3c0f-4460-8811-df198f131f31 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] [instance: 62affd75-bad1-417a-aac7-3495d56d9f19] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:49:35.998370 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-ed0446fd-3c0f-4460-8811-df198f131f31 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:49:35.998818 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-ed0446fd-3c0f-4460-8811-df198f131f31 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:49:35.999581 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-ed0446fd-3c0f-4460-8811-df198f131f31 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:49:36.000022 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-ed0446fd-3c0f-4460-8811-df198f131f31 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:49:36.326658 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-c19e0b28-0b9d-4615-9f58-d1d193d4dbcc tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:49:36.327192 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-c19e0b28-0b9d-4615-9f58-d1d193d4dbcc tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] [instance: 9c94175f-2d56-454e-a834-4f54bf9df739] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:49:36.333844 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-c19e0b28-0b9d-4615-9f58-d1d193d4dbcc tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:49:36.334295 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-c19e0b28-0b9d-4615-9f58-d1d193d4dbcc tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:49:36.335055 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-c19e0b28-0b9d-4615-9f58-d1d193d4dbcc tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:49:36.335493 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-c19e0b28-0b9d-4615-9f58-d1d193d4dbcc tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:49:36.468091 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-c19e0b28-0b9d-4615-9f58-d1d193d4dbcc tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac48e585c133487dadbe0a1e095bfde0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32813adc26c64016b99c9c5fd838d391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:49:36.476475 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-c19e0b28-0b9d-4615-9f58-d1d193d4dbcc tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] 10.222.0.66 "GET /compute/v2.1/servers/9c94175f-2d56-454e-a834-4f54bf9df739" status: 200 len: 1264 microversion: 2.1 time: 0.153719 Aug 04 03:49:36.477042 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 510/1020] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:49:36 2022] GET /compute/v2.1/servers/9c94175f-2d56-454e-a834-4f54bf9df739 => generated 1264 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 03:49:36.957765 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-ed0446fd-3c0f-4460-8811-df198f131f31 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] 10.222.0.66 "POST /compute/v2.1/servers/62affd75-bad1-417a-aac7-3495d56d9f19/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.976056 Aug 04 03:49:36.958427 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 511/1021] 10.222.0.66 () {62 vars in 1364 bytes} [Thu Aug 4 03:49:35 2022] POST /compute/v2.1/servers/62affd75-bad1-417a-aac7-3495d56d9f19/os-volume_attachments => generated 188 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 04 03:49:37.083750 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-2c78ebcb-6117-4182-a542-41b3bb821abd tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:49:37.084234 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-2c78ebcb-6117-4182-a542-41b3bb821abd tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] [instance: 62affd75-bad1-417a-aac7-3495d56d9f19] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:49:37.090602 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-2c78ebcb-6117-4182-a542-41b3bb821abd tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:49:37.091044 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-2c78ebcb-6117-4182-a542-41b3bb821abd tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:49:37.091793 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-2c78ebcb-6117-4182-a542-41b3bb821abd tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:49:37.092224 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-2c78ebcb-6117-4182-a542-41b3bb821abd tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:49:37.497324 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-138064e2-2679-4601-8b56-040ec1cf5ad9 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:49:37.497939 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-138064e2-2679-4601-8b56-040ec1cf5ad9 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] [instance: 9c94175f-2d56-454e-a834-4f54bf9df739] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:49:37.504500 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-138064e2-2679-4601-8b56-040ec1cf5ad9 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:49:37.504954 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-138064e2-2679-4601-8b56-040ec1cf5ad9 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:49:37.505758 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-138064e2-2679-4601-8b56-040ec1cf5ad9 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:49:37.506195 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-138064e2-2679-4601-8b56-040ec1cf5ad9 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:49:37.510097 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG dbcounter [-] [130262] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=130262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:49:37.642307 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-138064e2-2679-4601-8b56-040ec1cf5ad9 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac48e585c133487dadbe0a1e095bfde0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32813adc26c64016b99c9c5fd838d391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:49:37.650569 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-138064e2-2679-4601-8b56-040ec1cf5ad9 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] 10.222.0.66 "GET /compute/v2.1/servers/9c94175f-2d56-454e-a834-4f54bf9df739" status: 200 len: 1264 microversion: 2.1 time: 0.157150 Aug 04 03:49:37.651113 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 512/1022] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:49:37 2022] GET /compute/v2.1/servers/9c94175f-2d56-454e-a834-4f54bf9df739 => generated 1264 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 03:49:38.132761 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [req-2027c1e1-96ab-416a-917d-097630c267bb req-4de6e08a-eab6-496f-a3dd-f204149b7b0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62affd75-bad1-417a-aac7-3495d56d9f19", "name": "network-vif-unplugged", "status": "completed", "tag": "de2fd866-0219-43e7-a73a-fd446fc3c7ba"}]} {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 03:49:38.143313 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [req-2027c1e1-96ab-416a-917d-097630c267bb req-4de6e08a-eab6-496f-a3dd-f204149b7b0f service nova] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:49:38.143752 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [req-2027c1e1-96ab-416a-917d-097630c267bb req-4de6e08a-eab6-496f-a3dd-f204149b7b0f service nova] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:49:38.155486 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.compute.server_external_events [req-2027c1e1-96ab-416a-917d-097630c267bb req-4de6e08a-eab6-496f-a3dd-f204149b7b0f service nova] Creating event network-vif-unplugged:de2fd866-0219-43e7-a73a-fd446fc3c7ba for instance 62affd75-bad1-417a-aac7-3495d56d9f19 on hv-cinder-73306 Aug 04 03:49:38.161157 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [req-2027c1e1-96ab-416a-917d-097630c267bb req-4de6e08a-eab6-496f-a3dd-f204149b7b0f service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032335 Aug 04 03:49:38.165075 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 513/1023] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 03:49:38 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 03:49:38.305127 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-2c78ebcb-6117-4182-a542-41b3bb821abd tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] 10.222.0.66 "DELETE /compute/v2.1/servers/62affd75-bad1-417a-aac7-3495d56d9f19/os-volume_attachments/6a4f3611-d667-4810-8f68-6d2a3db55b28" status: 202 len: 0 microversion: 2.20 time: 1.225205 Aug 04 03:49:38.305795 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 511/1024] 10.222.0.66 () {60 vars in 1457 bytes} [Thu Aug 4 03:49:37 2022] DELETE /compute/v2.1/servers/62affd75-bad1-417a-aac7-3495d56d9f19/os-volume_attachments/6a4f3611-d667-4810-8f68-6d2a3db55b28 => generated 0 bytes in 1227 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 04 03:49:38.365830 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-1d4d716f-7d24-4a1f-8272-e253a679ec4b tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 03:49:38.366504 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-1d4d716f-7d24-4a1f-8272-e253a679ec4b tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] [instance: 62affd75-bad1-417a-aac7-3495d56d9f19] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:49:38.372677 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-1d4d716f-7d24-4a1f-8272-e253a679ec4b tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:49:38.373122 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-1d4d716f-7d24-4a1f-8272-e253a679ec4b tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:49:38.373908 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-1d4d716f-7d24-4a1f-8272-e253a679ec4b tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:49:38.374342 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-1d4d716f-7d24-4a1f-8272-e253a679ec4b tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:49:38.403414 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-1d4d716f-7d24-4a1f-8272-e253a679ec4b tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] [instance: 62affd75-bad1-417a-aac7-3495d56d9f19] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=130262) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 04 03:49:38.671522 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-62c3c48f-b51b-4788-8a2a-0cd664c90e61 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:49:38.672132 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-62c3c48f-b51b-4788-8a2a-0cd664c90e61 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] [instance: 9c94175f-2d56-454e-a834-4f54bf9df739] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:49:38.679017 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-62c3c48f-b51b-4788-8a2a-0cd664c90e61 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:49:38.679463 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-62c3c48f-b51b-4788-8a2a-0cd664c90e61 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:49:38.680318 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-62c3c48f-b51b-4788-8a2a-0cd664c90e61 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:49:38.680758 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-62c3c48f-b51b-4788-8a2a-0cd664c90e61 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:49:38.691498 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-1d4d716f-7d24-4a1f-8272-e253a679ec4b tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] 10.222.0.66 "POST /compute/v2.1/servers/62affd75-bad1-417a-aac7-3495d56d9f19/action" status: 202 len: 0 microversion: 2.20 time: 0.329645 Aug 04 03:49:38.692190 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 514/1025] 10.222.0.66 () {62 vars in 1319 bytes} [Thu Aug 4 03:49:38 2022] POST /compute/v2.1/servers/62affd75-bad1-417a-aac7-3495d56d9f19/action => generated 0 bytes in 332 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 04 03:49:38.700420 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-cb155268-8fab-4fb2-b4e9-2f8c295b8465 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:49:38.701023 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-cb155268-8fab-4fb2-b4e9-2f8c295b8465 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] [instance: 62affd75-bad1-417a-aac7-3495d56d9f19] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:49:38.707284 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-cb155268-8fab-4fb2-b4e9-2f8c295b8465 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:49:38.711006 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-cb155268-8fab-4fb2-b4e9-2f8c295b8465 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:49:38.711006 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-cb155268-8fab-4fb2-b4e9-2f8c295b8465 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:49:38.711006 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-cb155268-8fab-4fb2-b4e9-2f8c295b8465 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:49:38.883962 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-62c3c48f-b51b-4788-8a2a-0cd664c90e61 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac48e585c133487dadbe0a1e095bfde0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32813adc26c64016b99c9c5fd838d391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:49:38.891303 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-cb155268-8fab-4fb2-b4e9-2f8c295b8465 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:49:38.891549 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-62c3c48f-b51b-4788-8a2a-0cd664c90e61 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] 10.222.0.66 "GET /compute/v2.1/servers/9c94175f-2d56-454e-a834-4f54bf9df739" status: 200 len: 1264 microversion: 2.1 time: 0.223942 Aug 04 03:49:38.892125 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 512/1026] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:49:38 2022] GET /compute/v2.1/servers/9c94175f-2d56-454e-a834-4f54bf9df739 => generated 1264 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 03:49:38.899970 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-cb155268-8fab-4fb2-b4e9-2f8c295b8465 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:49:38.901473 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-cb155268-8fab-4fb2-b4e9-2f8c295b8465 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:49:38.902791 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-cb155268-8fab-4fb2-b4e9-2f8c295b8465 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] 10.222.0.66 "GET /compute/v2.1/servers/62affd75-bad1-417a-aac7-3495d56d9f19" status: 200 len: 1733 microversion: 2.20 time: 0.206458 Aug 04 03:49:38.903165 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 515/1027] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 03:49:38 2022] GET /compute/v2.1/servers/62affd75-bad1-417a-aac7-3495d56d9f19 => generated 1733 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 03:49:39.913531 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-4fcca92c-19db-4b7d-8886-8f3973112a74 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:49:39.914150 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-4fcca92c-19db-4b7d-8886-8f3973112a74 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] [instance: 9c94175f-2d56-454e-a834-4f54bf9df739] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:49:39.920309 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-4fcca92c-19db-4b7d-8886-8f3973112a74 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:49:39.920749 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-4fcca92c-19db-4b7d-8886-8f3973112a74 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:49:39.921540 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-4fcca92c-19db-4b7d-8886-8f3973112a74 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:49:39.921984 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-4fcca92c-19db-4b7d-8886-8f3973112a74 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:49:39.926082 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-d8b20a6e-44a7-40a0-a876-74f9d88dc290 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:49:39.926689 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-d8b20a6e-44a7-40a0-a876-74f9d88dc290 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] [instance: 62affd75-bad1-417a-aac7-3495d56d9f19] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:49:39.933051 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-d8b20a6e-44a7-40a0-a876-74f9d88dc290 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:49:39.933547 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-d8b20a6e-44a7-40a0-a876-74f9d88dc290 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:49:39.934287 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-d8b20a6e-44a7-40a0-a876-74f9d88dc290 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:49:39.934718 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-d8b20a6e-44a7-40a0-a876-74f9d88dc290 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:49:40.128823 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-4fcca92c-19db-4b7d-8886-8f3973112a74 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac48e585c133487dadbe0a1e095bfde0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32813adc26c64016b99c9c5fd838d391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:49:40.132087 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-d8b20a6e-44a7-40a0-a876-74f9d88dc290 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:49:40.136623 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-4fcca92c-19db-4b7d-8886-8f3973112a74 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] 10.222.0.66 "GET /compute/v2.1/servers/9c94175f-2d56-454e-a834-4f54bf9df739" status: 200 len: 1264 microversion: 2.1 time: 0.227188 Aug 04 03:49:40.137192 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 513/1028] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:49:39 2022] GET /compute/v2.1/servers/9c94175f-2d56-454e-a834-4f54bf9df739 => generated 1264 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:49:40.140158 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-d8b20a6e-44a7-40a0-a876-74f9d88dc290 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:49:40.141785 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-d8b20a6e-44a7-40a0-a876-74f9d88dc290 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:49:40.143021 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-d8b20a6e-44a7-40a0-a876-74f9d88dc290 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] 10.222.0.66 "GET /compute/v2.1/servers/62affd75-bad1-417a-aac7-3495d56d9f19" status: 200 len: 1733 microversion: 2.20 time: 0.220969 Aug 04 03:49:40.143748 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 516/1029] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 03:49:39 2022] GET /compute/v2.1/servers/62affd75-bad1-417a-aac7-3495d56d9f19 => generated 1733 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 03:49:41.156948 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-318768f6-bd83-40b0-8083-0b9aff7f68c9 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:49:41.157622 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-318768f6-bd83-40b0-8083-0b9aff7f68c9 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] [instance: 9c94175f-2d56-454e-a834-4f54bf9df739] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:49:41.164636 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-318768f6-bd83-40b0-8083-0b9aff7f68c9 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:49:41.165091 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-318768f6-bd83-40b0-8083-0b9aff7f68c9 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:49:41.165896 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-318768f6-bd83-40b0-8083-0b9aff7f68c9 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:49:41.166332 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-318768f6-bd83-40b0-8083-0b9aff7f68c9 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:49:41.167557 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-50d19f3c-2f54-4f4d-9bfd-09a3d2b2cff1 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:49:41.168248 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-50d19f3c-2f54-4f4d-9bfd-09a3d2b2cff1 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] [instance: 62affd75-bad1-417a-aac7-3495d56d9f19] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:49:41.175184 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-50d19f3c-2f54-4f4d-9bfd-09a3d2b2cff1 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:49:41.175712 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-50d19f3c-2f54-4f4d-9bfd-09a3d2b2cff1 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:49:41.176961 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-50d19f3c-2f54-4f4d-9bfd-09a3d2b2cff1 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:49:41.177498 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-50d19f3c-2f54-4f4d-9bfd-09a3d2b2cff1 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:49:41.374701 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-318768f6-bd83-40b0-8083-0b9aff7f68c9 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac48e585c133487dadbe0a1e095bfde0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32813adc26c64016b99c9c5fd838d391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:49:41.376915 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG dbcounter [-] [130263] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=130263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:49:41.382903 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-50d19f3c-2f54-4f4d-9bfd-09a3d2b2cff1 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:49:41.383814 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-318768f6-bd83-40b0-8083-0b9aff7f68c9 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] 10.222.0.66 "GET /compute/v2.1/servers/9c94175f-2d56-454e-a834-4f54bf9df739" status: 200 len: 1264 microversion: 2.1 time: 0.230587 Aug 04 03:49:41.384608 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 514/1030] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:49:41 2022] GET /compute/v2.1/servers/9c94175f-2d56-454e-a834-4f54bf9df739 => generated 1264 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:49:41.397103 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-50d19f3c-2f54-4f4d-9bfd-09a3d2b2cff1 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:49:41.399515 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-50d19f3c-2f54-4f4d-9bfd-09a3d2b2cff1 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:49:41.399825 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-50d19f3c-2f54-4f4d-9bfd-09a3d2b2cff1 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] 10.222.0.66 "GET /compute/v2.1/servers/62affd75-bad1-417a-aac7-3495d56d9f19" status: 200 len: 1733 microversion: 2.20 time: 0.237783 Aug 04 03:49:41.400367 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 517/1031] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 03:49:41 2022] GET /compute/v2.1/servers/62affd75-bad1-417a-aac7-3495d56d9f19 => generated 1733 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 03:49:42.405563 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-5dea4671-7ed2-47ca-a10d-e8a303767a03 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:49:42.406179 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-5dea4671-7ed2-47ca-a10d-e8a303767a03 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] [instance: 9c94175f-2d56-454e-a834-4f54bf9df739] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:49:42.414312 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-5dea4671-7ed2-47ca-a10d-e8a303767a03 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:49:42.428094 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-5dea4671-7ed2-47ca-a10d-e8a303767a03 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:49:42.428094 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-5dea4671-7ed2-47ca-a10d-e8a303767a03 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:49:42.428094 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-5dea4671-7ed2-47ca-a10d-e8a303767a03 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:49:42.428445 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-aaff2951-684c-442f-a067-712a88d83e9a tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:49:42.428445 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-aaff2951-684c-442f-a067-712a88d83e9a tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] [instance: 62affd75-bad1-417a-aac7-3495d56d9f19] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:49:42.431180 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-aaff2951-684c-442f-a067-712a88d83e9a tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:49:42.431897 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-aaff2951-684c-442f-a067-712a88d83e9a tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:49:42.432882 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-aaff2951-684c-442f-a067-712a88d83e9a tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:49:42.433386 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-aaff2951-684c-442f-a067-712a88d83e9a tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:49:42.621775 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-5dea4671-7ed2-47ca-a10d-e8a303767a03 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac48e585c133487dadbe0a1e095bfde0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32813adc26c64016b99c9c5fd838d391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:49:42.628138 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-aaff2951-684c-442f-a067-712a88d83e9a tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:49:42.630457 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-5dea4671-7ed2-47ca-a10d-e8a303767a03 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] 10.222.0.66 "GET /compute/v2.1/servers/9c94175f-2d56-454e-a834-4f54bf9df739" status: 200 len: 1264 microversion: 2.1 time: 0.228813 Aug 04 03:49:42.633264 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 515/1032] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:49:42 2022] GET /compute/v2.1/servers/9c94175f-2d56-454e-a834-4f54bf9df739 => generated 1264 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:49:42.638100 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-aaff2951-684c-442f-a067-712a88d83e9a tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:49:42.639883 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-aaff2951-684c-442f-a067-712a88d83e9a tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:49:42.641391 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-aaff2951-684c-442f-a067-712a88d83e9a tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] 10.222.0.66 "GET /compute/v2.1/servers/62affd75-bad1-417a-aac7-3495d56d9f19" status: 200 len: 1731 microversion: 2.20 time: 0.222397 Aug 04 03:49:42.642107 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 518/1033] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 03:49:42 2022] GET /compute/v2.1/servers/62affd75-bad1-417a-aac7-3495d56d9f19 => generated 1731 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 03:49:43.653483 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-e5b38597-8611-44eb-a314-586fd54fac2a tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:49:43.654403 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-e5b38597-8611-44eb-a314-586fd54fac2a tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] [instance: 9c94175f-2d56-454e-a834-4f54bf9df739] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:49:43.668609 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-ad4be61e-795a-4f96-905f-6742de1eeeab tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:49:43.670039 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-ad4be61e-795a-4f96-905f-6742de1eeeab tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] [instance: 62affd75-bad1-417a-aac7-3495d56d9f19] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:49:43.671308 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-e5b38597-8611-44eb-a314-586fd54fac2a tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:49:43.671844 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-e5b38597-8611-44eb-a314-586fd54fac2a tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:49:43.672705 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-e5b38597-8611-44eb-a314-586fd54fac2a tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:49:43.673178 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-e5b38597-8611-44eb-a314-586fd54fac2a tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:49:43.675053 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG dbcounter [-] [130262] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=130262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:49:43.680147 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-ad4be61e-795a-4f96-905f-6742de1eeeab tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:49:43.680741 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-ad4be61e-795a-4f96-905f-6742de1eeeab tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:49:43.681606 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-ad4be61e-795a-4f96-905f-6742de1eeeab tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:49:43.682107 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-ad4be61e-795a-4f96-905f-6742de1eeeab tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:49:43.928859 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-ad4be61e-795a-4f96-905f-6742de1eeeab tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:49:43.942460 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-ad4be61e-795a-4f96-905f-6742de1eeeab tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:49:43.943982 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-ad4be61e-795a-4f96-905f-6742de1eeeab tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:49:43.947422 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-ad4be61e-795a-4f96-905f-6742de1eeeab tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] 10.222.0.66 "GET /compute/v2.1/servers/62affd75-bad1-417a-aac7-3495d56d9f19" status: 200 len: 1731 microversion: 2.20 time: 0.281153 Aug 04 03:49:43.948316 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 519/1034] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 03:49:43 2022] GET /compute/v2.1/servers/62affd75-bad1-417a-aac7-3495d56d9f19 => generated 1731 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 03:49:43.956686 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-e5b38597-8611-44eb-a314-586fd54fac2a tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac48e585c133487dadbe0a1e095bfde0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32813adc26c64016b99c9c5fd838d391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:49:43.966556 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-e5b38597-8611-44eb-a314-586fd54fac2a tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] 10.222.0.66 "GET /compute/v2.1/servers/9c94175f-2d56-454e-a834-4f54bf9df739" status: 200 len: 1264 microversion: 2.1 time: 0.318403 Aug 04 03:49:43.967147 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 516/1035] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:49:43 2022] GET /compute/v2.1/servers/9c94175f-2d56-454e-a834-4f54bf9df739 => generated 1264 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:49:44.971761 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-8a818fee-9c6b-4464-a63f-63285c27fdb7 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:49:44.972340 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-8a818fee-9c6b-4464-a63f-63285c27fdb7 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] [instance: 62affd75-bad1-417a-aac7-3495d56d9f19] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:49:44.979435 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-8a818fee-9c6b-4464-a63f-63285c27fdb7 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:49:44.980132 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-8a818fee-9c6b-4464-a63f-63285c27fdb7 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:49:44.980891 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-8a818fee-9c6b-4464-a63f-63285c27fdb7 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:49:44.981348 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-8a818fee-9c6b-4464-a63f-63285c27fdb7 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:49:44.990504 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-6c5d8c61-56ae-4dcc-8faf-a2ec2621b4a2 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:49:44.991175 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-6c5d8c61-56ae-4dcc-8faf-a2ec2621b4a2 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] [instance: 9c94175f-2d56-454e-a834-4f54bf9df739] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:49:44.997841 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-6c5d8c61-56ae-4dcc-8faf-a2ec2621b4a2 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:49:44.998905 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-6c5d8c61-56ae-4dcc-8faf-a2ec2621b4a2 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:49:44.999714 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-6c5d8c61-56ae-4dcc-8faf-a2ec2621b4a2 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:49:45.000203 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-6c5d8c61-56ae-4dcc-8faf-a2ec2621b4a2 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:49:45.208421 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-8a818fee-9c6b-4464-a63f-63285c27fdb7 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:49:45.216931 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-8a818fee-9c6b-4464-a63f-63285c27fdb7 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:49:45.218171 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-6c5d8c61-56ae-4dcc-8faf-a2ec2621b4a2 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac48e585c133487dadbe0a1e095bfde0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32813adc26c64016b99c9c5fd838d391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:49:45.218467 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-8a818fee-9c6b-4464-a63f-63285c27fdb7 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:49:45.219654 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-8a818fee-9c6b-4464-a63f-63285c27fdb7 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] 10.222.0.66 "GET /compute/v2.1/servers/62affd75-bad1-417a-aac7-3495d56d9f19" status: 200 len: 1731 microversion: 2.20 time: 0.251784 Aug 04 03:49:45.220393 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 520/1036] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 03:49:44 2022] GET /compute/v2.1/servers/62affd75-bad1-417a-aac7-3495d56d9f19 => generated 1731 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 03:49:45.227402 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-6c5d8c61-56ae-4dcc-8faf-a2ec2621b4a2 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] 10.222.0.66 "GET /compute/v2.1/servers/9c94175f-2d56-454e-a834-4f54bf9df739" status: 200 len: 1264 microversion: 2.1 time: 0.242867 Aug 04 03:49:45.227973 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 517/1037] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:49:44 2022] GET /compute/v2.1/servers/9c94175f-2d56-454e-a834-4f54bf9df739 => generated 1264 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 03:49:45.649177 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [req-f1944923-c667-44af-95b6-69d9edb9d8ec req-ea770878-140d-420c-bc9c-887bde5a19df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c94175f-2d56-454e-a834-4f54bf9df739", "name": "network-vif-plugged", "status": "completed", "tag": "f138a127-97be-4818-9ebe-61a13e12b1e2"}]} {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 03:49:45.662426 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [req-f1944923-c667-44af-95b6-69d9edb9d8ec req-ea770878-140d-420c-bc9c-887bde5a19df service nova] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:49:45.663116 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [req-f1944923-c667-44af-95b6-69d9edb9d8ec req-ea770878-140d-420c-bc9c-887bde5a19df service nova] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:49:45.675928 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.compute.server_external_events [req-f1944923-c667-44af-95b6-69d9edb9d8ec req-ea770878-140d-420c-bc9c-887bde5a19df service nova] Creating event network-vif-plugged:f138a127-97be-4818-9ebe-61a13e12b1e2 for instance 9c94175f-2d56-454e-a834-4f54bf9df739 on hv-cinder-73306 Aug 04 03:49:45.682492 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [req-f1944923-c667-44af-95b6-69d9edb9d8ec req-ea770878-140d-420c-bc9c-887bde5a19df service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038899 Aug 04 03:49:45.683078 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 521/1038] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 03:49:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 03:49:46.246824 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-fd6eb102-ae38-4409-aad8-8dda88dc590e tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:49:46.248615 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-fd6eb102-ae38-4409-aad8-8dda88dc590e tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] [instance: 62affd75-bad1-417a-aac7-3495d56d9f19] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:49:46.250105 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-a785754b-acd2-4745-aaca-f499b5c2decc tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:49:46.251306 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-a785754b-acd2-4745-aaca-f499b5c2decc tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] [instance: 9c94175f-2d56-454e-a834-4f54bf9df739] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:49:46.258010 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-fd6eb102-ae38-4409-aad8-8dda88dc590e tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:49:46.258942 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-fd6eb102-ae38-4409-aad8-8dda88dc590e tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:49:46.259765 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-fd6eb102-ae38-4409-aad8-8dda88dc590e tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:49:46.260270 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-fd6eb102-ae38-4409-aad8-8dda88dc590e tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:49:46.261502 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-a785754b-acd2-4745-aaca-f499b5c2decc tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:49:46.262132 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-a785754b-acd2-4745-aaca-f499b5c2decc tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:49:46.264855 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-a785754b-acd2-4745-aaca-f499b5c2decc tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:49:46.264855 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-a785754b-acd2-4745-aaca-f499b5c2decc tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:49:46.464870 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-fd6eb102-ae38-4409-aad8-8dda88dc590e tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:49:46.474302 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-fd6eb102-ae38-4409-aad8-8dda88dc590e tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:49:46.475837 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-fd6eb102-ae38-4409-aad8-8dda88dc590e tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:49:46.477070 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-fd6eb102-ae38-4409-aad8-8dda88dc590e tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] 10.222.0.66 "GET /compute/v2.1/servers/62affd75-bad1-417a-aac7-3495d56d9f19" status: 200 len: 1731 microversion: 2.20 time: 0.236114 Aug 04 03:49:46.477959 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 518/1039] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 03:49:46 2022] GET /compute/v2.1/servers/62affd75-bad1-417a-aac7-3495d56d9f19 => generated 1731 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 03:49:46.499451 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-a785754b-acd2-4745-aaca-f499b5c2decc tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac48e585c133487dadbe0a1e095bfde0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32813adc26c64016b99c9c5fd838d391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:49:46.508765 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-a785754b-acd2-4745-aaca-f499b5c2decc tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] 10.222.0.66 "GET /compute/v2.1/servers/9c94175f-2d56-454e-a834-4f54bf9df739" status: 200 len: 1264 microversion: 2.1 time: 0.263258 Aug 04 03:49:46.524402 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 522/1040] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:49:46 2022] GET /compute/v2.1/servers/9c94175f-2d56-454e-a834-4f54bf9df739 => generated 1264 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 03:49:47.503553 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-d6e79ad2-ee74-449d-8ec4-e4ddc74376b6 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:49:47.504899 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-d6e79ad2-ee74-449d-8ec4-e4ddc74376b6 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] [instance: 62affd75-bad1-417a-aac7-3495d56d9f19] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:49:47.511825 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-d6e79ad2-ee74-449d-8ec4-e4ddc74376b6 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:49:47.512282 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-d6e79ad2-ee74-449d-8ec4-e4ddc74376b6 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:49:47.513054 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-d6e79ad2-ee74-449d-8ec4-e4ddc74376b6 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:49:47.513520 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-d6e79ad2-ee74-449d-8ec4-e4ddc74376b6 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:49:47.532103 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-db89a332-5770-406e-bb3e-9dc73036ef1c tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:49:47.532758 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-db89a332-5770-406e-bb3e-9dc73036ef1c tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] [instance: 9c94175f-2d56-454e-a834-4f54bf9df739] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:49:47.544942 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-db89a332-5770-406e-bb3e-9dc73036ef1c tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:49:47.545433 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-db89a332-5770-406e-bb3e-9dc73036ef1c tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:49:47.546221 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-db89a332-5770-406e-bb3e-9dc73036ef1c tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:49:47.546663 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-db89a332-5770-406e-bb3e-9dc73036ef1c tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:49:47.758254 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-d6e79ad2-ee74-449d-8ec4-e4ddc74376b6 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:49:47.763203 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-db89a332-5770-406e-bb3e-9dc73036ef1c tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac48e585c133487dadbe0a1e095bfde0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32813adc26c64016b99c9c5fd838d391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:49:47.770113 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-d6e79ad2-ee74-449d-8ec4-e4ddc74376b6 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:49:47.772708 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-db89a332-5770-406e-bb3e-9dc73036ef1c tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] 10.222.0.66 "GET /compute/v2.1/servers/9c94175f-2d56-454e-a834-4f54bf9df739" status: 200 len: 1264 microversion: 2.1 time: 0.243514 Aug 04 03:49:47.773991 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 523/1041] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:49:47 2022] GET /compute/v2.1/servers/9c94175f-2d56-454e-a834-4f54bf9df739 => generated 1264 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:49:47.774234 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-d6e79ad2-ee74-449d-8ec4-e4ddc74376b6 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:49:47.775692 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-d6e79ad2-ee74-449d-8ec4-e4ddc74376b6 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] 10.222.0.66 "GET /compute/v2.1/servers/62affd75-bad1-417a-aac7-3495d56d9f19" status: 200 len: 1731 microversion: 2.20 time: 0.276390 Aug 04 03:49:47.776250 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 519/1042] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 03:49:47 2022] GET /compute/v2.1/servers/62affd75-bad1-417a-aac7-3495d56d9f19 => generated 1731 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 03:49:48.795639 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-f9588798-f5bd-40db-b6a6-eeb8cb183966 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:49:48.796910 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-f9588798-f5bd-40db-b6a6-eeb8cb183966 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] [instance: 9c94175f-2d56-454e-a834-4f54bf9df739] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:49:48.800399 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-baf6211b-09f7-436f-8bb3-94cde887b11a tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:49:48.801332 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-baf6211b-09f7-436f-8bb3-94cde887b11a tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] [instance: 62affd75-bad1-417a-aac7-3495d56d9f19] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:49:48.805125 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-f9588798-f5bd-40db-b6a6-eeb8cb183966 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:49:48.805887 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-f9588798-f5bd-40db-b6a6-eeb8cb183966 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:49:48.806869 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-f9588798-f5bd-40db-b6a6-eeb8cb183966 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:49:48.807546 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-f9588798-f5bd-40db-b6a6-eeb8cb183966 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:49:48.809597 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-baf6211b-09f7-436f-8bb3-94cde887b11a tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:49:48.810106 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-baf6211b-09f7-436f-8bb3-94cde887b11a tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:49:48.810915 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-baf6211b-09f7-436f-8bb3-94cde887b11a tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:49:48.811522 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-baf6211b-09f7-436f-8bb3-94cde887b11a tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:49:49.073003 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-baf6211b-09f7-436f-8bb3-94cde887b11a tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:49:49.083983 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-baf6211b-09f7-436f-8bb3-94cde887b11a tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:49:49.085536 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-baf6211b-09f7-436f-8bb3-94cde887b11a tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:49:49.085817 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-f9588798-f5bd-40db-b6a6-eeb8cb183966 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac48e585c133487dadbe0a1e095bfde0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32813adc26c64016b99c9c5fd838d391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:49:49.094799 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-baf6211b-09f7-436f-8bb3-94cde887b11a tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] 10.222.0.66 "GET /compute/v2.1/servers/62affd75-bad1-417a-aac7-3495d56d9f19" status: 200 len: 1731 microversion: 2.20 time: 0.294945 Aug 04 03:49:49.094799 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 520/1043] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 03:49:48 2022] GET /compute/v2.1/servers/62affd75-bad1-417a-aac7-3495d56d9f19 => generated 1731 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 03:49:49.095028 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-f9588798-f5bd-40db-b6a6-eeb8cb183966 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] 10.222.0.66 "GET /compute/v2.1/servers/9c94175f-2d56-454e-a834-4f54bf9df739" status: 200 len: 1264 microversion: 2.1 time: 0.304151 Aug 04 03:49:49.108224 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 524/1044] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:49:48 2022] GET /compute/v2.1/servers/9c94175f-2d56-454e-a834-4f54bf9df739 => generated 1264 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:49:50.115760 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-ad95ce3d-2990-4c5a-9eb5-539ec03753d3 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:49:50.116372 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-ad95ce3d-2990-4c5a-9eb5-539ec03753d3 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] [instance: 9c94175f-2d56-454e-a834-4f54bf9df739] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:49:50.118240 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-d57d762b-f457-4ced-9676-da57683764a4 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:49:50.118960 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-d57d762b-f457-4ced-9676-da57683764a4 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] [instance: 62affd75-bad1-417a-aac7-3495d56d9f19] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:49:50.123537 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-ad95ce3d-2990-4c5a-9eb5-539ec03753d3 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:49:50.124055 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-ad95ce3d-2990-4c5a-9eb5-539ec03753d3 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:49:50.125138 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-ad95ce3d-2990-4c5a-9eb5-539ec03753d3 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:49:50.125620 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-ad95ce3d-2990-4c5a-9eb5-539ec03753d3 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:49:50.126281 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-d57d762b-f457-4ced-9676-da57683764a4 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:49:50.126888 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-d57d762b-f457-4ced-9676-da57683764a4 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:49:50.127909 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-d57d762b-f457-4ced-9676-da57683764a4 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:49:50.128626 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-d57d762b-f457-4ced-9676-da57683764a4 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:49:50.343994 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-d57d762b-f457-4ced-9676-da57683764a4 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:49:50.347059 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-ad95ce3d-2990-4c5a-9eb5-539ec03753d3 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac48e585c133487dadbe0a1e095bfde0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32813adc26c64016b99c9c5fd838d391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:49:50.353704 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-d57d762b-f457-4ced-9676-da57683764a4 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:49:50.355759 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-d57d762b-f457-4ced-9676-da57683764a4 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:49:50.358551 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-ad95ce3d-2990-4c5a-9eb5-539ec03753d3 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] 10.222.0.66 "GET /compute/v2.1/servers/9c94175f-2d56-454e-a834-4f54bf9df739" status: 200 len: 1264 microversion: 2.1 time: 0.247193 Aug 04 03:49:50.359718 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 521/1045] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:49:50 2022] GET /compute/v2.1/servers/9c94175f-2d56-454e-a834-4f54bf9df739 => generated 1264 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 03:49:50.378180 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-d57d762b-f457-4ced-9676-da57683764a4 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] 10.222.0.66 "GET /compute/v2.1/servers/62affd75-bad1-417a-aac7-3495d56d9f19" status: 200 len: 1731 microversion: 2.20 time: 0.264166 Aug 04 03:49:50.389328 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 525/1046] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 03:49:50 2022] GET /compute/v2.1/servers/62affd75-bad1-417a-aac7-3495d56d9f19 => generated 1731 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 03:49:51.379802 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-6afbd181-f0b6-4f61-a438-1b317b13c131 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:49:51.381754 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-6afbd181-f0b6-4f61-a438-1b317b13c131 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] [instance: 9c94175f-2d56-454e-a834-4f54bf9df739] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:49:51.389266 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-6afbd181-f0b6-4f61-a438-1b317b13c131 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:49:51.390056 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-6afbd181-f0b6-4f61-a438-1b317b13c131 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:49:51.392579 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-6afbd181-f0b6-4f61-a438-1b317b13c131 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:49:51.392579 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-6afbd181-f0b6-4f61-a438-1b317b13c131 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:49:51.412072 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-042b0965-84b6-4a01-9d6e-f5865038fb21 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:49:51.415647 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-042b0965-84b6-4a01-9d6e-f5865038fb21 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] [instance: 62affd75-bad1-417a-aac7-3495d56d9f19] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:49:51.419144 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-042b0965-84b6-4a01-9d6e-f5865038fb21 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:49:51.420101 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-042b0965-84b6-4a01-9d6e-f5865038fb21 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:49:51.421002 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-042b0965-84b6-4a01-9d6e-f5865038fb21 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:49:51.423980 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-042b0965-84b6-4a01-9d6e-f5865038fb21 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:49:51.645781 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-6afbd181-f0b6-4f61-a438-1b317b13c131 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac48e585c133487dadbe0a1e095bfde0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32813adc26c64016b99c9c5fd838d391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:49:51.649372 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-042b0965-84b6-4a01-9d6e-f5865038fb21 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:49:51.657065 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-6afbd181-f0b6-4f61-a438-1b317b13c131 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] 10.222.0.66 "GET /compute/v2.1/servers/9c94175f-2d56-454e-a834-4f54bf9df739" status: 200 len: 1264 microversion: 2.1 time: 0.281254 Aug 04 03:49:51.658821 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 522/1047] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:49:51 2022] GET /compute/v2.1/servers/9c94175f-2d56-454e-a834-4f54bf9df739 => generated 1264 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 03:49:51.658970 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-042b0965-84b6-4a01-9d6e-f5865038fb21 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:49:51.660614 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-042b0965-84b6-4a01-9d6e-f5865038fb21 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:49:51.661827 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-042b0965-84b6-4a01-9d6e-f5865038fb21 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] 10.222.0.66 "GET /compute/v2.1/servers/62affd75-bad1-417a-aac7-3495d56d9f19" status: 200 len: 1731 microversion: 2.20 time: 0.254508 Aug 04 03:49:51.662365 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 526/1048] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 03:49:51 2022] GET /compute/v2.1/servers/62affd75-bad1-417a-aac7-3495d56d9f19 => generated 1731 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 03:49:52.681874 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-5bbe26cc-7b7a-48b5-8fc2-c7e238aa4df6 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:49:52.683248 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-5bbe26cc-7b7a-48b5-8fc2-c7e238aa4df6 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] [instance: 9c94175f-2d56-454e-a834-4f54bf9df739] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:49:52.686002 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-a74673d8-01da-448d-abb0-727ff150930f tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:49:52.687178 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-a74673d8-01da-448d-abb0-727ff150930f tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] [instance: 62affd75-bad1-417a-aac7-3495d56d9f19] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:49:52.694255 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-a74673d8-01da-448d-abb0-727ff150930f tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:49:52.694708 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-a74673d8-01da-448d-abb0-727ff150930f tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:49:52.695852 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-a74673d8-01da-448d-abb0-727ff150930f tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:49:52.696320 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-a74673d8-01da-448d-abb0-727ff150930f tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:49:52.696727 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-5bbe26cc-7b7a-48b5-8fc2-c7e238aa4df6 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:49:52.697182 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-5bbe26cc-7b7a-48b5-8fc2-c7e238aa4df6 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:49:52.697977 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-5bbe26cc-7b7a-48b5-8fc2-c7e238aa4df6 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:49:52.698417 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-5bbe26cc-7b7a-48b5-8fc2-c7e238aa4df6 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:49:53.164742 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-a74673d8-01da-448d-abb0-727ff150930f tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:49:53.178630 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-5bbe26cc-7b7a-48b5-8fc2-c7e238aa4df6 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac48e585c133487dadbe0a1e095bfde0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32813adc26c64016b99c9c5fd838d391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:49:53.184087 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-a74673d8-01da-448d-abb0-727ff150930f tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:49:53.185674 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-a74673d8-01da-448d-abb0-727ff150930f tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:49:53.186931 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-a74673d8-01da-448d-abb0-727ff150930f tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] 10.222.0.66 "GET /compute/v2.1/servers/62affd75-bad1-417a-aac7-3495d56d9f19" status: 200 len: 1731 microversion: 2.20 time: 0.505119 Aug 04 03:49:53.187682 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 527/1049] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 03:49:52 2022] GET /compute/v2.1/servers/62affd75-bad1-417a-aac7-3495d56d9f19 => generated 1731 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 03:49:53.188749 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-5bbe26cc-7b7a-48b5-8fc2-c7e238aa4df6 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] 10.222.0.66 "GET /compute/v2.1/servers/9c94175f-2d56-454e-a834-4f54bf9df739" status: 200 len: 1264 microversion: 2.1 time: 0.514029 Aug 04 03:49:53.193583 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 523/1050] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:49:52 2022] GET /compute/v2.1/servers/9c94175f-2d56-454e-a834-4f54bf9df739 => generated 1264 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:49:54.211772 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-be618dc9-061f-46ec-bb54-c73d7cfb24cf tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:49:54.212453 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-7058beb2-9e56-4e29-880b-4465eb1981e4 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:49:54.213330 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-7058beb2-9e56-4e29-880b-4465eb1981e4 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] [instance: 9c94175f-2d56-454e-a834-4f54bf9df739] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:49:54.214363 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-be618dc9-061f-46ec-bb54-c73d7cfb24cf tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] [instance: 62affd75-bad1-417a-aac7-3495d56d9f19] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:49:54.225911 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-be618dc9-061f-46ec-bb54-c73d7cfb24cf tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:49:54.226361 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-be618dc9-061f-46ec-bb54-c73d7cfb24cf tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:49:54.228166 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-7058beb2-9e56-4e29-880b-4465eb1981e4 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:49:54.228664 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-7058beb2-9e56-4e29-880b-4465eb1981e4 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:49:54.229942 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-7058beb2-9e56-4e29-880b-4465eb1981e4 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:49:54.230379 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-7058beb2-9e56-4e29-880b-4465eb1981e4 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:49:54.232296 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-be618dc9-061f-46ec-bb54-c73d7cfb24cf tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:49:54.232742 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-be618dc9-061f-46ec-bb54-c73d7cfb24cf tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:49:54.447094 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-be618dc9-061f-46ec-bb54-c73d7cfb24cf tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:49:54.464108 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-7058beb2-9e56-4e29-880b-4465eb1981e4 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac48e585c133487dadbe0a1e095bfde0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32813adc26c64016b99c9c5fd838d391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:49:54.476307 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-be618dc9-061f-46ec-bb54-c73d7cfb24cf tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:49:54.478440 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-7058beb2-9e56-4e29-880b-4465eb1981e4 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] 10.222.0.66 "GET /compute/v2.1/servers/9c94175f-2d56-454e-a834-4f54bf9df739" status: 200 len: 1264 microversion: 2.1 time: 0.268258 Aug 04 03:49:54.480905 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 528/1051] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:49:54 2022] GET /compute/v2.1/servers/9c94175f-2d56-454e-a834-4f54bf9df739 => generated 1264 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:49:54.481612 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-be618dc9-061f-46ec-bb54-c73d7cfb24cf tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:49:54.484001 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-be618dc9-061f-46ec-bb54-c73d7cfb24cf tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] 10.222.0.66 "GET /compute/v2.1/servers/62affd75-bad1-417a-aac7-3495d56d9f19" status: 200 len: 1731 microversion: 2.20 time: 0.276032 Aug 04 03:49:54.495531 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 524/1052] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 03:49:54 2022] GET /compute/v2.1/servers/62affd75-bad1-417a-aac7-3495d56d9f19 => generated 1731 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 03:49:55.499886 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-edad7ee9-0d27-4503-a6fc-c6b560e33eb0 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:49:55.500496 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-edad7ee9-0d27-4503-a6fc-c6b560e33eb0 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] [instance: 9c94175f-2d56-454e-a834-4f54bf9df739] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:49:55.507219 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-edad7ee9-0d27-4503-a6fc-c6b560e33eb0 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:49:55.507676 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-edad7ee9-0d27-4503-a6fc-c6b560e33eb0 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:49:55.507841 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-503635a4-0380-4e59-a179-d9c81ac0d0f4 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:49:55.508452 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-edad7ee9-0d27-4503-a6fc-c6b560e33eb0 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:49:55.508571 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-503635a4-0380-4e59-a179-d9c81ac0d0f4 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] [instance: 62affd75-bad1-417a-aac7-3495d56d9f19] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:49:55.508893 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-edad7ee9-0d27-4503-a6fc-c6b560e33eb0 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:49:55.512998 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG dbcounter [-] [130262] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:49:55.515241 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-503635a4-0380-4e59-a179-d9c81ac0d0f4 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:49:55.515700 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-503635a4-0380-4e59-a179-d9c81ac0d0f4 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:49:55.516498 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-503635a4-0380-4e59-a179-d9c81ac0d0f4 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:49:55.516937 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-503635a4-0380-4e59-a179-d9c81ac0d0f4 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:49:55.714917 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-edad7ee9-0d27-4503-a6fc-c6b560e33eb0 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac48e585c133487dadbe0a1e095bfde0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32813adc26c64016b99c9c5fd838d391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:49:55.718009 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-503635a4-0380-4e59-a179-d9c81ac0d0f4 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:49:55.722345 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-edad7ee9-0d27-4503-a6fc-c6b560e33eb0 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] 10.222.0.66 "GET /compute/v2.1/servers/9c94175f-2d56-454e-a834-4f54bf9df739" status: 200 len: 1264 microversion: 2.1 time: 0.226375 Aug 04 03:49:55.723544 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 529/1053] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:49:55 2022] GET /compute/v2.1/servers/9c94175f-2d56-454e-a834-4f54bf9df739 => generated 1264 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:49:55.726981 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-503635a4-0380-4e59-a179-d9c81ac0d0f4 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:49:55.728646 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-503635a4-0380-4e59-a179-d9c81ac0d0f4 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:49:55.730572 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-503635a4-0380-4e59-a179-d9c81ac0d0f4 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] 10.222.0.66 "GET /compute/v2.1/servers/62affd75-bad1-417a-aac7-3495d56d9f19" status: 200 len: 1731 microversion: 2.20 time: 0.226932 Aug 04 03:49:55.731130 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 525/1054] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 03:49:55 2022] GET /compute/v2.1/servers/62affd75-bad1-417a-aac7-3495d56d9f19 => generated 1731 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 03:49:56.744967 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-9243b664-2022-47dc-8d97-8e978b5db7fb tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:49:56.745530 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-9243b664-2022-47dc-8d97-8e978b5db7fb tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] [instance: 9c94175f-2d56-454e-a834-4f54bf9df739] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:49:56.752344 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-9243b664-2022-47dc-8d97-8e978b5db7fb tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:49:56.752785 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-9243b664-2022-47dc-8d97-8e978b5db7fb tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:49:56.753702 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-487d3bfc-340d-428c-a7d7-814b84e1586d tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:49:56.754807 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-9243b664-2022-47dc-8d97-8e978b5db7fb tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:49:56.754956 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-9243b664-2022-47dc-8d97-8e978b5db7fb tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:49:56.755328 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-487d3bfc-340d-428c-a7d7-814b84e1586d tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] [instance: 62affd75-bad1-417a-aac7-3495d56d9f19] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:49:56.764540 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-487d3bfc-340d-428c-a7d7-814b84e1586d tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:49:56.765411 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-487d3bfc-340d-428c-a7d7-814b84e1586d tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:49:56.766616 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-487d3bfc-340d-428c-a7d7-814b84e1586d tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:49:56.767565 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-487d3bfc-340d-428c-a7d7-814b84e1586d tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:49:56.961074 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-9243b664-2022-47dc-8d97-8e978b5db7fb tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac48e585c133487dadbe0a1e095bfde0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32813adc26c64016b99c9c5fd838d391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:49:56.964413 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-487d3bfc-340d-428c-a7d7-814b84e1586d tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:49:56.968683 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-9243b664-2022-47dc-8d97-8e978b5db7fb tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] 10.222.0.66 "GET /compute/v2.1/servers/9c94175f-2d56-454e-a834-4f54bf9df739" status: 200 len: 1264 microversion: 2.1 time: 0.227879 Aug 04 03:49:56.969345 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 530/1055] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:49:56 2022] GET /compute/v2.1/servers/9c94175f-2d56-454e-a834-4f54bf9df739 => generated 1264 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:49:56.973214 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-487d3bfc-340d-428c-a7d7-814b84e1586d tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:49:56.975409 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-487d3bfc-340d-428c-a7d7-814b84e1586d tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:49:56.976556 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-487d3bfc-340d-428c-a7d7-814b84e1586d tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] 10.222.0.66 "GET /compute/v2.1/servers/62affd75-bad1-417a-aac7-3495d56d9f19" status: 200 len: 1731 microversion: 2.20 time: 0.227446 Aug 04 03:49:56.977092 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 526/1056] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 03:49:56 2022] GET /compute/v2.1/servers/62affd75-bad1-417a-aac7-3495d56d9f19 => generated 1731 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 03:49:57.990807 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-6a0e5a3e-5462-49bf-b8b6-602a3b138d87 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:49:57.991419 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-6a0e5a3e-5462-49bf-b8b6-602a3b138d87 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] [instance: 9c94175f-2d56-454e-a834-4f54bf9df739] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:49:57.997897 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-6a0e5a3e-5462-49bf-b8b6-602a3b138d87 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:49:57.998379 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-6a0e5a3e-5462-49bf-b8b6-602a3b138d87 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:49:57.999171 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-6a0e5a3e-5462-49bf-b8b6-602a3b138d87 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:49:57.999605 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-6a0e5a3e-5462-49bf-b8b6-602a3b138d87 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:49:57.999708 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-dd6fd08a-9fa4-412e-97a9-ea2d5cf15287 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:49:58.000315 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-dd6fd08a-9fa4-412e-97a9-ea2d5cf15287 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] [instance: 62affd75-bad1-417a-aac7-3495d56d9f19] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:49:58.007483 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-dd6fd08a-9fa4-412e-97a9-ea2d5cf15287 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:49:58.007932 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-dd6fd08a-9fa4-412e-97a9-ea2d5cf15287 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:49:58.008700 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-dd6fd08a-9fa4-412e-97a9-ea2d5cf15287 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:49:58.009140 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-dd6fd08a-9fa4-412e-97a9-ea2d5cf15287 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:49:58.197171 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-6a0e5a3e-5462-49bf-b8b6-602a3b138d87 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac48e585c133487dadbe0a1e095bfde0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32813adc26c64016b99c9c5fd838d391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:49:58.204525 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-6a0e5a3e-5462-49bf-b8b6-602a3b138d87 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] 10.222.0.66 "GET /compute/v2.1/servers/9c94175f-2d56-454e-a834-4f54bf9df739" status: 200 len: 1264 microversion: 2.1 time: 0.218137 Aug 04 03:49:58.205078 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 531/1057] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:49:57 2022] GET /compute/v2.1/servers/9c94175f-2d56-454e-a834-4f54bf9df739 => generated 1264 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:49:58.208616 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-dd6fd08a-9fa4-412e-97a9-ea2d5cf15287 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:49:58.216755 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-dd6fd08a-9fa4-412e-97a9-ea2d5cf15287 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:49:58.218353 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-dd6fd08a-9fa4-412e-97a9-ea2d5cf15287 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:49:58.219517 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-dd6fd08a-9fa4-412e-97a9-ea2d5cf15287 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] 10.222.0.66 "GET /compute/v2.1/servers/62affd75-bad1-417a-aac7-3495d56d9f19" status: 200 len: 1731 microversion: 2.20 time: 0.223689 Aug 04 03:49:58.220071 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 527/1058] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 03:49:57 2022] GET /compute/v2.1/servers/62affd75-bad1-417a-aac7-3495d56d9f19 => generated 1731 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 03:49:59.226678 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-b7c43fd7-4061-43a3-a880-0d03461b68c4 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:49:59.227280 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-b7c43fd7-4061-43a3-a880-0d03461b68c4 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] [instance: 9c94175f-2d56-454e-a834-4f54bf9df739] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:49:59.234006 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-b7c43fd7-4061-43a3-a880-0d03461b68c4 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:49:59.234460 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-b7c43fd7-4061-43a3-a880-0d03461b68c4 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:49:59.235215 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-b7c43fd7-4061-43a3-a880-0d03461b68c4 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:49:59.235649 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-b7c43fd7-4061-43a3-a880-0d03461b68c4 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:49:59.243450 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-3fe58291-3b0f-488a-ab42-014af621868b tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:49:59.244063 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-3fe58291-3b0f-488a-ab42-014af621868b tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] [instance: 62affd75-bad1-417a-aac7-3495d56d9f19] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:49:59.250738 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-3fe58291-3b0f-488a-ab42-014af621868b tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:49:59.251193 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-3fe58291-3b0f-488a-ab42-014af621868b tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:49:59.251965 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-3fe58291-3b0f-488a-ab42-014af621868b tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:49:59.252401 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-3fe58291-3b0f-488a-ab42-014af621868b tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:49:59.434844 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-b7c43fd7-4061-43a3-a880-0d03461b68c4 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac48e585c133487dadbe0a1e095bfde0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32813adc26c64016b99c9c5fd838d391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:49:59.438890 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-3fe58291-3b0f-488a-ab42-014af621868b tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:49:59.443146 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-b7c43fd7-4061-43a3-a880-0d03461b68c4 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] 10.222.0.66 "GET /compute/v2.1/servers/9c94175f-2d56-454e-a834-4f54bf9df739" status: 200 len: 1264 microversion: 2.1 time: 0.220760 Aug 04 03:49:59.443801 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 532/1059] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:49:59 2022] GET /compute/v2.1/servers/9c94175f-2d56-454e-a834-4f54bf9df739 => generated 1264 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:49:59.447923 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-3fe58291-3b0f-488a-ab42-014af621868b tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:49:59.449498 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-3fe58291-3b0f-488a-ab42-014af621868b tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:49:59.450685 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-3fe58291-3b0f-488a-ab42-014af621868b tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] 10.222.0.66 "GET /compute/v2.1/servers/62affd75-bad1-417a-aac7-3495d56d9f19" status: 200 len: 1731 microversion: 2.20 time: 0.211161 Aug 04 03:49:59.451221 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 528/1060] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 03:49:59 2022] GET /compute/v2.1/servers/62affd75-bad1-417a-aac7-3495d56d9f19 => generated 1731 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 03:50:00.464734 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-218bfa97-a5f4-440c-8a16-16f28b804d64 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:50:00.465356 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-218bfa97-a5f4-440c-8a16-16f28b804d64 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] [instance: 9c94175f-2d56-454e-a834-4f54bf9df739] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:50:00.474576 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-ed7e1f8c-2b83-4dac-9bf9-63e37b36d1c8 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:50:00.475107 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-218bfa97-a5f4-440c-8a16-16f28b804d64 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:50:00.475205 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-ed7e1f8c-2b83-4dac-9bf9-63e37b36d1c8 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] [instance: 62affd75-bad1-417a-aac7-3495d56d9f19] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:50:00.475301 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-218bfa97-a5f4-440c-8a16-16f28b804d64 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:50:00.476340 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-218bfa97-a5f4-440c-8a16-16f28b804d64 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:50:00.476993 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-218bfa97-a5f4-440c-8a16-16f28b804d64 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:50:00.486344 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-ed7e1f8c-2b83-4dac-9bf9-63e37b36d1c8 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:50:00.487112 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-ed7e1f8c-2b83-4dac-9bf9-63e37b36d1c8 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:50:00.488143 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-ed7e1f8c-2b83-4dac-9bf9-63e37b36d1c8 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:50:00.488733 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-ed7e1f8c-2b83-4dac-9bf9-63e37b36d1c8 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:50:00.671993 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-218bfa97-a5f4-440c-8a16-16f28b804d64 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac48e585c133487dadbe0a1e095bfde0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32813adc26c64016b99c9c5fd838d391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:50:00.679692 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-218bfa97-a5f4-440c-8a16-16f28b804d64 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] 10.222.0.66 "GET /compute/v2.1/servers/9c94175f-2d56-454e-a834-4f54bf9df739" status: 200 len: 1264 microversion: 2.1 time: 0.218884 Aug 04 03:50:00.680262 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 533/1061] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:50:00 2022] GET /compute/v2.1/servers/9c94175f-2d56-454e-a834-4f54bf9df739 => generated 1264 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:50:00.700274 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-ed7e1f8c-2b83-4dac-9bf9-63e37b36d1c8 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:50:00.709220 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-ed7e1f8c-2b83-4dac-9bf9-63e37b36d1c8 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:50:00.710906 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-ed7e1f8c-2b83-4dac-9bf9-63e37b36d1c8 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:50:00.712230 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-ed7e1f8c-2b83-4dac-9bf9-63e37b36d1c8 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] 10.222.0.66 "GET /compute/v2.1/servers/62affd75-bad1-417a-aac7-3495d56d9f19" status: 200 len: 1731 microversion: 2.20 time: 0.242407 Aug 04 03:50:00.712794 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 529/1062] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 03:50:00 2022] GET /compute/v2.1/servers/62affd75-bad1-417a-aac7-3495d56d9f19 => generated 1731 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 03:50:01.701518 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-e180de04-57f0-4b31-8a26-2cd59bdcc213 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:50:01.702128 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-e180de04-57f0-4b31-8a26-2cd59bdcc213 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] [instance: 9c94175f-2d56-454e-a834-4f54bf9df739] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:50:01.708531 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-e180de04-57f0-4b31-8a26-2cd59bdcc213 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:50:01.708979 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-e180de04-57f0-4b31-8a26-2cd59bdcc213 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:50:01.709786 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-e180de04-57f0-4b31-8a26-2cd59bdcc213 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:50:01.710223 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-e180de04-57f0-4b31-8a26-2cd59bdcc213 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:50:01.735641 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-370c0f21-6a0b-4e90-be4b-9e5c15c93c41 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:50:01.736385 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-370c0f21-6a0b-4e90-be4b-9e5c15c93c41 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] [instance: 62affd75-bad1-417a-aac7-3495d56d9f19] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:50:01.743928 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-370c0f21-6a0b-4e90-be4b-9e5c15c93c41 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:50:01.744374 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-370c0f21-6a0b-4e90-be4b-9e5c15c93c41 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:50:01.745132 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-370c0f21-6a0b-4e90-be4b-9e5c15c93c41 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:50:01.745600 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-370c0f21-6a0b-4e90-be4b-9e5c15c93c41 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:50:01.898279 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-e180de04-57f0-4b31-8a26-2cd59bdcc213 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac48e585c133487dadbe0a1e095bfde0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32813adc26c64016b99c9c5fd838d391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:50:01.905776 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-e180de04-57f0-4b31-8a26-2cd59bdcc213 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] 10.222.0.66 "GET /compute/v2.1/servers/9c94175f-2d56-454e-a834-4f54bf9df739" status: 200 len: 1264 microversion: 2.1 time: 0.208101 Aug 04 03:50:01.906349 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 534/1063] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:50:01 2022] GET /compute/v2.1/servers/9c94175f-2d56-454e-a834-4f54bf9df739 => generated 1264 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:50:01.924922 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-370c0f21-6a0b-4e90-be4b-9e5c15c93c41 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:50:01.933833 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-370c0f21-6a0b-4e90-be4b-9e5c15c93c41 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:50:01.935342 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-370c0f21-6a0b-4e90-be4b-9e5c15c93c41 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:50:01.936500 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-370c0f21-6a0b-4e90-be4b-9e5c15c93c41 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] 10.222.0.66 "GET /compute/v2.1/servers/62affd75-bad1-417a-aac7-3495d56d9f19" status: 200 len: 1731 microversion: 2.20 time: 0.204698 Aug 04 03:50:01.937061 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 530/1064] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 03:50:01 2022] GET /compute/v2.1/servers/62affd75-bad1-417a-aac7-3495d56d9f19 => generated 1731 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 03:50:02.926108 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-32197cd8-6682-4ee4-bd3c-907f5e5f86de tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:50:02.926851 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-32197cd8-6682-4ee4-bd3c-907f5e5f86de tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] [instance: 9c94175f-2d56-454e-a834-4f54bf9df739] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:50:02.933460 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-32197cd8-6682-4ee4-bd3c-907f5e5f86de tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:50:02.933917 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-32197cd8-6682-4ee4-bd3c-907f5e5f86de tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:50:02.934684 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-32197cd8-6682-4ee4-bd3c-907f5e5f86de tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:50:02.935127 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-32197cd8-6682-4ee4-bd3c-907f5e5f86de tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:50:02.960554 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-95e99ebb-10fe-4da5-8c9e-33b20ec782cf tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:50:02.961166 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-95e99ebb-10fe-4da5-8c9e-33b20ec782cf tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] [instance: 62affd75-bad1-417a-aac7-3495d56d9f19] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:50:02.967768 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-95e99ebb-10fe-4da5-8c9e-33b20ec782cf tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:50:02.968218 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-95e99ebb-10fe-4da5-8c9e-33b20ec782cf tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:50:02.968991 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-95e99ebb-10fe-4da5-8c9e-33b20ec782cf tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:50:02.969457 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-95e99ebb-10fe-4da5-8c9e-33b20ec782cf tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:50:02.985729 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG dbcounter [-] [130263] Writing DB stats nova_cell1:SELECT=100 {{(pid=130263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:50:03.129039 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-32197cd8-6682-4ee4-bd3c-907f5e5f86de tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac48e585c133487dadbe0a1e095bfde0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32813adc26c64016b99c9c5fd838d391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:50:03.136526 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-32197cd8-6682-4ee4-bd3c-907f5e5f86de tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] 10.222.0.66 "GET /compute/v2.1/servers/9c94175f-2d56-454e-a834-4f54bf9df739" status: 200 len: 1264 microversion: 2.1 time: 0.214193 Aug 04 03:50:03.137095 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 535/1065] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:50:02 2022] GET /compute/v2.1/servers/9c94175f-2d56-454e-a834-4f54bf9df739 => generated 1264 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 03:50:03.155608 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-95e99ebb-10fe-4da5-8c9e-33b20ec782cf tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:50:03.164313 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-95e99ebb-10fe-4da5-8c9e-33b20ec782cf tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:50:03.165858 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-95e99ebb-10fe-4da5-8c9e-33b20ec782cf tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:50:03.167017 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-95e99ebb-10fe-4da5-8c9e-33b20ec782cf tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] 10.222.0.66 "GET /compute/v2.1/servers/62affd75-bad1-417a-aac7-3495d56d9f19" status: 200 len: 1731 microversion: 2.20 time: 0.211174 Aug 04 03:50:03.167763 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 531/1066] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 03:50:02 2022] GET /compute/v2.1/servers/62affd75-bad1-417a-aac7-3495d56d9f19 => generated 1731 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 03:50:04.157151 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-dead6f72-179c-40ea-886f-36a383f025c7 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:50:04.157814 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-dead6f72-179c-40ea-886f-36a383f025c7 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] [instance: 9c94175f-2d56-454e-a834-4f54bf9df739] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:50:04.165241 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-dead6f72-179c-40ea-886f-36a383f025c7 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:50:04.165692 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-dead6f72-179c-40ea-886f-36a383f025c7 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:50:04.166458 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-dead6f72-179c-40ea-886f-36a383f025c7 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:50:04.166888 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-dead6f72-179c-40ea-886f-36a383f025c7 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:50:04.190267 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-3eb3f566-486d-4011-b7ca-945d6da4f8c6 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:50:04.190904 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-3eb3f566-486d-4011-b7ca-945d6da4f8c6 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] [instance: 62affd75-bad1-417a-aac7-3495d56d9f19] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:50:04.197443 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-3eb3f566-486d-4011-b7ca-945d6da4f8c6 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:50:04.197892 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-3eb3f566-486d-4011-b7ca-945d6da4f8c6 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:50:04.198702 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-3eb3f566-486d-4011-b7ca-945d6da4f8c6 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:50:04.199077 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-3eb3f566-486d-4011-b7ca-945d6da4f8c6 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:50:04.353022 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-dead6f72-179c-40ea-886f-36a383f025c7 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac48e585c133487dadbe0a1e095bfde0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32813adc26c64016b99c9c5fd838d391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:50:04.360642 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-dead6f72-179c-40ea-886f-36a383f025c7 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] 10.222.0.66 "GET /compute/v2.1/servers/9c94175f-2d56-454e-a834-4f54bf9df739" status: 200 len: 1264 microversion: 2.1 time: 0.207422 Aug 04 03:50:04.361216 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 536/1067] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:50:04 2022] GET /compute/v2.1/servers/9c94175f-2d56-454e-a834-4f54bf9df739 => generated 1264 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:50:04.379306 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-3eb3f566-486d-4011-b7ca-945d6da4f8c6 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:50:04.387878 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-3eb3f566-486d-4011-b7ca-945d6da4f8c6 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:50:04.394541 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-3eb3f566-486d-4011-b7ca-945d6da4f8c6 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:50:04.394541 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-3eb3f566-486d-4011-b7ca-945d6da4f8c6 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] 10.222.0.66 "GET /compute/v2.1/servers/62affd75-bad1-417a-aac7-3495d56d9f19" status: 200 len: 1731 microversion: 2.20 time: 0.204198 Aug 04 03:50:04.394541 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 532/1068] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 03:50:04 2022] GET /compute/v2.1/servers/62affd75-bad1-417a-aac7-3495d56d9f19 => generated 1731 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 03:50:05.381494 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-ba8ec28f-108c-4d74-9c26-0782f9fd18bd tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:50:05.382099 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-ba8ec28f-108c-4d74-9c26-0782f9fd18bd tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] [instance: 9c94175f-2d56-454e-a834-4f54bf9df739] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:50:05.394054 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-ba8ec28f-108c-4d74-9c26-0782f9fd18bd tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:50:05.394507 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-ba8ec28f-108c-4d74-9c26-0782f9fd18bd tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:50:05.395283 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-ba8ec28f-108c-4d74-9c26-0782f9fd18bd tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:50:05.395836 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-ba8ec28f-108c-4d74-9c26-0782f9fd18bd tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:50:05.416795 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-2c517193-105b-467b-8cee-571edc23b4cd tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:50:05.417448 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-2c517193-105b-467b-8cee-571edc23b4cd tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] [instance: 62affd75-bad1-417a-aac7-3495d56d9f19] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:50:05.423941 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-2c517193-105b-467b-8cee-571edc23b4cd tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:50:05.424442 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-2c517193-105b-467b-8cee-571edc23b4cd tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:50:05.425154 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-2c517193-105b-467b-8cee-571edc23b4cd tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:50:05.425619 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-2c517193-105b-467b-8cee-571edc23b4cd tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:50:05.599431 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-ba8ec28f-108c-4d74-9c26-0782f9fd18bd tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac48e585c133487dadbe0a1e095bfde0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32813adc26c64016b99c9c5fd838d391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:50:05.606508 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-2c517193-105b-467b-8cee-571edc23b4cd tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:50:05.607125 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-ba8ec28f-108c-4d74-9c26-0782f9fd18bd tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] 10.222.0.66 "GET /compute/v2.1/servers/9c94175f-2d56-454e-a834-4f54bf9df739" status: 200 len: 1264 microversion: 2.1 time: 0.230168 Aug 04 03:50:05.607689 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 537/1069] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:50:05 2022] GET /compute/v2.1/servers/9c94175f-2d56-454e-a834-4f54bf9df739 => generated 1264 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:50:05.615306 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-2c517193-105b-467b-8cee-571edc23b4cd tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:50:05.616810 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-2c517193-105b-467b-8cee-571edc23b4cd tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:50:05.617987 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-2c517193-105b-467b-8cee-571edc23b4cd tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] 10.222.0.66 "GET /compute/v2.1/servers/62affd75-bad1-417a-aac7-3495d56d9f19" status: 200 len: 1731 microversion: 2.20 time: 0.205128 Aug 04 03:50:05.618531 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 533/1070] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 03:50:05 2022] GET /compute/v2.1/servers/62affd75-bad1-417a-aac7-3495d56d9f19 => generated 1731 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 03:50:06.628219 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-03239f81-5c11-4f50-ad87-865272ba10a8 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:50:06.628832 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-03239f81-5c11-4f50-ad87-865272ba10a8 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] [instance: 9c94175f-2d56-454e-a834-4f54bf9df739] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:50:06.635305 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-03239f81-5c11-4f50-ad87-865272ba10a8 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:50:06.635750 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-03239f81-5c11-4f50-ad87-865272ba10a8 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:50:06.636521 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-03239f81-5c11-4f50-ad87-865272ba10a8 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:50:06.636952 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-03239f81-5c11-4f50-ad87-865272ba10a8 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:50:06.641239 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-93973516-fb42-42ae-8d67-d5f774176a2c tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:50:06.641913 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-93973516-fb42-42ae-8d67-d5f774176a2c tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] [instance: 62affd75-bad1-417a-aac7-3495d56d9f19] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:50:06.644223 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG dbcounter [-] [130263] Writing DB stats nova_api:SELECT=52 {{(pid=130263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:50:06.649217 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-93973516-fb42-42ae-8d67-d5f774176a2c tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:50:06.651971 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-93973516-fb42-42ae-8d67-d5f774176a2c tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:50:06.651971 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-93973516-fb42-42ae-8d67-d5f774176a2c tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:50:06.651971 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-93973516-fb42-42ae-8d67-d5f774176a2c tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:50:06.834736 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-03239f81-5c11-4f50-ad87-865272ba10a8 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac48e585c133487dadbe0a1e095bfde0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32813adc26c64016b99c9c5fd838d391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:50:06.842186 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-03239f81-5c11-4f50-ad87-865272ba10a8 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] 10.222.0.66 "GET /compute/v2.1/servers/9c94175f-2d56-454e-a834-4f54bf9df739" status: 200 len: 1264 microversion: 2.1 time: 0.217803 Aug 04 03:50:06.845462 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 538/1071] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:50:06 2022] GET /compute/v2.1/servers/9c94175f-2d56-454e-a834-4f54bf9df739 => generated 1264 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:50:06.845697 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-93973516-fb42-42ae-8d67-d5f774176a2c tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:50:06.854677 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-93973516-fb42-42ae-8d67-d5f774176a2c tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:50:06.856202 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-93973516-fb42-42ae-8d67-d5f774176a2c tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:50:06.857384 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-93973516-fb42-42ae-8d67-d5f774176a2c tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] 10.222.0.66 "GET /compute/v2.1/servers/62affd75-bad1-417a-aac7-3495d56d9f19" status: 200 len: 1731 microversion: 2.20 time: 0.219954 Aug 04 03:50:06.857941 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 534/1072] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 03:50:06 2022] GET /compute/v2.1/servers/62affd75-bad1-417a-aac7-3495d56d9f19 => generated 1731 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 03:50:07.864416 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-787d6252-10f8-4f70-be64-448ba314b085 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:50:07.865099 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-787d6252-10f8-4f70-be64-448ba314b085 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] [instance: 9c94175f-2d56-454e-a834-4f54bf9df739] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:50:07.871473 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-787d6252-10f8-4f70-be64-448ba314b085 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:50:07.871916 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-787d6252-10f8-4f70-be64-448ba314b085 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:50:07.872699 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-787d6252-10f8-4f70-be64-448ba314b085 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:50:07.873130 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-787d6252-10f8-4f70-be64-448ba314b085 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:50:07.881215 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-f088f3fb-b0ac-4eef-9ebe-8f64db0168e2 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:50:07.881840 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-f088f3fb-b0ac-4eef-9ebe-8f64db0168e2 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] [instance: 62affd75-bad1-417a-aac7-3495d56d9f19] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:50:07.888419 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-f088f3fb-b0ac-4eef-9ebe-8f64db0168e2 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:50:07.888872 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-f088f3fb-b0ac-4eef-9ebe-8f64db0168e2 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:50:07.889670 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-f088f3fb-b0ac-4eef-9ebe-8f64db0168e2 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:50:07.890109 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-f088f3fb-b0ac-4eef-9ebe-8f64db0168e2 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:50:08.059231 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-787d6252-10f8-4f70-be64-448ba314b085 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac48e585c133487dadbe0a1e095bfde0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32813adc26c64016b99c9c5fd838d391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:50:08.066902 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-787d6252-10f8-4f70-be64-448ba314b085 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] 10.222.0.66 "GET /compute/v2.1/servers/9c94175f-2d56-454e-a834-4f54bf9df739" status: 200 len: 1264 microversion: 2.1 time: 0.206830 Aug 04 03:50:08.069582 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 539/1073] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:50:07 2022] GET /compute/v2.1/servers/9c94175f-2d56-454e-a834-4f54bf9df739 => generated 1264 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:50:08.082345 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-f088f3fb-b0ac-4eef-9ebe-8f64db0168e2 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:50:08.091950 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-f088f3fb-b0ac-4eef-9ebe-8f64db0168e2 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:50:08.093569 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-f088f3fb-b0ac-4eef-9ebe-8f64db0168e2 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:50:08.094752 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-f088f3fb-b0ac-4eef-9ebe-8f64db0168e2 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] 10.222.0.66 "GET /compute/v2.1/servers/62affd75-bad1-417a-aac7-3495d56d9f19" status: 200 len: 1731 microversion: 2.20 time: 0.218268 Aug 04 03:50:08.095313 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 535/1074] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 03:50:07 2022] GET /compute/v2.1/servers/62affd75-bad1-417a-aac7-3495d56d9f19 => generated 1731 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 03:50:09.095763 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-d57f9c0f-cafb-4687-841e-07da51308ce7 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:50:09.096361 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-d57f9c0f-cafb-4687-841e-07da51308ce7 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] [instance: 9c94175f-2d56-454e-a834-4f54bf9df739] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:50:09.102792 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-d57f9c0f-cafb-4687-841e-07da51308ce7 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:50:09.103230 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-d57f9c0f-cafb-4687-841e-07da51308ce7 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:50:09.103976 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-d57f9c0f-cafb-4687-841e-07da51308ce7 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:50:09.104671 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-d57f9c0f-cafb-4687-841e-07da51308ce7 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:50:09.117166 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-a43c51eb-93ba-4f1b-81e6-4db059576d89 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:50:09.117819 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-a43c51eb-93ba-4f1b-81e6-4db059576d89 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] [instance: 62affd75-bad1-417a-aac7-3495d56d9f19] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:50:09.124378 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-a43c51eb-93ba-4f1b-81e6-4db059576d89 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:50:09.124834 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-a43c51eb-93ba-4f1b-81e6-4db059576d89 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:50:09.125629 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-a43c51eb-93ba-4f1b-81e6-4db059576d89 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:50:09.126070 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-a43c51eb-93ba-4f1b-81e6-4db059576d89 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:50:09.293967 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-d57f9c0f-cafb-4687-841e-07da51308ce7 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac48e585c133487dadbe0a1e095bfde0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32813adc26c64016b99c9c5fd838d391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:50:09.302312 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-d57f9c0f-cafb-4687-841e-07da51308ce7 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] 10.222.0.66 "GET /compute/v2.1/servers/9c94175f-2d56-454e-a834-4f54bf9df739" status: 200 len: 1264 microversion: 2.1 time: 0.209760 Aug 04 03:50:09.303086 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 540/1075] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:50:09 2022] GET /compute/v2.1/servers/9c94175f-2d56-454e-a834-4f54bf9df739 => generated 1264 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:50:09.318079 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-a43c51eb-93ba-4f1b-81e6-4db059576d89 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:50:09.326085 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-a43c51eb-93ba-4f1b-81e6-4db059576d89 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:50:09.327577 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-a43c51eb-93ba-4f1b-81e6-4db059576d89 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:50:09.328815 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-a43c51eb-93ba-4f1b-81e6-4db059576d89 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] 10.222.0.66 "GET /compute/v2.1/servers/62affd75-bad1-417a-aac7-3495d56d9f19" status: 200 len: 1731 microversion: 2.20 time: 0.215557 Aug 04 03:50:09.329383 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 536/1076] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 03:50:09 2022] GET /compute/v2.1/servers/62affd75-bad1-417a-aac7-3495d56d9f19 => generated 1731 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 03:50:10.323891 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-b0c2143c-e71e-432a-87b3-130b32e90fc0 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:50:10.324457 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-b0c2143c-e71e-432a-87b3-130b32e90fc0 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] [instance: 9c94175f-2d56-454e-a834-4f54bf9df739] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:50:10.330924 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-b0c2143c-e71e-432a-87b3-130b32e90fc0 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:50:10.331371 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-b0c2143c-e71e-432a-87b3-130b32e90fc0 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:50:10.332132 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-b0c2143c-e71e-432a-87b3-130b32e90fc0 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:50:10.332611 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-b0c2143c-e71e-432a-87b3-130b32e90fc0 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:50:10.352497 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-7776f8aa-7fc9-4a21-9b6c-fb4ecd67b802 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:50:10.353101 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-7776f8aa-7fc9-4a21-9b6c-fb4ecd67b802 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] [instance: 62affd75-bad1-417a-aac7-3495d56d9f19] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:50:10.359737 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-7776f8aa-7fc9-4a21-9b6c-fb4ecd67b802 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:50:10.360193 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-7776f8aa-7fc9-4a21-9b6c-fb4ecd67b802 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:50:10.360965 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-7776f8aa-7fc9-4a21-9b6c-fb4ecd67b802 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:50:10.361449 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-7776f8aa-7fc9-4a21-9b6c-fb4ecd67b802 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:50:10.534952 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-b0c2143c-e71e-432a-87b3-130b32e90fc0 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac48e585c133487dadbe0a1e095bfde0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32813adc26c64016b99c9c5fd838d391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:50:10.539558 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-7776f8aa-7fc9-4a21-9b6c-fb4ecd67b802 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:50:10.543538 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-b0c2143c-e71e-432a-87b3-130b32e90fc0 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] 10.222.0.66 "GET /compute/v2.1/servers/9c94175f-2d56-454e-a834-4f54bf9df739" status: 200 len: 1264 microversion: 2.1 time: 0.223548 Aug 04 03:50:10.544327 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 541/1077] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:50:10 2022] GET /compute/v2.1/servers/9c94175f-2d56-454e-a834-4f54bf9df739 => generated 1264 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:50:10.548304 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-7776f8aa-7fc9-4a21-9b6c-fb4ecd67b802 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:50:10.549867 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-7776f8aa-7fc9-4a21-9b6c-fb4ecd67b802 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:50:10.551040 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-7776f8aa-7fc9-4a21-9b6c-fb4ecd67b802 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] 10.222.0.66 "GET /compute/v2.1/servers/62affd75-bad1-417a-aac7-3495d56d9f19" status: 200 len: 1731 microversion: 2.20 time: 0.203117 Aug 04 03:50:10.552220 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 537/1078] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 03:50:10 2022] GET /compute/v2.1/servers/62affd75-bad1-417a-aac7-3495d56d9f19 => generated 1731 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 03:50:11.564891 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-842b41aa-802c-403f-8fbf-4dd0781b7137 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:50:11.565537 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-842b41aa-802c-403f-8fbf-4dd0781b7137 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] [instance: 9c94175f-2d56-454e-a834-4f54bf9df739] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:50:11.572162 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-842b41aa-802c-403f-8fbf-4dd0781b7137 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:50:11.572609 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-842b41aa-802c-403f-8fbf-4dd0781b7137 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:50:11.573408 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-842b41aa-802c-403f-8fbf-4dd0781b7137 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:50:11.573848 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-842b41aa-802c-403f-8fbf-4dd0781b7137 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:50:11.574865 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-7f25a9dd-6860-4830-9e8c-b8c722fba49f tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:50:11.575567 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-7f25a9dd-6860-4830-9e8c-b8c722fba49f tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] [instance: 62affd75-bad1-417a-aac7-3495d56d9f19] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:50:11.582069 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-7f25a9dd-6860-4830-9e8c-b8c722fba49f tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:50:11.582571 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-7f25a9dd-6860-4830-9e8c-b8c722fba49f tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:50:11.583344 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-7f25a9dd-6860-4830-9e8c-b8c722fba49f tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:50:11.583832 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-7f25a9dd-6860-4830-9e8c-b8c722fba49f tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:50:11.781770 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-842b41aa-802c-403f-8fbf-4dd0781b7137 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac48e585c133487dadbe0a1e095bfde0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32813adc26c64016b99c9c5fd838d391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:50:11.789304 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-7f25a9dd-6860-4830-9e8c-b8c722fba49f tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:50:11.790760 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-842b41aa-802c-403f-8fbf-4dd0781b7137 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] 10.222.0.66 "GET /compute/v2.1/servers/9c94175f-2d56-454e-a834-4f54bf9df739" status: 200 len: 1264 microversion: 2.1 time: 0.229564 Aug 04 03:50:11.791402 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 542/1079] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:50:11 2022] GET /compute/v2.1/servers/9c94175f-2d56-454e-a834-4f54bf9df739 => generated 1264 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:50:11.797291 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-7f25a9dd-6860-4830-9e8c-b8c722fba49f tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:50:11.798785 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-7f25a9dd-6860-4830-9e8c-b8c722fba49f tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:50:11.799932 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-7f25a9dd-6860-4830-9e8c-b8c722fba49f tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] 10.222.0.66 "GET /compute/v2.1/servers/62affd75-bad1-417a-aac7-3495d56d9f19" status: 200 len: 1731 microversion: 2.20 time: 0.229018 Aug 04 03:50:11.800476 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 538/1080] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 03:50:11 2022] GET /compute/v2.1/servers/62affd75-bad1-417a-aac7-3495d56d9f19 => generated 1731 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 03:50:12.812100 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-dbbf404d-3539-4922-8995-7df2ea807d65 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:50:12.812713 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-dbbf404d-3539-4922-8995-7df2ea807d65 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] [instance: 9c94175f-2d56-454e-a834-4f54bf9df739] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:50:12.819810 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-dbbf404d-3539-4922-8995-7df2ea807d65 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:50:12.820260 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-dbbf404d-3539-4922-8995-7df2ea807d65 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:50:12.821022 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-dbbf404d-3539-4922-8995-7df2ea807d65 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:50:12.821490 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-dbbf404d-3539-4922-8995-7df2ea807d65 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:50:12.823883 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-1b017b1d-9b7b-417d-9014-c722aabbc380 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:50:12.824488 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-1b017b1d-9b7b-417d-9014-c722aabbc380 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] [instance: 62affd75-bad1-417a-aac7-3495d56d9f19] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:50:12.830965 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-1b017b1d-9b7b-417d-9014-c722aabbc380 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:50:12.831410 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-1b017b1d-9b7b-417d-9014-c722aabbc380 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:50:12.832163 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-1b017b1d-9b7b-417d-9014-c722aabbc380 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:50:12.833473 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-1b017b1d-9b7b-417d-9014-c722aabbc380 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:50:13.021328 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-dbbf404d-3539-4922-8995-7df2ea807d65 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac48e585c133487dadbe0a1e095bfde0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32813adc26c64016b99c9c5fd838d391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:50:13.029970 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-dbbf404d-3539-4922-8995-7df2ea807d65 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] 10.222.0.66 "GET /compute/v2.1/servers/9c94175f-2d56-454e-a834-4f54bf9df739" status: 200 len: 1264 microversion: 2.1 time: 0.220695 Aug 04 03:50:13.030150 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-1b017b1d-9b7b-417d-9014-c722aabbc380 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:50:13.030276 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 543/1081] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:50:12 2022] GET /compute/v2.1/servers/9c94175f-2d56-454e-a834-4f54bf9df739 => generated 1264 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:50:13.038236 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-1b017b1d-9b7b-417d-9014-c722aabbc380 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:50:13.039903 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-1b017b1d-9b7b-417d-9014-c722aabbc380 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:50:13.041089 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-1b017b1d-9b7b-417d-9014-c722aabbc380 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] 10.222.0.66 "GET /compute/v2.1/servers/62affd75-bad1-417a-aac7-3495d56d9f19" status: 200 len: 1731 microversion: 2.20 time: 0.221013 Aug 04 03:50:13.041830 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 539/1082] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 03:50:12 2022] GET /compute/v2.1/servers/62affd75-bad1-417a-aac7-3495d56d9f19 => generated 1731 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 03:50:14.049850 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-6cb75e23-a716-40f5-b3b9-58dfee565b8f tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:50:14.050466 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-6cb75e23-a716-40f5-b3b9-58dfee565b8f tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] [instance: 9c94175f-2d56-454e-a834-4f54bf9df739] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:50:14.053428 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG dbcounter [-] [130262] Writing DB stats nova_api:SELECT=50 {{(pid=130262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:50:14.058218 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-6cb75e23-a716-40f5-b3b9-58dfee565b8f tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:50:14.058669 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-6cb75e23-a716-40f5-b3b9-58dfee565b8f tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:50:14.059438 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-6cb75e23-a716-40f5-b3b9-58dfee565b8f tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:50:14.059882 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-6cb75e23-a716-40f5-b3b9-58dfee565b8f tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:50:14.067482 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-bfba2b8f-6b8c-40ae-a050-f70ebbf1183a tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:50:14.068378 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-bfba2b8f-6b8c-40ae-a050-f70ebbf1183a tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] [instance: 62affd75-bad1-417a-aac7-3495d56d9f19] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:50:14.081347 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-bfba2b8f-6b8c-40ae-a050-f70ebbf1183a tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:50:14.081861 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-bfba2b8f-6b8c-40ae-a050-f70ebbf1183a tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:50:14.083452 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-bfba2b8f-6b8c-40ae-a050-f70ebbf1183a tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:50:14.084155 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-bfba2b8f-6b8c-40ae-a050-f70ebbf1183a tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:50:14.262313 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-6cb75e23-a716-40f5-b3b9-58dfee565b8f tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac48e585c133487dadbe0a1e095bfde0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32813adc26c64016b99c9c5fd838d391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:50:14.269915 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-6cb75e23-a716-40f5-b3b9-58dfee565b8f tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] 10.222.0.66 "GET /compute/v2.1/servers/9c94175f-2d56-454e-a834-4f54bf9df739" status: 200 len: 1264 microversion: 2.1 time: 0.223770 Aug 04 03:50:14.270334 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 544/1083] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:50:14 2022] GET /compute/v2.1/servers/9c94175f-2d56-454e-a834-4f54bf9df739 => generated 1264 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:50:14.279541 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-bfba2b8f-6b8c-40ae-a050-f70ebbf1183a tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:50:14.288484 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-bfba2b8f-6b8c-40ae-a050-f70ebbf1183a tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:50:14.290177 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-bfba2b8f-6b8c-40ae-a050-f70ebbf1183a tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:50:14.291451 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-bfba2b8f-6b8c-40ae-a050-f70ebbf1183a tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] 10.222.0.66 "GET /compute/v2.1/servers/62affd75-bad1-417a-aac7-3495d56d9f19" status: 200 len: 1731 microversion: 2.20 time: 0.228393 Aug 04 03:50:14.305393 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 540/1084] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 03:50:14 2022] GET /compute/v2.1/servers/62affd75-bad1-417a-aac7-3495d56d9f19 => generated 1731 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 03:50:15.290540 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-e165ece0-ad7f-4696-8e02-477254f5db66 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:50:15.291278 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-e165ece0-ad7f-4696-8e02-477254f5db66 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] [instance: 9c94175f-2d56-454e-a834-4f54bf9df739] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:50:15.297382 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-e165ece0-ad7f-4696-8e02-477254f5db66 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:50:15.297833 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-e165ece0-ad7f-4696-8e02-477254f5db66 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:50:15.298604 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-e165ece0-ad7f-4696-8e02-477254f5db66 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:50:15.299039 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-e165ece0-ad7f-4696-8e02-477254f5db66 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:50:15.316735 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-84500b12-a5af-4604-9eef-345fc0b64c3d tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:50:15.317099 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-84500b12-a5af-4604-9eef-345fc0b64c3d tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] [instance: 62affd75-bad1-417a-aac7-3495d56d9f19] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:50:15.324943 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-84500b12-a5af-4604-9eef-345fc0b64c3d tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:50:15.325814 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-84500b12-a5af-4604-9eef-345fc0b64c3d tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:50:15.327613 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-84500b12-a5af-4604-9eef-345fc0b64c3d tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:50:15.328217 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-84500b12-a5af-4604-9eef-345fc0b64c3d tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:50:15.516693 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-e165ece0-ad7f-4696-8e02-477254f5db66 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac48e585c133487dadbe0a1e095bfde0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32813adc26c64016b99c9c5fd838d391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:50:15.520059 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-84500b12-a5af-4604-9eef-345fc0b64c3d tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:50:15.523317 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG dbcounter [-] [130262] Writing DB stats nova_cell1:SELECT=100 {{(pid=130262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:50:15.525783 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-e165ece0-ad7f-4696-8e02-477254f5db66 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] 10.222.0.66 "GET /compute/v2.1/servers/9c94175f-2d56-454e-a834-4f54bf9df739" status: 200 len: 1450 microversion: 2.1 time: 0.239136 Aug 04 03:50:15.526347 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 545/1085] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:50:15 2022] GET /compute/v2.1/servers/9c94175f-2d56-454e-a834-4f54bf9df739 => generated 1450 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:50:15.529441 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-84500b12-a5af-4604-9eef-345fc0b64c3d tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:50:15.530942 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-84500b12-a5af-4604-9eef-345fc0b64c3d tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:50:15.532105 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-84500b12-a5af-4604-9eef-345fc0b64c3d tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] 10.222.0.66 "GET /compute/v2.1/servers/62affd75-bad1-417a-aac7-3495d56d9f19" status: 200 len: 1731 microversion: 2.20 time: 0.220409 Aug 04 03:50:15.532652 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 541/1086] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 03:50:15 2022] GET /compute/v2.1/servers/62affd75-bad1-417a-aac7-3495d56d9f19 => generated 1731 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 03:50:15.547304 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-1e2fae8a-ae51-42ef-b05e-89510660c6fc tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:50:15.548198 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-1e2fae8a-ae51-42ef-b05e-89510660c6fc tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] [instance: 9c94175f-2d56-454e-a834-4f54bf9df739] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:50:15.554974 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-1e2fae8a-ae51-42ef-b05e-89510660c6fc tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:50:15.555501 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-1e2fae8a-ae51-42ef-b05e-89510660c6fc tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:50:15.556562 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-1e2fae8a-ae51-42ef-b05e-89510660c6fc tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:50:15.557062 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-1e2fae8a-ae51-42ef-b05e-89510660c6fc tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:50:15.707268 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-1e2fae8a-ae51-42ef-b05e-89510660c6fc tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac48e585c133487dadbe0a1e095bfde0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32813adc26c64016b99c9c5fd838d391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:50:15.716187 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-1e2fae8a-ae51-42ef-b05e-89510660c6fc tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] 10.222.0.66 "GET /compute/v2.1/servers/9c94175f-2d56-454e-a834-4f54bf9df739" status: 200 len: 1450 microversion: 2.1 time: 0.172737 Aug 04 03:50:15.716859 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 546/1087] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:50:15 2022] GET /compute/v2.1/servers/9c94175f-2d56-454e-a834-4f54bf9df739 => generated 1450 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:50:15.925298 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [req-bb7f2592-84cc-4303-83f8-be302c5b564f req-ccceae4b-5963-4e96-af9f-820c826a3783 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62affd75-bad1-417a-aac7-3495d56d9f19", "name": "network-vif-plugged", "status": "completed", "tag": "de2fd866-0219-43e7-a73a-fd446fc3c7ba"}]} {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 03:50:15.935867 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [req-bb7f2592-84cc-4303-83f8-be302c5b564f req-ccceae4b-5963-4e96-af9f-820c826a3783 service nova] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:50:15.936312 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [req-bb7f2592-84cc-4303-83f8-be302c5b564f req-ccceae4b-5963-4e96-af9f-820c826a3783 service nova] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:50:15.947616 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.compute.server_external_events [req-bb7f2592-84cc-4303-83f8-be302c5b564f req-ccceae4b-5963-4e96-af9f-820c826a3783 service nova] Creating event network-vif-plugged:de2fd866-0219-43e7-a73a-fd446fc3c7ba for instance 62affd75-bad1-417a-aac7-3495d56d9f19 on hv-cinder-73306 Aug 04 03:50:15.952733 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [req-bb7f2592-84cc-4303-83f8-be302c5b564f req-ccceae4b-5963-4e96-af9f-820c826a3783 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.223371 Aug 04 03:50:15.953929 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 542/1088] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 03:50:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 03:50:16.557303 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-5dc992a0-49f6-41df-b46b-b2d2f1afcae5 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:50:16.557923 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-5dc992a0-49f6-41df-b46b-b2d2f1afcae5 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] [instance: 62affd75-bad1-417a-aac7-3495d56d9f19] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:50:16.564823 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-5dc992a0-49f6-41df-b46b-b2d2f1afcae5 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:50:16.565316 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-5dc992a0-49f6-41df-b46b-b2d2f1afcae5 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:50:16.566097 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-5dc992a0-49f6-41df-b46b-b2d2f1afcae5 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:50:16.566540 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-5dc992a0-49f6-41df-b46b-b2d2f1afcae5 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:50:16.739259 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-5dc992a0-49f6-41df-b46b-b2d2f1afcae5 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:50:16.748315 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-5dc992a0-49f6-41df-b46b-b2d2f1afcae5 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:50:16.749916 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-5dc992a0-49f6-41df-b46b-b2d2f1afcae5 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:50:16.751126 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-5dc992a0-49f6-41df-b46b-b2d2f1afcae5 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] 10.222.0.66 "GET /compute/v2.1/servers/62affd75-bad1-417a-aac7-3495d56d9f19" status: 200 len: 1731 microversion: 2.20 time: 0.199397 Aug 04 03:50:16.751694 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 547/1089] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 03:50:16 2022] GET /compute/v2.1/servers/62affd75-bad1-417a-aac7-3495d56d9f19 => generated 1731 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 03:50:17.365676 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 03:50:17.365877 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: Thu Aug 4 03:50:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 03:50:17.775699 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-df68a364-1d91-4134-b280-c4b41fc95311 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:50:17.776399 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-df68a364-1d91-4134-b280-c4b41fc95311 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] [instance: 62affd75-bad1-417a-aac7-3495d56d9f19] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:50:17.782687 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-df68a364-1d91-4134-b280-c4b41fc95311 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:50:17.783802 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-df68a364-1d91-4134-b280-c4b41fc95311 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:50:17.783916 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-df68a364-1d91-4134-b280-c4b41fc95311 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:50:17.784318 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-df68a364-1d91-4134-b280-c4b41fc95311 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:50:17.941592 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-df68a364-1d91-4134-b280-c4b41fc95311 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:50:17.952453 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-df68a364-1d91-4134-b280-c4b41fc95311 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:50:17.961987 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-df68a364-1d91-4134-b280-c4b41fc95311 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:50:17.970227 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-df68a364-1d91-4134-b280-c4b41fc95311 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] 10.222.0.66 "GET /compute/v2.1/servers/62affd75-bad1-417a-aac7-3495d56d9f19" status: 200 len: 1731 microversion: 2.20 time: 0.193407 Aug 04 03:50:17.970870 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 543/1090] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 03:50:17 2022] GET /compute/v2.1/servers/62affd75-bad1-417a-aac7-3495d56d9f19 => generated 1731 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 03:50:17.989709 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [req-8a4b0d27-5589-42bd-80c5-1727c8e68005 req-9195cb24-86fa-4a28-9c18-f492d37bd255 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c94175f-2d56-454e-a834-4f54bf9df739", "tag": "f138a127-97be-4818-9ebe-61a13e12b1e2"}]} {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 03:50:18.002364 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [req-8a4b0d27-5589-42bd-80c5-1727c8e68005 req-9195cb24-86fa-4a28-9c18-f492d37bd255 service nova] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:50:18.002933 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [req-8a4b0d27-5589-42bd-80c5-1727c8e68005 req-9195cb24-86fa-4a28-9c18-f492d37bd255 service nova] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:50:18.015298 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.compute.server_external_events [req-8a4b0d27-5589-42bd-80c5-1727c8e68005 req-9195cb24-86fa-4a28-9c18-f492d37bd255 service nova] Creating event network-changed:f138a127-97be-4818-9ebe-61a13e12b1e2 for instance 9c94175f-2d56-454e-a834-4f54bf9df739 on hv-cinder-73306 Aug 04 03:50:18.022007 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [req-8a4b0d27-5589-42bd-80c5-1727c8e68005 req-9195cb24-86fa-4a28-9c18-f492d37bd255 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038607 Aug 04 03:50:18.022007 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 548/1091] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 03:50:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 03:50:18.997679 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-59b163af-7038-45b0-b9f7-8cc1f81c7cf5 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:50:18.998349 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-59b163af-7038-45b0-b9f7-8cc1f81c7cf5 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] [instance: 62affd75-bad1-417a-aac7-3495d56d9f19] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:50:19.009315 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-59b163af-7038-45b0-b9f7-8cc1f81c7cf5 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:50:19.010062 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-59b163af-7038-45b0-b9f7-8cc1f81c7cf5 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:50:19.011084 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-59b163af-7038-45b0-b9f7-8cc1f81c7cf5 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:50:19.011681 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-59b163af-7038-45b0-b9f7-8cc1f81c7cf5 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:50:19.157076 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-59b163af-7038-45b0-b9f7-8cc1f81c7cf5 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:50:19.170730 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-59b163af-7038-45b0-b9f7-8cc1f81c7cf5 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:50:19.172232 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-59b163af-7038-45b0-b9f7-8cc1f81c7cf5 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:50:19.173461 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-59b163af-7038-45b0-b9f7-8cc1f81c7cf5 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] 10.222.0.66 "GET /compute/v2.1/servers/62affd75-bad1-417a-aac7-3495d56d9f19" status: 200 len: 1731 microversion: 2.20 time: 0.180012 Aug 04 03:50:19.174016 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 544/1092] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 03:50:18 2022] GET /compute/v2.1/servers/62affd75-bad1-417a-aac7-3495d56d9f19 => generated 1731 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 03:50:19.828555 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-62d16f1b-5bdb-4ea2-8cb5-4a9d2ed284e9 tempest-VolumesNegativeTest-2006341457 tempest-VolumesNegativeTest-2006341457-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-528017495", "imageRef": "0208f4b3-1d2f-42e4-a9b4-528bf5066fe1", "flavorRef": "452"}} {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 03:50:19.876654 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.network.neutron [None req-62d16f1b-5bdb-4ea2-8cb5-4a9d2ed284e9 tempest-VolumesNegativeTest-2006341457 tempest-VolumesNegativeTest-2006341457-project] validate_networks() for None {{(pid=130262) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 03:50:20.150936 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.virt.hardware [None req-62d16f1b-5bdb-4ea2-8cb5-4a9d2ed284e9 tempest-VolumesNegativeTest-2006341457 tempest-VolumesNegativeTest-2006341457-project] Flavor limits 0:0:0 {{(pid=130262) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 03:50:20.151373 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.virt.hardware [None req-62d16f1b-5bdb-4ea2-8cb5-4a9d2ed284e9 tempest-VolumesNegativeTest-2006341457 tempest-VolumesNegativeTest-2006341457-project] Image limits 0:0:0 {{(pid=130262) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 03:50:20.151844 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.virt.hardware [None req-62d16f1b-5bdb-4ea2-8cb5-4a9d2ed284e9 tempest-VolumesNegativeTest-2006341457 tempest-VolumesNegativeTest-2006341457-project] Flavor pref 0:0:0 {{(pid=130262) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 03:50:20.152247 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.virt.hardware [None req-62d16f1b-5bdb-4ea2-8cb5-4a9d2ed284e9 tempest-VolumesNegativeTest-2006341457 tempest-VolumesNegativeTest-2006341457-project] Image pref 0:0:0 {{(pid=130262) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 03:50:20.152654 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.virt.hardware [None req-62d16f1b-5bdb-4ea2-8cb5-4a9d2ed284e9 tempest-VolumesNegativeTest-2006341457 tempest-VolumesNegativeTest-2006341457-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130262) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 03:50:20.161354 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-62d16f1b-5bdb-4ea2-8cb5-4a9d2ed284e9 tempest-VolumesNegativeTest-2006341457 tempest-VolumesNegativeTest-2006341457-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:50:20.161808 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-62d16f1b-5bdb-4ea2-8cb5-4a9d2ed284e9 tempest-VolumesNegativeTest-2006341457 tempest-VolumesNegativeTest-2006341457-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:50:20.163204 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-62d16f1b-5bdb-4ea2-8cb5-4a9d2ed284e9 tempest-VolumesNegativeTest-2006341457 tempest-VolumesNegativeTest-2006341457-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:50:20.163640 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-62d16f1b-5bdb-4ea2-8cb5-4a9d2ed284e9 tempest-VolumesNegativeTest-2006341457 tempest-VolumesNegativeTest-2006341457-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:50:20.180986 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.quota [None req-62d16f1b-5bdb-4ea2-8cb5-4a9d2ed284e9 tempest-VolumesNegativeTest-2006341457 tempest-VolumesNegativeTest-2006341457-project] Getting quotas for project 1dd657bfb46942d798e6972c64706a4e. Resources: {'instances', 'ram', 'cores'} {{(pid=130262) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 03:50:20.184991 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.quota [None req-62d16f1b-5bdb-4ea2-8cb5-4a9d2ed284e9 tempest-VolumesNegativeTest-2006341457 tempest-VolumesNegativeTest-2006341457-project] Getting quotas for user 48d105f34f6d42fc800517b33a30d2c8 and project 1dd657bfb46942d798e6972c64706a4e. Resources: {'instances', 'ram', 'cores'} {{(pid=130262) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 03:50:20.195836 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-62d16f1b-5bdb-4ea2-8cb5-4a9d2ed284e9 tempest-VolumesNegativeTest-2006341457 tempest-VolumesNegativeTest-2006341457-project] Going to run 1 instances... {{(pid=130262) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 03:50:20.198206 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-62d16f1b-5bdb-4ea2-8cb5-4a9d2ed284e9 tempest-VolumesNegativeTest-2006341457 tempest-VolumesNegativeTest-2006341457-project] [instance: 53aeb67e-f80f-400e-b28d-41c84292fe5b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0208f4b3-1d2f-42e4-a9b4-528bf5066fe1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130262) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 03:50:20.198362 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-7dc5d911-ea0a-46c4-9606-4d4e6eee7a9b tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:50:20.199018 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-7dc5d911-ea0a-46c4-9606-4d4e6eee7a9b tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] [instance: 62affd75-bad1-417a-aac7-3495d56d9f19] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:50:20.205539 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-7dc5d911-ea0a-46c4-9606-4d4e6eee7a9b tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:50:20.205983 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-7dc5d911-ea0a-46c4-9606-4d4e6eee7a9b tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:50:20.206733 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-7dc5d911-ea0a-46c4-9606-4d4e6eee7a9b tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:50:20.207394 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-7dc5d911-ea0a-46c4-9606-4d4e6eee7a9b tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:50:20.304687 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-62d16f1b-5bdb-4ea2-8cb5-4a9d2ed284e9 tempest-VolumesNegativeTest-2006341457 tempest-VolumesNegativeTest-2006341457-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.485449 Aug 04 03:50:20.305489 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 549/1093] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 03:50:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 487 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 03:50:20.315810 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-9560c4e1-9715-47c0-9a65-5dcdaf3a7930 tempest-VolumesNegativeTest-2006341457 tempest-VolumesNegativeTest-2006341457-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:50:20.316417 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-9560c4e1-9715-47c0-9a65-5dcdaf3a7930 tempest-VolumesNegativeTest-2006341457 tempest-VolumesNegativeTest-2006341457-project] [instance: 53aeb67e-f80f-400e-b28d-41c84292fe5b] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:50:20.346860 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-7dc5d911-ea0a-46c4-9606-4d4e6eee7a9b tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:50:20.360955 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-7dc5d911-ea0a-46c4-9606-4d4e6eee7a9b tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:50:20.360955 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-7dc5d911-ea0a-46c4-9606-4d4e6eee7a9b tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:50:20.360955 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-7dc5d911-ea0a-46c4-9606-4d4e6eee7a9b tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] 10.222.0.66 "GET /compute/v2.1/servers/62affd75-bad1-417a-aac7-3495d56d9f19" status: 200 len: 1718 microversion: 2.20 time: 0.165434 Aug 04 03:50:20.361378 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 545/1094] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 03:50:20 2022] GET /compute/v2.1/servers/62affd75-bad1-417a-aac7-3495d56d9f19 => generated 1718 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 04 03:50:20.382862 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-9560c4e1-9715-47c0-9a65-5dcdaf3a7930 tempest-VolumesNegativeTest-2006341457 tempest-VolumesNegativeTest-2006341457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d105f34f6d42fc800517b33a30d2c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd657bfb46942d798e6972c64706a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:50:20.390392 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-9560c4e1-9715-47c0-9a65-5dcdaf3a7930 tempest-VolumesNegativeTest-2006341457 tempest-VolumesNegativeTest-2006341457-project] 10.222.0.66 "GET /compute/v2.1/servers/53aeb67e-f80f-400e-b28d-41c84292fe5b" status: 200 len: 1214 microversion: 2.1 time: 0.078344 Aug 04 03:50:20.391033 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 550/1095] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:50:20 2022] GET /compute/v2.1/servers/53aeb67e-f80f-400e-b28d-41c84292fe5b => generated 1214 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:50:21.411363 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-ca9d647d-2d67-4a11-8bb3-5bbf73e0620d tempest-VolumesNegativeTest-2006341457 tempest-VolumesNegativeTest-2006341457-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:50:21.411998 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-ca9d647d-2d67-4a11-8bb3-5bbf73e0620d tempest-VolumesNegativeTest-2006341457 tempest-VolumesNegativeTest-2006341457-project] [instance: 53aeb67e-f80f-400e-b28d-41c84292fe5b] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:50:21.465213 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-ca9d647d-2d67-4a11-8bb3-5bbf73e0620d tempest-VolumesNegativeTest-2006341457 tempest-VolumesNegativeTest-2006341457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d105f34f6d42fc800517b33a30d2c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd657bfb46942d798e6972c64706a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:50:21.472233 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-ca9d647d-2d67-4a11-8bb3-5bbf73e0620d tempest-VolumesNegativeTest-2006341457 tempest-VolumesNegativeTest-2006341457-project] 10.222.0.66 "GET /compute/v2.1/servers/53aeb67e-f80f-400e-b28d-41c84292fe5b" status: 200 len: 1214 microversion: 2.1 time: 0.064872 Aug 04 03:50:21.472791 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 546/1096] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:50:21 2022] GET /compute/v2.1/servers/53aeb67e-f80f-400e-b28d-41c84292fe5b => generated 1214 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:50:22.493980 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-c2671b86-4efa-4e62-93bf-d28c10809512 tempest-VolumesNegativeTest-2006341457 tempest-VolumesNegativeTest-2006341457-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:50:22.494586 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-c2671b86-4efa-4e62-93bf-d28c10809512 tempest-VolumesNegativeTest-2006341457 tempest-VolumesNegativeTest-2006341457-project] [instance: 53aeb67e-f80f-400e-b28d-41c84292fe5b] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:50:22.501346 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-c2671b86-4efa-4e62-93bf-d28c10809512 tempest-VolumesNegativeTest-2006341457 tempest-VolumesNegativeTest-2006341457-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:50:22.501794 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-c2671b86-4efa-4e62-93bf-d28c10809512 tempest-VolumesNegativeTest-2006341457 tempest-VolumesNegativeTest-2006341457-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:50:22.502546 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-c2671b86-4efa-4e62-93bf-d28c10809512 tempest-VolumesNegativeTest-2006341457 tempest-VolumesNegativeTest-2006341457-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:50:22.502978 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-c2671b86-4efa-4e62-93bf-d28c10809512 tempest-VolumesNegativeTest-2006341457 tempest-VolumesNegativeTest-2006341457-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:50:22.565808 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-c2671b86-4efa-4e62-93bf-d28c10809512 tempest-VolumesNegativeTest-2006341457 tempest-VolumesNegativeTest-2006341457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d105f34f6d42fc800517b33a30d2c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd657bfb46942d798e6972c64706a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:50:22.573937 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-c2671b86-4efa-4e62-93bf-d28c10809512 tempest-VolumesNegativeTest-2006341457 tempest-VolumesNegativeTest-2006341457-project] 10.222.0.66 "GET /compute/v2.1/servers/53aeb67e-f80f-400e-b28d-41c84292fe5b" status: 200 len: 1266 microversion: 2.1 time: 0.083933 Aug 04 03:50:22.574493 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 551/1097] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:50:22 2022] GET /compute/v2.1/servers/53aeb67e-f80f-400e-b28d-41c84292fe5b => generated 1266 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:50:23.595332 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-a424e0fb-1e39-473c-87eb-84d627c7c8ab tempest-VolumesNegativeTest-2006341457 tempest-VolumesNegativeTest-2006341457-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:50:23.595955 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-a424e0fb-1e39-473c-87eb-84d627c7c8ab tempest-VolumesNegativeTest-2006341457 tempest-VolumesNegativeTest-2006341457-project] [instance: 53aeb67e-f80f-400e-b28d-41c84292fe5b] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:50:23.604331 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-a424e0fb-1e39-473c-87eb-84d627c7c8ab tempest-VolumesNegativeTest-2006341457 tempest-VolumesNegativeTest-2006341457-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:50:23.604784 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-a424e0fb-1e39-473c-87eb-84d627c7c8ab tempest-VolumesNegativeTest-2006341457 tempest-VolumesNegativeTest-2006341457-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:50:23.605681 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-a424e0fb-1e39-473c-87eb-84d627c7c8ab tempest-VolumesNegativeTest-2006341457 tempest-VolumesNegativeTest-2006341457-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:50:23.606126 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-a424e0fb-1e39-473c-87eb-84d627c7c8ab tempest-VolumesNegativeTest-2006341457 tempest-VolumesNegativeTest-2006341457-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:50:23.909682 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-a424e0fb-1e39-473c-87eb-84d627c7c8ab tempest-VolumesNegativeTest-2006341457 tempest-VolumesNegativeTest-2006341457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d105f34f6d42fc800517b33a30d2c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd657bfb46942d798e6972c64706a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:50:23.917515 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-a424e0fb-1e39-473c-87eb-84d627c7c8ab tempest-VolumesNegativeTest-2006341457 tempest-VolumesNegativeTest-2006341457-project] 10.222.0.66 "GET /compute/v2.1/servers/53aeb67e-f80f-400e-b28d-41c84292fe5b" status: 200 len: 1272 microversion: 2.1 time: 0.326038 Aug 04 03:50:23.921843 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 547/1098] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:50:23 2022] GET /compute/v2.1/servers/53aeb67e-f80f-400e-b28d-41c84292fe5b => generated 1272 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:50:24.938350 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-953b6ca3-75cf-4b91-88d8-8ca6b211a3fa tempest-VolumesNegativeTest-2006341457 tempest-VolumesNegativeTest-2006341457-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:50:24.939120 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [req-6c711a63-7211-43f5-88bf-1dedddaba973 req-2197db2a-fb13-496e-86e8-675f746c49f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53aeb67e-f80f-400e-b28d-41c84292fe5b", "tag": "9478f132-e4e5-4579-b848-18730ee7689b"}]} {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 03:50:24.940041 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-953b6ca3-75cf-4b91-88d8-8ca6b211a3fa tempest-VolumesNegativeTest-2006341457 tempest-VolumesNegativeTest-2006341457-project] [instance: 53aeb67e-f80f-400e-b28d-41c84292fe5b] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:50:24.946954 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-953b6ca3-75cf-4b91-88d8-8ca6b211a3fa tempest-VolumesNegativeTest-2006341457 tempest-VolumesNegativeTest-2006341457-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:50:24.947634 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-953b6ca3-75cf-4b91-88d8-8ca6b211a3fa tempest-VolumesNegativeTest-2006341457 tempest-VolumesNegativeTest-2006341457-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:50:24.948568 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-953b6ca3-75cf-4b91-88d8-8ca6b211a3fa tempest-VolumesNegativeTest-2006341457 tempest-VolumesNegativeTest-2006341457-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:50:24.949013 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-953b6ca3-75cf-4b91-88d8-8ca6b211a3fa tempest-VolumesNegativeTest-2006341457 tempest-VolumesNegativeTest-2006341457-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:50:24.951168 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [req-6c711a63-7211-43f5-88bf-1dedddaba973 req-2197db2a-fb13-496e-86e8-675f746c49f0 service nova] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:50:24.951681 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [req-6c711a63-7211-43f5-88bf-1dedddaba973 req-2197db2a-fb13-496e-86e8-675f746c49f0 service nova] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:50:24.963906 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.compute.server_external_events [req-6c711a63-7211-43f5-88bf-1dedddaba973 req-2197db2a-fb13-496e-86e8-675f746c49f0 service nova] Creating event network-changed:9478f132-e4e5-4579-b848-18730ee7689b for instance 53aeb67e-f80f-400e-b28d-41c84292fe5b on hv-cinder-73306 Aug 04 03:50:24.969096 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [req-6c711a63-7211-43f5-88bf-1dedddaba973 req-2197db2a-fb13-496e-86e8-675f746c49f0 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033730 Aug 04 03:50:24.970094 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 548/1099] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 03:50:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 03:50:25.084045 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-953b6ca3-75cf-4b91-88d8-8ca6b211a3fa tempest-VolumesNegativeTest-2006341457 tempest-VolumesNegativeTest-2006341457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d105f34f6d42fc800517b33a30d2c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd657bfb46942d798e6972c64706a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:50:25.092237 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-953b6ca3-75cf-4b91-88d8-8ca6b211a3fa tempest-VolumesNegativeTest-2006341457 tempest-VolumesNegativeTest-2006341457-project] 10.222.0.66 "GET /compute/v2.1/servers/53aeb67e-f80f-400e-b28d-41c84292fe5b" status: 200 len: 1314 microversion: 2.1 time: 0.157964 Aug 04 03:50:25.092897 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 552/1100] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:50:24 2022] GET /compute/v2.1/servers/53aeb67e-f80f-400e-b28d-41c84292fe5b => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:50:26.114027 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-cba67b6d-f557-4007-961a-51612fb7a9b0 tempest-VolumesNegativeTest-2006341457 tempest-VolumesNegativeTest-2006341457-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:50:26.114730 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-cba67b6d-f557-4007-961a-51612fb7a9b0 tempest-VolumesNegativeTest-2006341457 tempest-VolumesNegativeTest-2006341457-project] [instance: 53aeb67e-f80f-400e-b28d-41c84292fe5b] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:50:26.121761 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-cba67b6d-f557-4007-961a-51612fb7a9b0 tempest-VolumesNegativeTest-2006341457 tempest-VolumesNegativeTest-2006341457-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:50:26.122220 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-cba67b6d-f557-4007-961a-51612fb7a9b0 tempest-VolumesNegativeTest-2006341457 tempest-VolumesNegativeTest-2006341457-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:50:26.123036 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-cba67b6d-f557-4007-961a-51612fb7a9b0 tempest-VolumesNegativeTest-2006341457 tempest-VolumesNegativeTest-2006341457-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:50:26.123437 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-cba67b6d-f557-4007-961a-51612fb7a9b0 tempest-VolumesNegativeTest-2006341457 tempest-VolumesNegativeTest-2006341457-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:50:26.260650 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-cba67b6d-f557-4007-961a-51612fb7a9b0 tempest-VolumesNegativeTest-2006341457 tempest-VolumesNegativeTest-2006341457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d105f34f6d42fc800517b33a30d2c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd657bfb46942d798e6972c64706a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:50:26.268265 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-cba67b6d-f557-4007-961a-51612fb7a9b0 tempest-VolumesNegativeTest-2006341457 tempest-VolumesNegativeTest-2006341457-project] 10.222.0.66 "GET /compute/v2.1/servers/53aeb67e-f80f-400e-b28d-41c84292fe5b" status: 200 len: 1314 microversion: 2.1 time: 0.159069 Aug 04 03:50:26.268840 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 549/1101] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:50:26 2022] GET /compute/v2.1/servers/53aeb67e-f80f-400e-b28d-41c84292fe5b => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:50:27.289816 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-2fbdde0f-041e-4da0-a4b7-ed7f2360b797 tempest-VolumesNegativeTest-2006341457 tempest-VolumesNegativeTest-2006341457-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:50:27.290429 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-2fbdde0f-041e-4da0-a4b7-ed7f2360b797 tempest-VolumesNegativeTest-2006341457 tempest-VolumesNegativeTest-2006341457-project] [instance: 53aeb67e-f80f-400e-b28d-41c84292fe5b] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:50:27.296903 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-2fbdde0f-041e-4da0-a4b7-ed7f2360b797 tempest-VolumesNegativeTest-2006341457 tempest-VolumesNegativeTest-2006341457-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:50:27.297379 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-2fbdde0f-041e-4da0-a4b7-ed7f2360b797 tempest-VolumesNegativeTest-2006341457 tempest-VolumesNegativeTest-2006341457-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:50:27.298144 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-2fbdde0f-041e-4da0-a4b7-ed7f2360b797 tempest-VolumesNegativeTest-2006341457 tempest-VolumesNegativeTest-2006341457-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:50:27.298581 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-2fbdde0f-041e-4da0-a4b7-ed7f2360b797 tempest-VolumesNegativeTest-2006341457 tempest-VolumesNegativeTest-2006341457-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:50:27.427406 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-2fbdde0f-041e-4da0-a4b7-ed7f2360b797 tempest-VolumesNegativeTest-2006341457 tempest-VolumesNegativeTest-2006341457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d105f34f6d42fc800517b33a30d2c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd657bfb46942d798e6972c64706a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:50:27.435565 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-2fbdde0f-041e-4da0-a4b7-ed7f2360b797 tempest-VolumesNegativeTest-2006341457 tempest-VolumesNegativeTest-2006341457-project] 10.222.0.66 "GET /compute/v2.1/servers/53aeb67e-f80f-400e-b28d-41c84292fe5b" status: 200 len: 1314 microversion: 2.1 time: 0.149892 Aug 04 03:50:27.436118 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 553/1102] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:50:27 2022] GET /compute/v2.1/servers/53aeb67e-f80f-400e-b28d-41c84292fe5b => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:50:28.457178 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-688c2bd1-c248-447a-bb25-7591a5f95085 tempest-VolumesNegativeTest-2006341457 tempest-VolumesNegativeTest-2006341457-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:50:28.457776 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-688c2bd1-c248-447a-bb25-7591a5f95085 tempest-VolumesNegativeTest-2006341457 tempest-VolumesNegativeTest-2006341457-project] [instance: 53aeb67e-f80f-400e-b28d-41c84292fe5b] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:50:28.464287 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-688c2bd1-c248-447a-bb25-7591a5f95085 tempest-VolumesNegativeTest-2006341457 tempest-VolumesNegativeTest-2006341457-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:50:28.464738 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-688c2bd1-c248-447a-bb25-7591a5f95085 tempest-VolumesNegativeTest-2006341457 tempest-VolumesNegativeTest-2006341457-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:50:28.465528 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-688c2bd1-c248-447a-bb25-7591a5f95085 tempest-VolumesNegativeTest-2006341457 tempest-VolumesNegativeTest-2006341457-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:50:28.465965 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-688c2bd1-c248-447a-bb25-7591a5f95085 tempest-VolumesNegativeTest-2006341457 tempest-VolumesNegativeTest-2006341457-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:50:28.481836 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG dbcounter [-] [130263] Writing DB stats nova_cell1:SELECT=100 {{(pid=130263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:50:28.596434 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-688c2bd1-c248-447a-bb25-7591a5f95085 tempest-VolumesNegativeTest-2006341457 tempest-VolumesNegativeTest-2006341457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d105f34f6d42fc800517b33a30d2c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd657bfb46942d798e6972c64706a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:50:28.604583 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-688c2bd1-c248-447a-bb25-7591a5f95085 tempest-VolumesNegativeTest-2006341457 tempest-VolumesNegativeTest-2006341457-project] 10.222.0.66 "GET /compute/v2.1/servers/53aeb67e-f80f-400e-b28d-41c84292fe5b" status: 200 len: 1314 microversion: 2.1 time: 0.151102 Aug 04 03:50:28.605158 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 550/1103] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:50:28 2022] GET /compute/v2.1/servers/53aeb67e-f80f-400e-b28d-41c84292fe5b => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:50:29.625901 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-d72c9153-6dfc-4c00-861c-4bd791704c51 tempest-VolumesNegativeTest-2006341457 tempest-VolumesNegativeTest-2006341457-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:50:29.626431 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-d72c9153-6dfc-4c00-861c-4bd791704c51 tempest-VolumesNegativeTest-2006341457 tempest-VolumesNegativeTest-2006341457-project] [instance: 53aeb67e-f80f-400e-b28d-41c84292fe5b] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:50:29.633358 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-d72c9153-6dfc-4c00-861c-4bd791704c51 tempest-VolumesNegativeTest-2006341457 tempest-VolumesNegativeTest-2006341457-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:50:29.633803 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-d72c9153-6dfc-4c00-861c-4bd791704c51 tempest-VolumesNegativeTest-2006341457 tempest-VolumesNegativeTest-2006341457-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:50:29.634587 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-d72c9153-6dfc-4c00-861c-4bd791704c51 tempest-VolumesNegativeTest-2006341457 tempest-VolumesNegativeTest-2006341457-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:50:29.635032 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-d72c9153-6dfc-4c00-861c-4bd791704c51 tempest-VolumesNegativeTest-2006341457 tempest-VolumesNegativeTest-2006341457-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:50:29.782614 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-d72c9153-6dfc-4c00-861c-4bd791704c51 tempest-VolumesNegativeTest-2006341457 tempest-VolumesNegativeTest-2006341457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d105f34f6d42fc800517b33a30d2c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd657bfb46942d798e6972c64706a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:50:29.791314 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-d72c9153-6dfc-4c00-861c-4bd791704c51 tempest-VolumesNegativeTest-2006341457 tempest-VolumesNegativeTest-2006341457-project] 10.222.0.66 "GET /compute/v2.1/servers/53aeb67e-f80f-400e-b28d-41c84292fe5b" status: 200 len: 1314 microversion: 2.1 time: 0.169618 Aug 04 03:50:29.791897 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 554/1104] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:50:29 2022] GET /compute/v2.1/servers/53aeb67e-f80f-400e-b28d-41c84292fe5b => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:50:30.811025 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-6c89b2ca-eeed-41f3-8157-ac592a14e54b tempest-VolumesNegativeTest-2006341457 tempest-VolumesNegativeTest-2006341457-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:50:30.811577 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-6c89b2ca-eeed-41f3-8157-ac592a14e54b tempest-VolumesNegativeTest-2006341457 tempest-VolumesNegativeTest-2006341457-project] [instance: 53aeb67e-f80f-400e-b28d-41c84292fe5b] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:50:30.818157 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-6c89b2ca-eeed-41f3-8157-ac592a14e54b tempest-VolumesNegativeTest-2006341457 tempest-VolumesNegativeTest-2006341457-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:50:30.818672 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-6c89b2ca-eeed-41f3-8157-ac592a14e54b tempest-VolumesNegativeTest-2006341457 tempest-VolumesNegativeTest-2006341457-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:50:30.819441 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-6c89b2ca-eeed-41f3-8157-ac592a14e54b tempest-VolumesNegativeTest-2006341457 tempest-VolumesNegativeTest-2006341457-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:50:30.819880 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-6c89b2ca-eeed-41f3-8157-ac592a14e54b tempest-VolumesNegativeTest-2006341457 tempest-VolumesNegativeTest-2006341457-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:50:30.947527 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-6c89b2ca-eeed-41f3-8157-ac592a14e54b tempest-VolumesNegativeTest-2006341457 tempest-VolumesNegativeTest-2006341457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d105f34f6d42fc800517b33a30d2c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd657bfb46942d798e6972c64706a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:50:30.955006 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-6c89b2ca-eeed-41f3-8157-ac592a14e54b tempest-VolumesNegativeTest-2006341457 tempest-VolumesNegativeTest-2006341457-project] 10.222.0.66 "GET /compute/v2.1/servers/53aeb67e-f80f-400e-b28d-41c84292fe5b" status: 200 len: 1314 microversion: 2.1 time: 0.147953 Aug 04 03:50:30.955582 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 551/1105] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:50:30 2022] GET /compute/v2.1/servers/53aeb67e-f80f-400e-b28d-41c84292fe5b => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:50:31.845772 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [req-5e34d487-e8fb-431d-a7fa-f67590bd41fb req-ca76e58d-c83f-4dc8-869d-93648af2ea4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53aeb67e-f80f-400e-b28d-41c84292fe5b", "name": "network-vif-plugged", "status": "completed", "tag": "9478f132-e4e5-4579-b848-18730ee7689b"}]} {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 03:50:31.850926 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG dbcounter [-] [130262] Writing DB stats nova_cell0:SELECT=2 {{(pid=130262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:50:31.851889 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG dbcounter [-] [130262] Writing DB stats nova_cell0:SELECT=8 {{(pid=130262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:50:31.857876 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [req-5e34d487-e8fb-431d-a7fa-f67590bd41fb req-ca76e58d-c83f-4dc8-869d-93648af2ea4d service nova] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:50:31.858317 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [req-5e34d487-e8fb-431d-a7fa-f67590bd41fb req-ca76e58d-c83f-4dc8-869d-93648af2ea4d service nova] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:50:31.873301 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.compute.server_external_events [req-5e34d487-e8fb-431d-a7fa-f67590bd41fb req-ca76e58d-c83f-4dc8-869d-93648af2ea4d service nova] Creating event network-vif-plugged:9478f132-e4e5-4579-b848-18730ee7689b for instance 53aeb67e-f80f-400e-b28d-41c84292fe5b on hv-cinder-73306 Aug 04 03:50:31.874963 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [req-5e34d487-e8fb-431d-a7fa-f67590bd41fb req-ca76e58d-c83f-4dc8-869d-93648af2ea4d service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032924 Aug 04 03:50:31.875522 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 555/1106] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 03:50:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 03:50:31.976150 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-115950f1-08ed-4c6b-84b4-b6caf40ceb2e tempest-VolumesNegativeTest-2006341457 tempest-VolumesNegativeTest-2006341457-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:50:31.976977 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-115950f1-08ed-4c6b-84b4-b6caf40ceb2e tempest-VolumesNegativeTest-2006341457 tempest-VolumesNegativeTest-2006341457-project] [instance: 53aeb67e-f80f-400e-b28d-41c84292fe5b] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:50:31.979273 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG dbcounter [-] [130263] Writing DB stats nova_cell0:SELECT=2 {{(pid=130263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:50:31.984712 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-115950f1-08ed-4c6b-84b4-b6caf40ceb2e tempest-VolumesNegativeTest-2006341457 tempest-VolumesNegativeTest-2006341457-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:50:31.985159 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-115950f1-08ed-4c6b-84b4-b6caf40ceb2e tempest-VolumesNegativeTest-2006341457 tempest-VolumesNegativeTest-2006341457-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:50:31.985962 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-115950f1-08ed-4c6b-84b4-b6caf40ceb2e tempest-VolumesNegativeTest-2006341457 tempest-VolumesNegativeTest-2006341457-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:50:31.986398 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-115950f1-08ed-4c6b-84b4-b6caf40ceb2e tempest-VolumesNegativeTest-2006341457 tempest-VolumesNegativeTest-2006341457-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:50:32.124581 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-115950f1-08ed-4c6b-84b4-b6caf40ceb2e tempest-VolumesNegativeTest-2006341457 tempest-VolumesNegativeTest-2006341457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d105f34f6d42fc800517b33a30d2c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd657bfb46942d798e6972c64706a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:50:32.132337 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-115950f1-08ed-4c6b-84b4-b6caf40ceb2e tempest-VolumesNegativeTest-2006341457 tempest-VolumesNegativeTest-2006341457-project] 10.222.0.66 "GET /compute/v2.1/servers/53aeb67e-f80f-400e-b28d-41c84292fe5b" status: 200 len: 1314 microversion: 2.1 time: 0.160057 Aug 04 03:50:32.132908 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 552/1107] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:50:31 2022] GET /compute/v2.1/servers/53aeb67e-f80f-400e-b28d-41c84292fe5b => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:50:33.155071 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-bc0ec601-3d98-42a5-8fbc-80b7898f761f tempest-VolumesNegativeTest-2006341457 tempest-VolumesNegativeTest-2006341457-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:50:33.155785 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-bc0ec601-3d98-42a5-8fbc-80b7898f761f tempest-VolumesNegativeTest-2006341457 tempest-VolumesNegativeTest-2006341457-project] [instance: 53aeb67e-f80f-400e-b28d-41c84292fe5b] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:50:33.163713 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-bc0ec601-3d98-42a5-8fbc-80b7898f761f tempest-VolumesNegativeTest-2006341457 tempest-VolumesNegativeTest-2006341457-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:50:33.164165 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-bc0ec601-3d98-42a5-8fbc-80b7898f761f tempest-VolumesNegativeTest-2006341457 tempest-VolumesNegativeTest-2006341457-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:50:33.164935 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-bc0ec601-3d98-42a5-8fbc-80b7898f761f tempest-VolumesNegativeTest-2006341457 tempest-VolumesNegativeTest-2006341457-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:50:33.165401 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-bc0ec601-3d98-42a5-8fbc-80b7898f761f tempest-VolumesNegativeTest-2006341457 tempest-VolumesNegativeTest-2006341457-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:50:33.293850 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-bc0ec601-3d98-42a5-8fbc-80b7898f761f tempest-VolumesNegativeTest-2006341457 tempest-VolumesNegativeTest-2006341457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d105f34f6d42fc800517b33a30d2c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd657bfb46942d798e6972c64706a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:50:33.301139 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-bc0ec601-3d98-42a5-8fbc-80b7898f761f tempest-VolumesNegativeTest-2006341457 tempest-VolumesNegativeTest-2006341457-project] 10.222.0.66 "GET /compute/v2.1/servers/53aeb67e-f80f-400e-b28d-41c84292fe5b" status: 200 len: 1314 microversion: 2.1 time: 0.151221 Aug 04 03:50:33.301714 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 556/1108] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:50:33 2022] GET /compute/v2.1/servers/53aeb67e-f80f-400e-b28d-41c84292fe5b => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:50:34.322235 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-70d4329b-3470-4d0c-98c8-421989af4d64 tempest-VolumesNegativeTest-2006341457 tempest-VolumesNegativeTest-2006341457-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:50:34.322885 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-70d4329b-3470-4d0c-98c8-421989af4d64 tempest-VolumesNegativeTest-2006341457 tempest-VolumesNegativeTest-2006341457-project] [instance: 53aeb67e-f80f-400e-b28d-41c84292fe5b] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:50:34.329550 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-70d4329b-3470-4d0c-98c8-421989af4d64 tempest-VolumesNegativeTest-2006341457 tempest-VolumesNegativeTest-2006341457-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:50:34.329992 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-70d4329b-3470-4d0c-98c8-421989af4d64 tempest-VolumesNegativeTest-2006341457 tempest-VolumesNegativeTest-2006341457-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:50:34.330745 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-70d4329b-3470-4d0c-98c8-421989af4d64 tempest-VolumesNegativeTest-2006341457 tempest-VolumesNegativeTest-2006341457-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:50:34.331175 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-70d4329b-3470-4d0c-98c8-421989af4d64 tempest-VolumesNegativeTest-2006341457 tempest-VolumesNegativeTest-2006341457-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:50:34.463284 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-70d4329b-3470-4d0c-98c8-421989af4d64 tempest-VolumesNegativeTest-2006341457 tempest-VolumesNegativeTest-2006341457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d105f34f6d42fc800517b33a30d2c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd657bfb46942d798e6972c64706a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:50:34.470850 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-70d4329b-3470-4d0c-98c8-421989af4d64 tempest-VolumesNegativeTest-2006341457 tempest-VolumesNegativeTest-2006341457-project] 10.222.0.66 "GET /compute/v2.1/servers/53aeb67e-f80f-400e-b28d-41c84292fe5b" status: 200 len: 1463 microversion: 2.1 time: 0.152720 Aug 04 03:50:34.471766 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 553/1109] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:50:34 2022] GET /compute/v2.1/servers/53aeb67e-f80f-400e-b28d-41c84292fe5b => generated 1463 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:50:34.516399 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-1b34cb15-abce-4c6b-873e-3877d2f9443f tempest-VolumesNegativeTest-2006341457 tempest-VolumesNegativeTest-2006341457-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:50:34.516919 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-1b34cb15-abce-4c6b-873e-3877d2f9443f tempest-VolumesNegativeTest-2006341457 tempest-VolumesNegativeTest-2006341457-project] [instance: 53aeb67e-f80f-400e-b28d-41c84292fe5b] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:50:34.523496 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-1b34cb15-abce-4c6b-873e-3877d2f9443f tempest-VolumesNegativeTest-2006341457 tempest-VolumesNegativeTest-2006341457-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:50:34.523944 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-1b34cb15-abce-4c6b-873e-3877d2f9443f tempest-VolumesNegativeTest-2006341457 tempest-VolumesNegativeTest-2006341457-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:50:34.524695 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-1b34cb15-abce-4c6b-873e-3877d2f9443f tempest-VolumesNegativeTest-2006341457 tempest-VolumesNegativeTest-2006341457-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:50:34.525128 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-1b34cb15-abce-4c6b-873e-3877d2f9443f tempest-VolumesNegativeTest-2006341457 tempest-VolumesNegativeTest-2006341457-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:50:34.549755 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-1b34cb15-abce-4c6b-873e-3877d2f9443f tempest-VolumesNegativeTest-2006341457 tempest-VolumesNegativeTest-2006341457-project] [instance: 53aeb67e-f80f-400e-b28d-41c84292fe5b] Going to try to terminate instance {{(pid=130262) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 03:50:34.784917 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-1b34cb15-abce-4c6b-873e-3877d2f9443f tempest-VolumesNegativeTest-2006341457 tempest-VolumesNegativeTest-2006341457-project] 10.222.0.66 "DELETE /compute/v2.1/servers/53aeb67e-f80f-400e-b28d-41c84292fe5b" status: 204 len: 0 microversion: 2.1 time: 0.272084 Aug 04 03:50:34.785447 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 557/1110] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 03:50:34 2022] DELETE /compute/v2.1/servers/53aeb67e-f80f-400e-b28d-41c84292fe5b => generated 0 bytes in 274 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 03:50:34.794488 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-293c0725-0539-45fb-bcac-fe31e0210214 tempest-VolumesNegativeTest-2006341457 tempest-VolumesNegativeTest-2006341457-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:50:34.795098 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-293c0725-0539-45fb-bcac-fe31e0210214 tempest-VolumesNegativeTest-2006341457 tempest-VolumesNegativeTest-2006341457-project] [instance: 53aeb67e-f80f-400e-b28d-41c84292fe5b] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:50:34.801123 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-293c0725-0539-45fb-bcac-fe31e0210214 tempest-VolumesNegativeTest-2006341457 tempest-VolumesNegativeTest-2006341457-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:50:34.801609 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-293c0725-0539-45fb-bcac-fe31e0210214 tempest-VolumesNegativeTest-2006341457 tempest-VolumesNegativeTest-2006341457-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:50:34.802364 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-293c0725-0539-45fb-bcac-fe31e0210214 tempest-VolumesNegativeTest-2006341457 tempest-VolumesNegativeTest-2006341457-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:50:34.802802 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-293c0725-0539-45fb-bcac-fe31e0210214 tempest-VolumesNegativeTest-2006341457 tempest-VolumesNegativeTest-2006341457-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:50:34.936184 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-293c0725-0539-45fb-bcac-fe31e0210214 tempest-VolumesNegativeTest-2006341457 tempest-VolumesNegativeTest-2006341457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d105f34f6d42fc800517b33a30d2c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd657bfb46942d798e6972c64706a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:50:34.944021 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-293c0725-0539-45fb-bcac-fe31e0210214 tempest-VolumesNegativeTest-2006341457 tempest-VolumesNegativeTest-2006341457-project] 10.222.0.66 "GET /compute/v2.1/servers/53aeb67e-f80f-400e-b28d-41c84292fe5b" status: 200 len: 1469 microversion: 2.1 time: 0.153179 Aug 04 03:50:34.944622 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 554/1111] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:50:34 2022] GET /compute/v2.1/servers/53aeb67e-f80f-400e-b28d-41c84292fe5b => generated 1469 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:50:35.965124 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-7f8481cc-2f86-4edf-90e7-8fdccb3d6aa3 tempest-VolumesNegativeTest-2006341457 tempest-VolumesNegativeTest-2006341457-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:50:35.965846 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-7f8481cc-2f86-4edf-90e7-8fdccb3d6aa3 tempest-VolumesNegativeTest-2006341457 tempest-VolumesNegativeTest-2006341457-project] [instance: 53aeb67e-f80f-400e-b28d-41c84292fe5b] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:50:35.972290 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-7f8481cc-2f86-4edf-90e7-8fdccb3d6aa3 tempest-VolumesNegativeTest-2006341457 tempest-VolumesNegativeTest-2006341457-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:50:35.972762 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-7f8481cc-2f86-4edf-90e7-8fdccb3d6aa3 tempest-VolumesNegativeTest-2006341457 tempest-VolumesNegativeTest-2006341457-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:50:35.973558 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-7f8481cc-2f86-4edf-90e7-8fdccb3d6aa3 tempest-VolumesNegativeTest-2006341457 tempest-VolumesNegativeTest-2006341457-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:50:35.973991 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-7f8481cc-2f86-4edf-90e7-8fdccb3d6aa3 tempest-VolumesNegativeTest-2006341457 tempest-VolumesNegativeTest-2006341457-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:50:36.102561 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-7f8481cc-2f86-4edf-90e7-8fdccb3d6aa3 tempest-VolumesNegativeTest-2006341457 tempest-VolumesNegativeTest-2006341457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d105f34f6d42fc800517b33a30d2c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd657bfb46942d798e6972c64706a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:50:36.110255 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-7f8481cc-2f86-4edf-90e7-8fdccb3d6aa3 tempest-VolumesNegativeTest-2006341457 tempest-VolumesNegativeTest-2006341457-project] 10.222.0.66 "GET /compute/v2.1/servers/53aeb67e-f80f-400e-b28d-41c84292fe5b" status: 200 len: 1469 microversion: 2.1 time: 0.149427 Aug 04 03:50:36.110806 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 558/1112] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:50:35 2022] GET /compute/v2.1/servers/53aeb67e-f80f-400e-b28d-41c84292fe5b => generated 1469 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 03:50:36.948359 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [req-647571a6-5928-45dc-9a12-e3435c48fcbd req-3008e27c-8faf-4b7b-ab6e-9cd3b19857f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53aeb67e-f80f-400e-b28d-41c84292fe5b", "name": "network-vif-deleted", "tag": "9478f132-e4e5-4579-b848-18730ee7689b"}]} {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 03:50:36.953809 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG dbcounter [-] [130263] Writing DB stats nova_api:SELECT=44 {{(pid=130263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:50:36.959805 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [req-647571a6-5928-45dc-9a12-e3435c48fcbd req-3008e27c-8faf-4b7b-ab6e-9cd3b19857f6 service nova] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:50:36.961767 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [req-647571a6-5928-45dc-9a12-e3435c48fcbd req-3008e27c-8faf-4b7b-ab6e-9cd3b19857f6 service nova] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:50:36.971891 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.compute.server_external_events [req-647571a6-5928-45dc-9a12-e3435c48fcbd req-3008e27c-8faf-4b7b-ab6e-9cd3b19857f6 service nova] Creating event network-vif-deleted:9478f132-e4e5-4579-b848-18730ee7689b for instance 53aeb67e-f80f-400e-b28d-41c84292fe5b on hv-cinder-73306 Aug 04 03:50:36.977777 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [req-647571a6-5928-45dc-9a12-e3435c48fcbd req-3008e27c-8faf-4b7b-ab6e-9cd3b19857f6 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032989 Aug 04 03:50:36.978643 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 555/1113] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 03:50:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 03:50:37.131545 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-d41719d3-1963-44b0-b4b2-364fab25d341 tempest-VolumesNegativeTest-2006341457 tempest-VolumesNegativeTest-2006341457-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:50:37.137662 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-d41719d3-1963-44b0-b4b2-364fab25d341 tempest-VolumesNegativeTest-2006341457 tempest-VolumesNegativeTest-2006341457-project] [instance: 53aeb67e-f80f-400e-b28d-41c84292fe5b] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:50:37.138910 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-d41719d3-1963-44b0-b4b2-364fab25d341 tempest-VolumesNegativeTest-2006341457 tempest-VolumesNegativeTest-2006341457-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:50:37.139360 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-d41719d3-1963-44b0-b4b2-364fab25d341 tempest-VolumesNegativeTest-2006341457 tempest-VolumesNegativeTest-2006341457-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:50:37.140125 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-d41719d3-1963-44b0-b4b2-364fab25d341 tempest-VolumesNegativeTest-2006341457 tempest-VolumesNegativeTest-2006341457-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:50:37.140566 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-d41719d3-1963-44b0-b4b2-364fab25d341 tempest-VolumesNegativeTest-2006341457 tempest-VolumesNegativeTest-2006341457-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:50:37.209899 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-d41719d3-1963-44b0-b4b2-364fab25d341 tempest-VolumesNegativeTest-2006341457 tempest-VolumesNegativeTest-2006341457-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48d105f34f6d42fc800517b33a30d2c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1dd657bfb46942d798e6972c64706a4e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:50:37.217814 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-d41719d3-1963-44b0-b4b2-364fab25d341 tempest-VolumesNegativeTest-2006341457 tempest-VolumesNegativeTest-2006341457-project] 10.222.0.66 "GET /compute/v2.1/servers/53aeb67e-f80f-400e-b28d-41c84292fe5b" status: 200 len: 1299 microversion: 2.1 time: 0.090484 Aug 04 03:50:37.218389 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 559/1114] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:50:37 2022] GET /compute/v2.1/servers/53aeb67e-f80f-400e-b28d-41c84292fe5b => generated 1299 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:50:38.240070 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-5e7707db-8e68-4600-b597-78c917b860d2 tempest-VolumesNegativeTest-2006341457 tempest-VolumesNegativeTest-2006341457-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:50:38.240799 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-5e7707db-8e68-4600-b597-78c917b860d2 tempest-VolumesNegativeTest-2006341457 tempest-VolumesNegativeTest-2006341457-project] [instance: 53aeb67e-f80f-400e-b28d-41c84292fe5b] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:50:38.247574 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-5e7707db-8e68-4600-b597-78c917b860d2 tempest-VolumesNegativeTest-2006341457 tempest-VolumesNegativeTest-2006341457-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:50:38.248032 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-5e7707db-8e68-4600-b597-78c917b860d2 tempest-VolumesNegativeTest-2006341457 tempest-VolumesNegativeTest-2006341457-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:50:38.248797 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-5e7707db-8e68-4600-b597-78c917b860d2 tempest-VolumesNegativeTest-2006341457 tempest-VolumesNegativeTest-2006341457-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:50:38.249267 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-5e7707db-8e68-4600-b597-78c917b860d2 tempest-VolumesNegativeTest-2006341457 tempest-VolumesNegativeTest-2006341457-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:50:38.265670 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.wsgi [None req-5e7707db-8e68-4600-b597-78c917b860d2 tempest-VolumesNegativeTest-2006341457 tempest-VolumesNegativeTest-2006341457-project] HTTP exception thrown: Instance 53aeb67e-f80f-400e-b28d-41c84292fe5b could not be found. Aug 04 03:50:38.267309 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-5e7707db-8e68-4600-b597-78c917b860d2 tempest-VolumesNegativeTest-2006341457 tempest-VolumesNegativeTest-2006341457-project] Request method failure captured: Aug 04 03:50:38.267309 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: request: GET /compute/v2.1/servers/53aeb67e-f80f-400e-b28d-41c84292fe5b HTTP/1.1 Aug 04 03:50:38.267309 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Accept: application/json Aug 04 03:50:38.267309 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Accept-Encoding: identity Aug 04 03:50:38.267309 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Connection: close Aug 04 03:50:38.267309 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Content-Length: 0 Aug 04 03:50:38.267309 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Content-Type: application/json Aug 04 03:50:38.267309 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Host: 10.222.0.66 Aug 04 03:50:38.267309 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Openstack-System-Scope: None Aug 04 03:50:38.267309 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: User-Agent: python-urllib3/1.26.11 Aug 04 03:50:38.267309 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Auth-Token: gAAAAABi60H5tuRBpmSpPLO9x5wQPzduYtR6uqku7ypsG6qWMJ4fglBjdc2OjJ4JM5uP-WnbrQDxT8GNTihiTClXHy7Er38y3RRU0Ho9Pv9N6a7UpvYnQTKTLQE5JzdB6-IQV0RIvmUzfdy1ZDdfdHCMF1hnX9DaSh-AfjbKlfNwQ3ig__Iaz0s Aug 04 03:50:38.267309 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Domain-Id: None Aug 04 03:50:38.267309 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Domain-Name: None Aug 04 03:50:38.267309 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Identity-Status: Confirmed Aug 04 03:50:38.267309 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Is-Admin-Project: True Aug 04 03:50:38.267309 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Project-Domain-Id: default Aug 04 03:50:38.267309 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Project-Domain-Name: Default Aug 04 03:50:38.267309 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Project-Id: 1dd657bfb46942d798e6972c64706a4e Aug 04 03:50:38.267309 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Project-Name: tempest-VolumesNegativeTest-2006341457 Aug 04 03:50:38.267309 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Role: member,reader Aug 04 03:50:38.267309 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Roles: member,reader Aug 04 03:50:38.268757 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/1dd657bfb46942d798e6972c64706a4e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/1dd657bfb46942d798e6972c64706a4e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/1dd657bfb46942d798e6972c64706a4e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_1dd657bfb46942d798e6972c64706a4e"}]}] Aug 04 03:50:38.268757 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Tenant: tempest-VolumesNegativeTest-2006341457 Aug 04 03:50:38.268757 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Tenant-Id: 1dd657bfb46942d798e6972c64706a4e Aug 04 03:50:38.268757 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Tenant-Name: tempest-VolumesNegativeTest-2006341457 Aug 04 03:50:38.268757 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-User: tempest-VolumesNegativeTest-2006341457-project Aug 04 03:50:38.268757 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-User-Domain-Id: default Aug 04 03:50:38.268757 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-User-Domain-Name: Default Aug 04 03:50:38.268757 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-User-Id: 48d105f34f6d42fc800517b33a30d2c8 Aug 04 03:50:38.268757 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-User-Name: tempest-VolumesNegativeTest-2006341457-project Aug 04 03:50:38.268757 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: method: > Aug 04 03:50:38.268757 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: exception: Instance 53aeb67e-f80f-400e-b28d-41c84292fe5b could not be found. Aug 04 03:50:38.268757 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: action_args: {'id': '53aeb67e-f80f-400e-b28d-41c84292fe5b'} Aug 04 03:50:38.269690 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 03:50:38.269690 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 03:50:38.269690 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 03:50:38.269690 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 03:50:38.269690 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 03:50:38.269690 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 03:50:38.269690 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 03:50:38.269690 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 03:50:38.269690 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 03:50:38.269690 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 03:50:38.269690 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 53aeb67e-f80f-400e-b28d-41c84292fe5b could not be found. Aug 04 03:50:38.269690 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Aug 04 03:50:38.269690 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 03:50:38.269690 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Aug 04 03:50:38.269690 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 03:50:38.269690 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 03:50:38.269690 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 03:50:38.269690 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 03:50:38.269690 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 03:50:38.269690 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 03:50:38.271271 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 03:50:38.271271 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 03:50:38.271271 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 03:50:38.271271 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 03:50:38.271271 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 03:50:38.271271 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 03:50:38.271271 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 03:50:38.271271 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 53aeb67e-f80f-400e-b28d-41c84292fe5b could not be found. Aug 04 03:50:38.271271 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Aug 04 03:50:38.271271 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 03:50:38.271271 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Aug 04 03:50:38.271271 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 03:50:38.271271 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 03:50:38.271271 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 03:50:38.271271 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 03:50:38.271271 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 03:50:38.271271 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 53aeb67e-f80f-400e-b28d-41c84292fe5b could not be found. Aug 04 03:50:38.271271 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Aug 04 03:50:38.273698 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-5e7707db-8e68-4600-b597-78c917b860d2 tempest-VolumesNegativeTest-2006341457 tempest-VolumesNegativeTest-2006341457-project] Returning 404 to user: Instance 53aeb67e-f80f-400e-b28d-41c84292fe5b could not be found. {{(pid=130263) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 03:50:38.273698 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-5e7707db-8e68-4600-b597-78c917b860d2 tempest-VolumesNegativeTest-2006341457 tempest-VolumesNegativeTest-2006341457-project] 10.222.0.66 "GET /compute/v2.1/servers/53aeb67e-f80f-400e-b28d-41c84292fe5b" status: 404 len: 111 microversion: 2.1 time: 0.033365 Aug 04 03:50:38.273698 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 556/1115] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:50:38 2022] GET /compute/v2.1/servers/53aeb67e-f80f-400e-b28d-41c84292fe5b => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 03:51:10.139261 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-8e113b84-06f3-451f-89c1-e4dbe311e5e6 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:51:10.139824 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-8e113b84-06f3-451f-89c1-e4dbe311e5e6 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] [instance: edb69fe3-e255-4e54-8e08-fff8bbc28d4f] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:51:10.142049 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG dbcounter [-] [130262] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=130262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:51:10.142690 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG dbcounter [-] [130262] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:51:10.147629 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-8e113b84-06f3-451f-89c1-e4dbe311e5e6 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:51:10.148129 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-8e113b84-06f3-451f-89c1-e4dbe311e5e6 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:51:10.149626 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-8e113b84-06f3-451f-89c1-e4dbe311e5e6 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:51:10.151933 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-8e113b84-06f3-451f-89c1-e4dbe311e5e6 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:51:10.175469 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-8e113b84-06f3-451f-89c1-e4dbe311e5e6 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] 10.222.0.66 "GET /compute/v2.1/servers/edb69fe3-e255-4e54-8e08-fff8bbc28d4f/ips" status: 200 len: 149 microversion: 2.1 time: 0.040207 Aug 04 03:51:10.176030 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 560/1116] 10.222.0.66 () {58 vars in 1248 bytes} [Thu Aug 4 03:51:10 2022] GET /compute/v2.1/servers/edb69fe3-e255-4e54-8e08-fff8bbc28d4f/ips => generated 149 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 03:51:10.189106 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-ba1d1dfa-8c4e-478a-ae65-9e837e2f04cc tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "45e6b8e9-4b14-4d48-b367-90f347efc55e"}} {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 03:51:10.191472 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-ba1d1dfa-8c4e-478a-ae65-9e837e2f04cc tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] [instance: edb69fe3-e255-4e54-8e08-fff8bbc28d4f] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:51:10.193743 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG dbcounter [-] [130263] Writing DB stats nova_api:SELECT=3 {{(pid=130263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:51:10.194400 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG dbcounter [-] [130263] Writing DB stats nova_cell1:SELECT=31 {{(pid=130263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:51:10.199778 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-ba1d1dfa-8c4e-478a-ae65-9e837e2f04cc tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:51:10.200233 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-ba1d1dfa-8c4e-478a-ae65-9e837e2f04cc tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:51:10.201003 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-ba1d1dfa-8c4e-478a-ae65-9e837e2f04cc tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:51:10.201466 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-ba1d1dfa-8c4e-478a-ae65-9e837e2f04cc tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:51:10.283121 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.wsgi [None req-ba1d1dfa-8c4e-478a-ae65-9e837e2f04cc tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] HTTP exception thrown: Invalid volume: volume 45e6b8e9-4b14-4d48-b367-90f347efc55e is already attached to instances: 2ed39450-289e-4d51-b1b0-c5fe323e6201 Aug 04 03:51:10.284730 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-ba1d1dfa-8c4e-478a-ae65-9e837e2f04cc tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Request method failure captured: Aug 04 03:51:10.284730 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: request: POST /compute/v2.1/servers/edb69fe3-e255-4e54-8e08-fff8bbc28d4f/os-volume_attachments HTTP/1.1 Aug 04 03:51:10.284730 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Accept: application/json Aug 04 03:51:10.284730 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Accept-Encoding: identity Aug 04 03:51:10.284730 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Connection: close Aug 04 03:51:10.284730 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Content-Length: 74 Aug 04 03:51:10.284730 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Content-Type: application/json Aug 04 03:51:10.284730 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Host: 10.222.0.66 Aug 04 03:51:10.284730 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Openstack-System-Scope: None Aug 04 03:51:10.284730 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: User-Agent: python-urllib3/1.26.11 Aug 04 03:51:10.284730 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Auth-Token: gAAAAABi60EfWo3pxV-WJerz4CV7aLU5sNdQOAjcWGxLQyzzVpQzfisgkZYPF0-VvjdP-4fhqH1P-iVrAYypOKaXop8hglb2CP9bQQNfaUgJfvrw6-mu2g-Bmn1rv5G9df81SkEqY2jauM8WPz4gyORIa-0zWCQz6JGM7HOO6Cyykhfv5KFcQRY Aug 04 03:51:10.284730 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Domain-Id: None Aug 04 03:51:10.284730 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Domain-Name: None Aug 04 03:51:10.284730 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Identity-Status: Confirmed Aug 04 03:51:10.284730 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Is-Admin-Project: True Aug 04 03:51:10.284730 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Project-Domain-Id: default Aug 04 03:51:10.284730 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Project-Domain-Name: Default Aug 04 03:51:10.284730 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Project-Id: a98f18ee8c7d4cfe9f4b879505ca6605 Aug 04 03:51:10.284730 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Project-Name: tempest-AttachVolumeNegativeTest-1888469620 Aug 04 03:51:10.284730 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Role: member,reader Aug 04 03:51:10.284730 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Roles: member,reader Aug 04 03:51:10.286550 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/a98f18ee8c7d4cfe9f4b879505ca6605"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/a98f18ee8c7d4cfe9f4b879505ca6605"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/a98f18ee8c7d4cfe9f4b879505ca6605"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_a98f18ee8c7d4cfe9f4b879505ca6605"}]}] Aug 04 03:51:10.286550 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Tenant: tempest-AttachVolumeNegativeTest-1888469620 Aug 04 03:51:10.286550 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Tenant-Id: a98f18ee8c7d4cfe9f4b879505ca6605 Aug 04 03:51:10.286550 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1888469620 Aug 04 03:51:10.286550 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-User: tempest-AttachVolumeNegativeTest-1888469620-project Aug 04 03:51:10.286550 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-User-Domain-Id: default Aug 04 03:51:10.286550 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-User-Domain-Name: Default Aug 04 03:51:10.286550 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-User-Id: ac99f60384fe4a119d019cedfe1d3557 Aug 04 03:51:10.286550 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-User-Name: tempest-AttachVolumeNegativeTest-1888469620-project Aug 04 03:51:10.286550 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Aug 04 03:51:10.286550 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: {"volumeAttachment": {"volumeId": "45e6b8e9-4b14-4d48-b367-90f347efc55e"}} Aug 04 03:51:10.286550 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: method: > Aug 04 03:51:10.287679 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: exception: Invalid volume: volume 45e6b8e9-4b14-4d48-b367-90f347efc55e is already attached to instances: 2ed39450-289e-4d51-b1b0-c5fe323e6201 Aug 04 03:51:10.287679 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: action_args: {'server_id': 'edb69fe3-e255-4e54-8e08-fff8bbc28d4f', 'body': {'volumeAttachment': {'volumeId': '45e6b8e9-4b14-4d48-b367-90f347efc55e'}}} Aug 04 03:51:10.287679 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 03:51:10.287679 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 03:51:10.287679 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 04 03:51:10.287679 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 04 03:51:10.287679 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 04 03:51:10.287679 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 04 03:51:10.287679 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 04 03:51:10.287679 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 04 03:51:10.287679 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5066, in attach_volume Aug 04 03:51:10.287679 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 04 03:51:10.287679 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4906, in _check_volume_already_attached Aug 04 03:51:10.287679 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 04 03:51:10.287679 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 45e6b8e9-4b14-4d48-b367-90f347efc55e is already attached to instances: 2ed39450-289e-4d51-b1b0-c5fe323e6201 Aug 04 03:51:10.287679 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Aug 04 03:51:10.287679 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 03:51:10.287679 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Aug 04 03:51:10.287679 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 03:51:10.289770 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 03:51:10.289770 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 03:51:10.289770 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 03:51:10.289770 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 03:51:10.289770 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 03:51:10.289770 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 03:51:10.289770 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 03:51:10.289770 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 03:51:10.289770 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 03:51:10.289770 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 03:51:10.289770 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 03:51:10.289770 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 03:51:10.289770 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 04 03:51:10.289770 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 04 03:51:10.289770 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 45e6b8e9-4b14-4d48-b367-90f347efc55e is already attached to instances: 2ed39450-289e-4d51-b1b0-c5fe323e6201 Aug 04 03:51:10.289770 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Aug 04 03:51:10.289770 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 03:51:10.289770 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Aug 04 03:51:10.289770 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 03:51:10.289770 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 03:51:10.291333 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 03:51:10.291333 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 03:51:10.291333 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 03:51:10.291333 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 45e6b8e9-4b14-4d48-b367-90f347efc55e is already attached to instances: 2ed39450-289e-4d51-b1b0-c5fe323e6201 Aug 04 03:51:10.291333 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Aug 04 03:51:10.291333 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-ba1d1dfa-8c4e-478a-ae65-9e837e2f04cc tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Returning 400 to user: Invalid volume: volume 45e6b8e9-4b14-4d48-b367-90f347efc55e is already attached to instances: 2ed39450-289e-4d51-b1b0-c5fe323e6201 {{(pid=130263) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 03:51:10.291333 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-ba1d1dfa-8c4e-478a-ae65-9e837e2f04cc tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] 10.222.0.66 "POST /compute/v2.1/servers/edb69fe3-e255-4e54-8e08-fff8bbc28d4f/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.101391 Aug 04 03:51:10.291333 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 557/1117] 10.222.0.66 () {60 vars in 1323 bytes} [Thu Aug 4 03:51:10 2022] POST /compute/v2.1/servers/edb69fe3-e255-4e54-8e08-fff8bbc28d4f/os-volume_attachments => generated 174 bytes in 102 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 03:51:10.296038 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-cc56ff82-9e5f-4ab7-97f0-5a9e32746396 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:51:10.297863 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-cc56ff82-9e5f-4ab7-97f0-5a9e32746396 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] [instance: edb69fe3-e255-4e54-8e08-fff8bbc28d4f] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:51:10.303683 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-cc56ff82-9e5f-4ab7-97f0-5a9e32746396 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:51:10.304133 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-cc56ff82-9e5f-4ab7-97f0-5a9e32746396 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:51:10.305699 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-cc56ff82-9e5f-4ab7-97f0-5a9e32746396 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:51:10.305985 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-cc56ff82-9e5f-4ab7-97f0-5a9e32746396 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:51:10.330560 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-cc56ff82-9e5f-4ab7-97f0-5a9e32746396 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] [instance: edb69fe3-e255-4e54-8e08-fff8bbc28d4f] Going to try to terminate instance {{(pid=130262) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 03:51:10.652268 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-cc56ff82-9e5f-4ab7-97f0-5a9e32746396 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] 10.222.0.66 "DELETE /compute/v2.1/servers/edb69fe3-e255-4e54-8e08-fff8bbc28d4f" status: 204 len: 0 microversion: 2.1 time: 0.360328 Aug 04 03:51:10.652954 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 561/1118] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 03:51:10 2022] DELETE /compute/v2.1/servers/edb69fe3-e255-4e54-8e08-fff8bbc28d4f => generated 0 bytes in 362 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 03:51:10.666029 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-2a120520-14ac-4180-a527-71845e18f823 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:51:10.666029 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-2a120520-14ac-4180-a527-71845e18f823 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] [instance: edb69fe3-e255-4e54-8e08-fff8bbc28d4f] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:51:10.669659 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-2a120520-14ac-4180-a527-71845e18f823 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:51:10.670175 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-2a120520-14ac-4180-a527-71845e18f823 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:51:10.671008 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-2a120520-14ac-4180-a527-71845e18f823 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:51:10.671532 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-2a120520-14ac-4180-a527-71845e18f823 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:51:10.854314 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-2a120520-14ac-4180-a527-71845e18f823 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac99f60384fe4a119d019cedfe1d3557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f18ee8c7d4cfe9f4b879505ca6605', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:51:10.861815 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-2a120520-14ac-4180-a527-71845e18f823 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] 10.222.0.66 "GET /compute/v2.1/servers/edb69fe3-e255-4e54-8e08-fff8bbc28d4f" status: 200 len: 1682 microversion: 2.1 time: 0.204573 Aug 04 03:51:10.862371 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 558/1119] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:51:10 2022] GET /compute/v2.1/servers/edb69fe3-e255-4e54-8e08-fff8bbc28d4f => generated 1682 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 03:51:11.883427 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-43089fa0-0ecd-46e6-8118-4298c0c11906 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:51:11.884145 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-43089fa0-0ecd-46e6-8118-4298c0c11906 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] [instance: edb69fe3-e255-4e54-8e08-fff8bbc28d4f] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:51:11.890716 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-43089fa0-0ecd-46e6-8118-4298c0c11906 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:51:11.891165 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-43089fa0-0ecd-46e6-8118-4298c0c11906 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:51:11.891927 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-43089fa0-0ecd-46e6-8118-4298c0c11906 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:51:11.892362 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-43089fa0-0ecd-46e6-8118-4298c0c11906 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:51:12.025266 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-43089fa0-0ecd-46e6-8118-4298c0c11906 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac99f60384fe4a119d019cedfe1d3557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f18ee8c7d4cfe9f4b879505ca6605', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:51:12.032752 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-43089fa0-0ecd-46e6-8118-4298c0c11906 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] 10.222.0.66 "GET /compute/v2.1/servers/edb69fe3-e255-4e54-8e08-fff8bbc28d4f" status: 200 len: 1682 microversion: 2.1 time: 0.153583 Aug 04 03:51:12.033325 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 562/1120] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:51:11 2022] GET /compute/v2.1/servers/edb69fe3-e255-4e54-8e08-fff8bbc28d4f => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:51:13.054430 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-733bbdb2-e1eb-40ab-98ac-e49ca3b2549d tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:51:13.055130 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-733bbdb2-e1eb-40ab-98ac-e49ca3b2549d tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] [instance: edb69fe3-e255-4e54-8e08-fff8bbc28d4f] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:51:13.061971 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-733bbdb2-e1eb-40ab-98ac-e49ca3b2549d tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:51:13.062496 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-733bbdb2-e1eb-40ab-98ac-e49ca3b2549d tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:51:13.063332 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-733bbdb2-e1eb-40ab-98ac-e49ca3b2549d tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:51:13.063773 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-733bbdb2-e1eb-40ab-98ac-e49ca3b2549d tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:51:13.196701 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-733bbdb2-e1eb-40ab-98ac-e49ca3b2549d tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac99f60384fe4a119d019cedfe1d3557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f18ee8c7d4cfe9f4b879505ca6605', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:51:13.205381 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-733bbdb2-e1eb-40ab-98ac-e49ca3b2549d tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] 10.222.0.66 "GET /compute/v2.1/servers/edb69fe3-e255-4e54-8e08-fff8bbc28d4f" status: 200 len: 1682 microversion: 2.1 time: 0.154761 Aug 04 03:51:13.210728 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 559/1121] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:51:13 2022] GET /compute/v2.1/servers/edb69fe3-e255-4e54-8e08-fff8bbc28d4f => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:51:13.506351 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [req-d743fa30-6ea4-4962-b49e-9ad08dba204f req-2eb781d8-0f14-4b2e-8241-6baa132184e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "edb69fe3-e255-4e54-8e08-fff8bbc28d4f", "name": "network-vif-deleted", "tag": "c25e6478-642e-4e0b-ac56-ae850b56d17a"}]} {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 03:51:13.517304 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [req-d743fa30-6ea4-4962-b49e-9ad08dba204f req-2eb781d8-0f14-4b2e-8241-6baa132184e4 service nova] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:51:13.517760 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [req-d743fa30-6ea4-4962-b49e-9ad08dba204f req-2eb781d8-0f14-4b2e-8241-6baa132184e4 service nova] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:51:13.529183 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.compute.server_external_events [req-d743fa30-6ea4-4962-b49e-9ad08dba204f req-2eb781d8-0f14-4b2e-8241-6baa132184e4 service nova] Creating event network-vif-deleted:c25e6478-642e-4e0b-ac56-ae850b56d17a for instance edb69fe3-e255-4e54-8e08-fff8bbc28d4f on hv-cinder-73306 Aug 04 03:51:13.534462 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [req-d743fa30-6ea4-4962-b49e-9ad08dba204f req-2eb781d8-0f14-4b2e-8241-6baa132184e4 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031970 Aug 04 03:51:13.535052 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 563/1122] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 03:51:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 03:51:14.227374 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-3d2aacb9-fbb5-4eb0-ab22-dc1c63333892 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:51:14.228792 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-3d2aacb9-fbb5-4eb0-ab22-dc1c63333892 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] [instance: edb69fe3-e255-4e54-8e08-fff8bbc28d4f] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:51:14.235900 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-3d2aacb9-fbb5-4eb0-ab22-dc1c63333892 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:51:14.236347 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-3d2aacb9-fbb5-4eb0-ab22-dc1c63333892 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:51:14.237110 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-3d2aacb9-fbb5-4eb0-ab22-dc1c63333892 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:51:14.237596 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-3d2aacb9-fbb5-4eb0-ab22-dc1c63333892 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:51:14.269797 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-3d2aacb9-fbb5-4eb0-ab22-dc1c63333892 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:51:14.270255 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-3d2aacb9-fbb5-4eb0-ab22-dc1c63333892 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:51:14.270686 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.objects.instance [None req-3d2aacb9-fbb5-4eb0-ab22-dc1c63333892 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lazy-loading 'fault' on Instance uuid edb69fe3-e255-4e54-8e08-fff8bbc28d4f {{(pid=130263) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 03:51:14.314276 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-3d2aacb9-fbb5-4eb0-ab22-dc1c63333892 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac99f60384fe4a119d019cedfe1d3557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f18ee8c7d4cfe9f4b879505ca6605', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:51:14.322488 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-3d2aacb9-fbb5-4eb0-ab22-dc1c63333892 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] 10.222.0.66 "GET /compute/v2.1/servers/edb69fe3-e255-4e54-8e08-fff8bbc28d4f" status: 200 len: 1332 microversion: 2.1 time: 0.098917 Aug 04 03:51:14.323072 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 560/1123] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:51:14 2022] GET /compute/v2.1/servers/edb69fe3-e255-4e54-8e08-fff8bbc28d4f => generated 1332 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:51:15.346601 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-f6221292-bcc3-4804-babd-6bcfc0ac55b0 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:51:15.347301 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-f6221292-bcc3-4804-babd-6bcfc0ac55b0 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] [instance: edb69fe3-e255-4e54-8e08-fff8bbc28d4f] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:51:15.354850 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-f6221292-bcc3-4804-babd-6bcfc0ac55b0 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:51:15.355296 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-f6221292-bcc3-4804-babd-6bcfc0ac55b0 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:51:15.356048 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-f6221292-bcc3-4804-babd-6bcfc0ac55b0 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:51:15.356483 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-f6221292-bcc3-4804-babd-6bcfc0ac55b0 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:51:15.369552 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.wsgi [None req-f6221292-bcc3-4804-babd-6bcfc0ac55b0 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] HTTP exception thrown: Instance edb69fe3-e255-4e54-8e08-fff8bbc28d4f could not be found. Aug 04 03:51:15.371148 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-f6221292-bcc3-4804-babd-6bcfc0ac55b0 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Request method failure captured: Aug 04 03:51:15.371148 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: request: GET /compute/v2.1/servers/edb69fe3-e255-4e54-8e08-fff8bbc28d4f HTTP/1.1 Aug 04 03:51:15.371148 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: Accept: application/json Aug 04 03:51:15.371148 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: Accept-Encoding: identity Aug 04 03:51:15.371148 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: Connection: close Aug 04 03:51:15.371148 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: Content-Length: 0 Aug 04 03:51:15.371148 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: Content-Type: application/json Aug 04 03:51:15.371148 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: Host: 10.222.0.66 Aug 04 03:51:15.371148 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: Openstack-System-Scope: None Aug 04 03:51:15.371148 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: User-Agent: python-urllib3/1.26.11 Aug 04 03:51:15.371148 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Auth-Token: gAAAAABi60EfWo3pxV-WJerz4CV7aLU5sNdQOAjcWGxLQyzzVpQzfisgkZYPF0-VvjdP-4fhqH1P-iVrAYypOKaXop8hglb2CP9bQQNfaUgJfvrw6-mu2g-Bmn1rv5G9df81SkEqY2jauM8WPz4gyORIa-0zWCQz6JGM7HOO6Cyykhfv5KFcQRY Aug 04 03:51:15.371148 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Domain-Id: None Aug 04 03:51:15.371148 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Domain-Name: None Aug 04 03:51:15.371148 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Identity-Status: Confirmed Aug 04 03:51:15.371148 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Is-Admin-Project: True Aug 04 03:51:15.371148 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Project-Domain-Id: default Aug 04 03:51:15.371148 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Project-Domain-Name: Default Aug 04 03:51:15.371148 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Project-Id: a98f18ee8c7d4cfe9f4b879505ca6605 Aug 04 03:51:15.371148 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Project-Name: tempest-AttachVolumeNegativeTest-1888469620 Aug 04 03:51:15.371148 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Role: member,reader Aug 04 03:51:15.371148 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Roles: member,reader Aug 04 03:51:15.372633 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/a98f18ee8c7d4cfe9f4b879505ca6605"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/a98f18ee8c7d4cfe9f4b879505ca6605"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/a98f18ee8c7d4cfe9f4b879505ca6605"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_a98f18ee8c7d4cfe9f4b879505ca6605"}]}] Aug 04 03:51:15.372633 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Tenant: tempest-AttachVolumeNegativeTest-1888469620 Aug 04 03:51:15.372633 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Tenant-Id: a98f18ee8c7d4cfe9f4b879505ca6605 Aug 04 03:51:15.372633 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1888469620 Aug 04 03:51:15.372633 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-User: tempest-AttachVolumeNegativeTest-1888469620-project Aug 04 03:51:15.372633 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-User-Domain-Id: default Aug 04 03:51:15.372633 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-User-Domain-Name: Default Aug 04 03:51:15.372633 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-User-Id: ac99f60384fe4a119d019cedfe1d3557 Aug 04 03:51:15.372633 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-User-Name: tempest-AttachVolumeNegativeTest-1888469620-project Aug 04 03:51:15.372633 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: method: > Aug 04 03:51:15.372633 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: exception: Instance edb69fe3-e255-4e54-8e08-fff8bbc28d4f could not be found. Aug 04 03:51:15.372633 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: action_args: {'id': 'edb69fe3-e255-4e54-8e08-fff8bbc28d4f'} Aug 04 03:51:15.373478 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 03:51:15.373478 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 03:51:15.373478 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 03:51:15.373478 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 03:51:15.373478 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 03:51:15.373478 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 03:51:15.373478 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 03:51:15.373478 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 03:51:15.373478 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 03:51:15.373478 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 03:51:15.373478 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance edb69fe3-e255-4e54-8e08-fff8bbc28d4f could not be found. Aug 04 03:51:15.373478 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi Aug 04 03:51:15.373478 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 03:51:15.373478 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi Aug 04 03:51:15.373478 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 03:51:15.373478 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 03:51:15.373478 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 03:51:15.373478 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 03:51:15.373478 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 03:51:15.373478 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 03:51:15.374981 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 03:51:15.374981 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 03:51:15.374981 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 03:51:15.374981 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 03:51:15.374981 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 03:51:15.374981 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 03:51:15.374981 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 03:51:15.374981 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance edb69fe3-e255-4e54-8e08-fff8bbc28d4f could not be found. Aug 04 03:51:15.374981 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi Aug 04 03:51:15.374981 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 03:51:15.374981 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi Aug 04 03:51:15.374981 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 03:51:15.374981 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 03:51:15.374981 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 03:51:15.374981 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 03:51:15.374981 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 03:51:15.374981 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance edb69fe3-e255-4e54-8e08-fff8bbc28d4f could not be found. Aug 04 03:51:15.374981 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi Aug 04 03:51:15.376295 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-f6221292-bcc3-4804-babd-6bcfc0ac55b0 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Returning 404 to user: Instance edb69fe3-e255-4e54-8e08-fff8bbc28d4f could not be found. {{(pid=130262) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 03:51:15.376295 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-f6221292-bcc3-4804-babd-6bcfc0ac55b0 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] 10.222.0.66 "GET /compute/v2.1/servers/edb69fe3-e255-4e54-8e08-fff8bbc28d4f" status: 404 len: 111 microversion: 2.1 time: 0.030211 Aug 04 03:51:15.376295 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 564/1124] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:51:15 2022] GET /compute/v2.1/servers/edb69fe3-e255-4e54-8e08-fff8bbc28d4f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 03:51:15.381520 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-9dfc5a82-7bac-4e53-ad9b-fed430888ea6 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Calling method '.version_select at 0x7f72e8138940>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:51:15.498917 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-9dfc5a82-7bac-4e53-ad9b-fed430888ea6 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2099035121" status: 202 len: 0 microversion: 2.1 time: 0.121125 Aug 04 03:51:15.499429 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 561/1125] 10.222.0.66 () {58 vars in 1221 bytes} [Thu Aug 4 03:51:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2099035121 => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 03:51:16.280725 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-f1a1a8fd-09a6-4581-8847-6a695fad56a3 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:51:16.281393 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-f1a1a8fd-09a6-4581-8847-6a695fad56a3 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] [instance: 2ed39450-289e-4d51-b1b0-c5fe323e6201] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:51:16.287587 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-f1a1a8fd-09a6-4581-8847-6a695fad56a3 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:51:16.288043 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-f1a1a8fd-09a6-4581-8847-6a695fad56a3 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:51:16.288812 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-f1a1a8fd-09a6-4581-8847-6a695fad56a3 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:51:16.289339 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-f1a1a8fd-09a6-4581-8847-6a695fad56a3 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:51:16.371228 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.objects.instance [None req-f1a1a8fd-09a6-4581-8847-6a695fad56a3 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lazy-loading 'services' on Instance uuid 2ed39450-289e-4d51-b1b0-c5fe323e6201 {{(pid=130262) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 03:51:16.604843 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-f1a1a8fd-09a6-4581-8847-6a695fad56a3 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] 10.222.0.66 "DELETE /compute/v2.1/servers/2ed39450-289e-4d51-b1b0-c5fe323e6201/os-volume_attachments/45e6b8e9-4b14-4d48-b367-90f347efc55e" status: 202 len: 0 microversion: 2.1 time: 0.327924 Aug 04 03:51:16.605651 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 565/1126] 10.222.0.66 () {58 vars in 1416 bytes} [Thu Aug 4 03:51:16 2022] DELETE /compute/v2.1/servers/2ed39450-289e-4d51-b1b0-c5fe323e6201/os-volume_attachments/45e6b8e9-4b14-4d48-b367-90f347efc55e => generated 0 bytes in 330 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 03:51:16.615714 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-12253eb5-3314-4c9d-beca-d00a68138a18 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:51:16.618463 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-12253eb5-3314-4c9d-beca-d00a68138a18 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] [instance: 2ed39450-289e-4d51-b1b0-c5fe323e6201] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:51:16.625501 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-12253eb5-3314-4c9d-beca-d00a68138a18 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:51:16.625887 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-12253eb5-3314-4c9d-beca-d00a68138a18 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:51:16.626651 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-12253eb5-3314-4c9d-beca-d00a68138a18 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:51:16.627084 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-12253eb5-3314-4c9d-beca-d00a68138a18 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:51:16.656097 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-12253eb5-3314-4c9d-beca-d00a68138a18 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] 10.222.0.66 "GET /compute/v2.1/servers/2ed39450-289e-4d51-b1b0-c5fe323e6201/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045858 Aug 04 03:51:16.656652 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 562/1127] 10.222.0.66 () {58 vars in 1302 bytes} [Thu Aug 4 03:51:16 2022] GET /compute/v2.1/servers/2ed39450-289e-4d51-b1b0-c5fe323e6201/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 03:51:17.669163 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-b9de571c-1215-470a-b63e-9ad845b7639c tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:51:17.671603 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-b9de571c-1215-470a-b63e-9ad845b7639c tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] [instance: 2ed39450-289e-4d51-b1b0-c5fe323e6201] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:51:17.678623 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-b9de571c-1215-470a-b63e-9ad845b7639c tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:51:17.679063 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-b9de571c-1215-470a-b63e-9ad845b7639c tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:51:17.679837 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-b9de571c-1215-470a-b63e-9ad845b7639c tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:51:17.680866 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-b9de571c-1215-470a-b63e-9ad845b7639c tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:51:17.711302 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-b9de571c-1215-470a-b63e-9ad845b7639c tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] 10.222.0.66 "GET /compute/v2.1/servers/2ed39450-289e-4d51-b1b0-c5fe323e6201/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046952 Aug 04 03:51:17.711901 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 566/1128] 10.222.0.66 () {58 vars in 1302 bytes} [Thu Aug 4 03:51:17 2022] GET /compute/v2.1/servers/2ed39450-289e-4d51-b1b0-c5fe323e6201/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 03:51:18.723224 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-c660ab89-fe51-4cc2-863d-741c2336e4ea tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:51:18.725436 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-c660ab89-fe51-4cc2-863d-741c2336e4ea tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] [instance: 2ed39450-289e-4d51-b1b0-c5fe323e6201] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:51:18.732841 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-c660ab89-fe51-4cc2-863d-741c2336e4ea tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:51:18.733331 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-c660ab89-fe51-4cc2-863d-741c2336e4ea tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:51:18.734106 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-c660ab89-fe51-4cc2-863d-741c2336e4ea tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:51:18.734551 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-c660ab89-fe51-4cc2-863d-741c2336e4ea tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:51:18.762850 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-c660ab89-fe51-4cc2-863d-741c2336e4ea tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] 10.222.0.66 "GET /compute/v2.1/servers/2ed39450-289e-4d51-b1b0-c5fe323e6201/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043678 Aug 04 03:51:18.763399 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 563/1129] 10.222.0.66 () {58 vars in 1302 bytes} [Thu Aug 4 03:51:18 2022] GET /compute/v2.1/servers/2ed39450-289e-4d51-b1b0-c5fe323e6201/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 03:51:18.824230 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-5ec9237f-6711-4a5e-9f89-7b9e9a8ed3e5 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:51:18.824745 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-5ec9237f-6711-4a5e-9f89-7b9e9a8ed3e5 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] [instance: 2ed39450-289e-4d51-b1b0-c5fe323e6201] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:51:18.831171 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-5ec9237f-6711-4a5e-9f89-7b9e9a8ed3e5 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:51:18.831617 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-5ec9237f-6711-4a5e-9f89-7b9e9a8ed3e5 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:51:18.832374 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-5ec9237f-6711-4a5e-9f89-7b9e9a8ed3e5 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:51:18.832810 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-5ec9237f-6711-4a5e-9f89-7b9e9a8ed3e5 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:51:18.858886 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-5ec9237f-6711-4a5e-9f89-7b9e9a8ed3e5 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] [instance: 2ed39450-289e-4d51-b1b0-c5fe323e6201] Going to try to terminate instance {{(pid=130262) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 03:51:19.161564 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-5ec9237f-6711-4a5e-9f89-7b9e9a8ed3e5 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] 10.222.0.66 "DELETE /compute/v2.1/servers/2ed39450-289e-4d51-b1b0-c5fe323e6201" status: 204 len: 0 microversion: 2.1 time: 0.340322 Aug 04 03:51:19.162198 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 567/1130] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 03:51:18 2022] DELETE /compute/v2.1/servers/2ed39450-289e-4d51-b1b0-c5fe323e6201 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 03:51:19.171193 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-496eeb56-9eef-40a2-b0a7-7fc36ad8b626 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:51:19.171818 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-496eeb56-9eef-40a2-b0a7-7fc36ad8b626 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] [instance: 2ed39450-289e-4d51-b1b0-c5fe323e6201] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:51:19.178309 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-496eeb56-9eef-40a2-b0a7-7fc36ad8b626 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:51:19.178763 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-496eeb56-9eef-40a2-b0a7-7fc36ad8b626 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:51:19.179523 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-496eeb56-9eef-40a2-b0a7-7fc36ad8b626 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:51:19.179960 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-496eeb56-9eef-40a2-b0a7-7fc36ad8b626 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:51:19.314284 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-496eeb56-9eef-40a2-b0a7-7fc36ad8b626 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac99f60384fe4a119d019cedfe1d3557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f18ee8c7d4cfe9f4b879505ca6605', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:51:19.322373 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-496eeb56-9eef-40a2-b0a7-7fc36ad8b626 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] 10.222.0.66 "GET /compute/v2.1/servers/2ed39450-289e-4d51-b1b0-c5fe323e6201" status: 200 len: 1682 microversion: 2.1 time: 0.155146 Aug 04 03:51:19.322870 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 564/1131] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:51:19 2022] GET /compute/v2.1/servers/2ed39450-289e-4d51-b1b0-c5fe323e6201 => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:51:20.344099 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-fbe1964f-9cce-40e9-a4c5-f2493db4f080 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:51:20.344791 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-fbe1964f-9cce-40e9-a4c5-f2493db4f080 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] [instance: 2ed39450-289e-4d51-b1b0-c5fe323e6201] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:51:20.351330 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-fbe1964f-9cce-40e9-a4c5-f2493db4f080 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:51:20.351775 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-fbe1964f-9cce-40e9-a4c5-f2493db4f080 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:51:20.353688 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-fbe1964f-9cce-40e9-a4c5-f2493db4f080 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:51:20.354265 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-fbe1964f-9cce-40e9-a4c5-f2493db4f080 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:51:20.485364 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-fbe1964f-9cce-40e9-a4c5-f2493db4f080 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac99f60384fe4a119d019cedfe1d3557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f18ee8c7d4cfe9f4b879505ca6605', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:51:20.492989 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-fbe1964f-9cce-40e9-a4c5-f2493db4f080 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] 10.222.0.66 "GET /compute/v2.1/servers/2ed39450-289e-4d51-b1b0-c5fe323e6201" status: 200 len: 1682 microversion: 2.1 time: 0.152984 Aug 04 03:51:20.493586 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 568/1132] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:51:20 2022] GET /compute/v2.1/servers/2ed39450-289e-4d51-b1b0-c5fe323e6201 => generated 1682 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:51:21.514377 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-4049498d-1fc3-4488-a027-68aebac9cfcf tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:51:21.515037 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-4049498d-1fc3-4488-a027-68aebac9cfcf tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] [instance: 2ed39450-289e-4d51-b1b0-c5fe323e6201] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:51:21.521758 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-4049498d-1fc3-4488-a027-68aebac9cfcf tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:51:21.522210 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-4049498d-1fc3-4488-a027-68aebac9cfcf tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:51:21.522970 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-4049498d-1fc3-4488-a027-68aebac9cfcf tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:51:21.523401 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-4049498d-1fc3-4488-a027-68aebac9cfcf tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:51:21.659612 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-4049498d-1fc3-4488-a027-68aebac9cfcf tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac99f60384fe4a119d019cedfe1d3557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f18ee8c7d4cfe9f4b879505ca6605', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:51:21.668225 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-4049498d-1fc3-4488-a027-68aebac9cfcf tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] 10.222.0.66 "GET /compute/v2.1/servers/2ed39450-289e-4d51-b1b0-c5fe323e6201" status: 200 len: 1682 microversion: 2.1 time: 0.157771 Aug 04 03:51:21.668829 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 565/1133] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:51:21 2022] GET /compute/v2.1/servers/2ed39450-289e-4d51-b1b0-c5fe323e6201 => generated 1682 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 03:51:22.416943 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [req-71c5bb56-785d-48fa-9738-f898469a7ac1 req-314ca388-2eab-491a-a723-2bd6cdae4025 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ed39450-289e-4d51-b1b0-c5fe323e6201", "name": "network-vif-deleted", "tag": "50488897-66f7-41a7-9f38-95ae861c95b6"}]} {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 03:51:22.426862 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [req-71c5bb56-785d-48fa-9738-f898469a7ac1 req-314ca388-2eab-491a-a723-2bd6cdae4025 service nova] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:51:22.427311 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [req-71c5bb56-785d-48fa-9738-f898469a7ac1 req-314ca388-2eab-491a-a723-2bd6cdae4025 service nova] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:51:22.438484 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.compute.server_external_events [req-71c5bb56-785d-48fa-9738-f898469a7ac1 req-314ca388-2eab-491a-a723-2bd6cdae4025 service nova] Creating event network-vif-deleted:50488897-66f7-41a7-9f38-95ae861c95b6 for instance 2ed39450-289e-4d51-b1b0-c5fe323e6201 on hv-cinder-73306 Aug 04 03:51:22.443451 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [req-71c5bb56-785d-48fa-9738-f898469a7ac1 req-314ca388-2eab-491a-a723-2bd6cdae4025 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.384010 Aug 04 03:51:22.447901 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 569/1134] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 03:51:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 03:51:22.689100 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-e4d815ab-07da-4ffc-b3c5-a0b0279dec7c tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:51:22.690279 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-e4d815ab-07da-4ffc-b3c5-a0b0279dec7c tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] [instance: 2ed39450-289e-4d51-b1b0-c5fe323e6201] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:51:22.696774 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-e4d815ab-07da-4ffc-b3c5-a0b0279dec7c tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:51:22.699840 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-e4d815ab-07da-4ffc-b3c5-a0b0279dec7c tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:51:22.699840 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-e4d815ab-07da-4ffc-b3c5-a0b0279dec7c tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:51:22.699840 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-e4d815ab-07da-4ffc-b3c5-a0b0279dec7c tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:51:22.732729 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-e4d815ab-07da-4ffc-b3c5-a0b0279dec7c tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:51:22.733170 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-e4d815ab-07da-4ffc-b3c5-a0b0279dec7c tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:51:22.733647 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.objects.instance [None req-e4d815ab-07da-4ffc-b3c5-a0b0279dec7c tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lazy-loading 'fault' on Instance uuid 2ed39450-289e-4d51-b1b0-c5fe323e6201 {{(pid=130263) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 03:51:22.776259 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-e4d815ab-07da-4ffc-b3c5-a0b0279dec7c tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac99f60384fe4a119d019cedfe1d3557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f18ee8c7d4cfe9f4b879505ca6605', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:51:22.784026 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-e4d815ab-07da-4ffc-b3c5-a0b0279dec7c tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] 10.222.0.66 "GET /compute/v2.1/servers/2ed39450-289e-4d51-b1b0-c5fe323e6201" status: 200 len: 1331 microversion: 2.1 time: 0.098831 Aug 04 03:51:22.784602 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 566/1135] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:51:22 2022] GET /compute/v2.1/servers/2ed39450-289e-4d51-b1b0-c5fe323e6201 => generated 1331 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:51:23.808717 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-1bbeee8e-2214-4774-8939-ded009662ba3 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:51:23.809454 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-1bbeee8e-2214-4774-8939-ded009662ba3 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] [instance: 2ed39450-289e-4d51-b1b0-c5fe323e6201] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:51:23.815610 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-1bbeee8e-2214-4774-8939-ded009662ba3 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:51:23.816054 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-1bbeee8e-2214-4774-8939-ded009662ba3 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:51:23.816803 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-1bbeee8e-2214-4774-8939-ded009662ba3 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:51:23.817257 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-1bbeee8e-2214-4774-8939-ded009662ba3 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:51:23.830652 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.wsgi [None req-1bbeee8e-2214-4774-8939-ded009662ba3 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] HTTP exception thrown: Instance 2ed39450-289e-4d51-b1b0-c5fe323e6201 could not be found. Aug 04 03:51:23.832249 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-1bbeee8e-2214-4774-8939-ded009662ba3 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Request method failure captured: Aug 04 03:51:23.832249 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: request: GET /compute/v2.1/servers/2ed39450-289e-4d51-b1b0-c5fe323e6201 HTTP/1.1 Aug 04 03:51:23.832249 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: Accept: application/json Aug 04 03:51:23.832249 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: Accept-Encoding: identity Aug 04 03:51:23.832249 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: Connection: close Aug 04 03:51:23.832249 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: Content-Length: 0 Aug 04 03:51:23.832249 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: Content-Type: application/json Aug 04 03:51:23.832249 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: Host: 10.222.0.66 Aug 04 03:51:23.832249 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: Openstack-System-Scope: None Aug 04 03:51:23.832249 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: User-Agent: python-urllib3/1.26.11 Aug 04 03:51:23.832249 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Auth-Token: gAAAAABi60EfWo3pxV-WJerz4CV7aLU5sNdQOAjcWGxLQyzzVpQzfisgkZYPF0-VvjdP-4fhqH1P-iVrAYypOKaXop8hglb2CP9bQQNfaUgJfvrw6-mu2g-Bmn1rv5G9df81SkEqY2jauM8WPz4gyORIa-0zWCQz6JGM7HOO6Cyykhfv5KFcQRY Aug 04 03:51:23.832249 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Domain-Id: None Aug 04 03:51:23.832249 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Domain-Name: None Aug 04 03:51:23.832249 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Identity-Status: Confirmed Aug 04 03:51:23.832249 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Is-Admin-Project: True Aug 04 03:51:23.832249 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Project-Domain-Id: default Aug 04 03:51:23.832249 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Project-Domain-Name: Default Aug 04 03:51:23.832249 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Project-Id: a98f18ee8c7d4cfe9f4b879505ca6605 Aug 04 03:51:23.832249 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Project-Name: tempest-AttachVolumeNegativeTest-1888469620 Aug 04 03:51:23.832249 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Role: member,reader Aug 04 03:51:23.832249 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Roles: member,reader Aug 04 03:51:23.833836 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/a98f18ee8c7d4cfe9f4b879505ca6605"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/a98f18ee8c7d4cfe9f4b879505ca6605"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/a98f18ee8c7d4cfe9f4b879505ca6605"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_a98f18ee8c7d4cfe9f4b879505ca6605"}]}] Aug 04 03:51:23.833836 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Tenant: tempest-AttachVolumeNegativeTest-1888469620 Aug 04 03:51:23.833836 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Tenant-Id: a98f18ee8c7d4cfe9f4b879505ca6605 Aug 04 03:51:23.833836 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1888469620 Aug 04 03:51:23.833836 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-User: tempest-AttachVolumeNegativeTest-1888469620-project Aug 04 03:51:23.833836 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-User-Domain-Id: default Aug 04 03:51:23.833836 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-User-Domain-Name: Default Aug 04 03:51:23.833836 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-User-Id: ac99f60384fe4a119d019cedfe1d3557 Aug 04 03:51:23.833836 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-User-Name: tempest-AttachVolumeNegativeTest-1888469620-project Aug 04 03:51:23.833836 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: method: > Aug 04 03:51:23.833836 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: exception: Instance 2ed39450-289e-4d51-b1b0-c5fe323e6201 could not be found. Aug 04 03:51:23.833836 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: action_args: {'id': '2ed39450-289e-4d51-b1b0-c5fe323e6201'} Aug 04 03:51:23.834696 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 03:51:23.834696 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 03:51:23.834696 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 03:51:23.834696 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 03:51:23.834696 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 03:51:23.834696 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 03:51:23.834696 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 03:51:23.834696 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 03:51:23.834696 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 03:51:23.834696 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 03:51:23.834696 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ed39450-289e-4d51-b1b0-c5fe323e6201 could not be found. Aug 04 03:51:23.834696 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi Aug 04 03:51:23.834696 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 03:51:23.834696 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi Aug 04 03:51:23.834696 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 03:51:23.834696 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 03:51:23.834696 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 03:51:23.834696 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 03:51:23.834696 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 03:51:23.834696 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 03:51:23.836211 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 03:51:23.836211 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 03:51:23.836211 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 03:51:23.836211 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 03:51:23.836211 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 03:51:23.836211 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 03:51:23.836211 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 03:51:23.836211 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ed39450-289e-4d51-b1b0-c5fe323e6201 could not be found. Aug 04 03:51:23.836211 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi Aug 04 03:51:23.836211 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 03:51:23.836211 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi Aug 04 03:51:23.836211 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 03:51:23.836211 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 03:51:23.836211 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 03:51:23.836211 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 03:51:23.836211 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 03:51:23.836211 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ed39450-289e-4d51-b1b0-c5fe323e6201 could not be found. Aug 04 03:51:23.836211 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi Aug 04 03:51:23.838254 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-1bbeee8e-2214-4774-8939-ded009662ba3 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Returning 404 to user: Instance 2ed39450-289e-4d51-b1b0-c5fe323e6201 could not be found. {{(pid=130262) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 03:51:23.838254 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-1bbeee8e-2214-4774-8939-ded009662ba3 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] 10.222.0.66 "GET /compute/v2.1/servers/2ed39450-289e-4d51-b1b0-c5fe323e6201" status: 404 len: 111 microversion: 2.1 time: 0.030683 Aug 04 03:51:23.838254 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 570/1136] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:51:23 2022] GET /compute/v2.1/servers/2ed39450-289e-4d51-b1b0-c5fe323e6201 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 03:51:23.842840 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-40e0c27f-115b-468c-b33e-af917889a37b tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Calling method '.version_select at 0x7f72e8142ca0>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:51:23.950861 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-40e0c27f-115b-468c-b33e-af917889a37b tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1570898862" status: 202 len: 0 microversion: 2.1 time: 0.111774 Aug 04 03:51:23.951463 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 567/1137] 10.222.0.66 () {58 vars in 1221 bytes} [Thu Aug 4 03:51:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1570898862 => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 04 03:51:24.652610 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-1dc05ac8-c9d2-438d-a382-843fb038b946 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Action: 'create', calling method: .version_select at 0x7f72e819da60>, body: {"keypair": {"name": "tempest-keypair-1244584001", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNsgEnlk6nBsEoXcpf7kiYU7QRO63HZ5u0pqBj9tI0vU5XsExyyNOYS122Es9Yu2R0s3f9KC3d3t08iRzmzk+PehoDCMXvCldD+2k03uECAsWAlA7/LlbLZKYh/Vznu70A=="}} {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 03:51:24.668401 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.quota [None req-1dc05ac8-c9d2-438d-a382-843fb038b946 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Getting quotas for project a98f18ee8c7d4cfe9f4b879505ca6605. Resources: {'key_pairs'} {{(pid=130262) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 03:51:24.672121 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.quota [None req-1dc05ac8-c9d2-438d-a382-843fb038b946 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Getting quotas for user ac99f60384fe4a119d019cedfe1d3557 and project a98f18ee8c7d4cfe9f4b879505ca6605. Resources: {'key_pairs'} {{(pid=130262) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 03:51:24.778341 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-1dc05ac8-c9d2-438d-a382-843fb038b946 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.129798 Aug 04 03:51:24.778936 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 571/1138] 10.222.0.66 () {60 vars in 1159 bytes} [Thu Aug 4 03:51:24 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 03:51:27.008151 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-5cd5fce8-3569-43a4-94b7-62256433a8de tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2070985636", "imageRef": "0208f4b3-1d2f-42e4-a9b4-528bf5066fe1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9a7b7e8a-baf9-483b-925f-a5723b52bbe6"}], "security_groups": [{"name": "tempest-securitygroup--52177952"}], "key_name": "tempest-keypair-1244584001", "user_data": "}} {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 03:51:27.113978 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.network.neutron [None req-5cd5fce8-3569-43a4-94b7-62256433a8de tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] validate_networks() for [('9a7b7e8a-baf9-483b-925f-a5723b52bbe6', None, None, None, None, None)] {{(pid=130263) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 03:51:27.576556 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.virt.hardware [None req-5cd5fce8-3569-43a4-94b7-62256433a8de tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Flavor limits 0:0:0 {{(pid=130263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 03:51:27.576985 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.virt.hardware [None req-5cd5fce8-3569-43a4-94b7-62256433a8de tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Image limits 0:0:0 {{(pid=130263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 03:51:27.577493 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.virt.hardware [None req-5cd5fce8-3569-43a4-94b7-62256433a8de tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Flavor pref 0:0:0 {{(pid=130263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 03:51:27.577904 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.virt.hardware [None req-5cd5fce8-3569-43a4-94b7-62256433a8de tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Image pref 0:0:0 {{(pid=130263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 03:51:27.578342 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.virt.hardware [None req-5cd5fce8-3569-43a4-94b7-62256433a8de tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 03:51:27.587027 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-5cd5fce8-3569-43a4-94b7-62256433a8de tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:51:27.587473 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-5cd5fce8-3569-43a4-94b7-62256433a8de tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:51:27.588269 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-5cd5fce8-3569-43a4-94b7-62256433a8de tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:51:27.588711 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-5cd5fce8-3569-43a4-94b7-62256433a8de tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:51:27.606218 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.quota [None req-5cd5fce8-3569-43a4-94b7-62256433a8de tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Getting quotas for project a98f18ee8c7d4cfe9f4b879505ca6605. Resources: {'instances', 'ram', 'cores'} {{(pid=130263) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 03:51:27.610156 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.quota [None req-5cd5fce8-3569-43a4-94b7-62256433a8de tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Getting quotas for user ac99f60384fe4a119d019cedfe1d3557 and project a98f18ee8c7d4cfe9f4b879505ca6605. Resources: {'instances', 'ram', 'cores'} {{(pid=130263) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 03:51:27.621189 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-5cd5fce8-3569-43a4-94b7-62256433a8de tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Going to run 1 instances... {{(pid=130263) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 03:51:27.623435 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-5cd5fce8-3569-43a4-94b7-62256433a8de tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] [instance: 43706117-d608-45d0-87cf-1ad6774c77ce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0208f4b3-1d2f-42e4-a9b4-528bf5066fe1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130263) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 03:51:27.780198 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-5cd5fce8-3569-43a4-94b7-62256433a8de tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.776753 Aug 04 03:51:27.780760 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 568/1139] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 03:51:27 2022] POST /compute/v2.1/servers => generated 400 bytes in 778 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 03:51:27.792269 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-c5e6d735-b916-48d0-a371-3fc1ea765793 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:51:27.792891 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-c5e6d735-b916-48d0-a371-3fc1ea765793 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] [instance: 43706117-d608-45d0-87cf-1ad6774c77ce] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:51:27.848857 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-c5e6d735-b916-48d0-a371-3fc1ea765793 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac99f60384fe4a119d019cedfe1d3557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f18ee8c7d4cfe9f4b879505ca6605', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:51:27.856665 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-c5e6d735-b916-48d0-a371-3fc1ea765793 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] 10.222.0.66 "GET /compute/v2.1/servers/43706117-d608-45d0-87cf-1ad6774c77ce" status: 200 len: 1242 microversion: 2.1 time: 0.068919 Aug 04 03:51:27.857254 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 572/1140] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:51:27 2022] GET /compute/v2.1/servers/43706117-d608-45d0-87cf-1ad6774c77ce => generated 1242 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:51:28.876810 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-fa413241-09e2-4031-aa2b-b58de955f2b4 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:51:28.877449 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-fa413241-09e2-4031-aa2b-b58de955f2b4 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] [instance: 43706117-d608-45d0-87cf-1ad6774c77ce] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:51:28.884752 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-fa413241-09e2-4031-aa2b-b58de955f2b4 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:51:28.885216 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-fa413241-09e2-4031-aa2b-b58de955f2b4 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:51:28.886540 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-fa413241-09e2-4031-aa2b-b58de955f2b4 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:51:28.886969 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-fa413241-09e2-4031-aa2b-b58de955f2b4 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:51:28.948849 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-fa413241-09e2-4031-aa2b-b58de955f2b4 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac99f60384fe4a119d019cedfe1d3557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f18ee8c7d4cfe9f4b879505ca6605', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:51:28.956641 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-fa413241-09e2-4031-aa2b-b58de955f2b4 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] 10.222.0.66 "GET /compute/v2.1/servers/43706117-d608-45d0-87cf-1ad6774c77ce" status: 200 len: 1246 microversion: 2.1 time: 0.083814 Aug 04 03:51:28.957226 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 569/1141] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:51:28 2022] GET /compute/v2.1/servers/43706117-d608-45d0-87cf-1ad6774c77ce => generated 1246 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:51:29.978585 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-61bd419a-dfeb-4cf1-beed-4009fff928ac tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:51:29.979203 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-61bd419a-dfeb-4cf1-beed-4009fff928ac tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] [instance: 43706117-d608-45d0-87cf-1ad6774c77ce] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:51:29.986542 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-61bd419a-dfeb-4cf1-beed-4009fff928ac tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:51:29.987318 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-61bd419a-dfeb-4cf1-beed-4009fff928ac tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:51:29.987916 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-61bd419a-dfeb-4cf1-beed-4009fff928ac tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:51:29.988366 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-61bd419a-dfeb-4cf1-beed-4009fff928ac tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:51:30.052786 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-61bd419a-dfeb-4cf1-beed-4009fff928ac tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac99f60384fe4a119d019cedfe1d3557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f18ee8c7d4cfe9f4b879505ca6605', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:51:30.060909 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-61bd419a-dfeb-4cf1-beed-4009fff928ac tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] 10.222.0.66 "GET /compute/v2.1/servers/43706117-d608-45d0-87cf-1ad6774c77ce" status: 200 len: 1312 microversion: 2.1 time: 0.086581 Aug 04 03:51:30.061869 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 573/1142] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:51:29 2022] GET /compute/v2.1/servers/43706117-d608-45d0-87cf-1ad6774c77ce => generated 1312 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:51:31.082234 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-e88fa7b4-8de3-4c51-bdc6-f7258f8640cb tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:51:31.082947 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-e88fa7b4-8de3-4c51-bdc6-f7258f8640cb tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] [instance: 43706117-d608-45d0-87cf-1ad6774c77ce] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:51:31.089476 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-e88fa7b4-8de3-4c51-bdc6-f7258f8640cb tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:51:31.089917 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-e88fa7b4-8de3-4c51-bdc6-f7258f8640cb tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:51:31.090677 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-e88fa7b4-8de3-4c51-bdc6-f7258f8640cb tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:51:31.091112 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-e88fa7b4-8de3-4c51-bdc6-f7258f8640cb tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:51:31.227619 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-e88fa7b4-8de3-4c51-bdc6-f7258f8640cb tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac99f60384fe4a119d019cedfe1d3557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f18ee8c7d4cfe9f4b879505ca6605', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:51:31.236428 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-e88fa7b4-8de3-4c51-bdc6-f7258f8640cb tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] 10.222.0.66 "GET /compute/v2.1/servers/43706117-d608-45d0-87cf-1ad6774c77ce" status: 200 len: 1366 microversion: 2.1 time: 0.158175 Aug 04 03:51:31.237058 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 570/1143] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:51:31 2022] GET /compute/v2.1/servers/43706117-d608-45d0-87cf-1ad6774c77ce => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:51:31.554452 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [req-60883881-410e-49cb-8b5f-b93ee56dd3d3 req-59e1a04e-d9bb-4641-83f8-81db43b86334 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "43706117-d608-45d0-87cf-1ad6774c77ce", "tag": "83d43a55-4b64-465b-9c04-5ce731a9f525"}]} {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 03:51:31.564779 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [req-60883881-410e-49cb-8b5f-b93ee56dd3d3 req-59e1a04e-d9bb-4641-83f8-81db43b86334 service nova] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:51:31.569702 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [req-60883881-410e-49cb-8b5f-b93ee56dd3d3 req-59e1a04e-d9bb-4641-83f8-81db43b86334 service nova] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:51:31.576629 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.compute.server_external_events [req-60883881-410e-49cb-8b5f-b93ee56dd3d3 req-59e1a04e-d9bb-4641-83f8-81db43b86334 service nova] Creating event network-changed:83d43a55-4b64-465b-9c04-5ce731a9f525 for instance 43706117-d608-45d0-87cf-1ad6774c77ce on hv-cinder-73306 Aug 04 03:51:31.581584 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [req-60883881-410e-49cb-8b5f-b93ee56dd3d3 req-59e1a04e-d9bb-4641-83f8-81db43b86334 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030879 Aug 04 03:51:31.582172 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 574/1144] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 03:51:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 03:51:32.258829 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-7567da4d-4a4b-459c-94ac-1c86fea78524 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:51:32.259432 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-7567da4d-4a4b-459c-94ac-1c86fea78524 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] [instance: 43706117-d608-45d0-87cf-1ad6774c77ce] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:51:32.267050 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-7567da4d-4a4b-459c-94ac-1c86fea78524 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:51:32.267503 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-7567da4d-4a4b-459c-94ac-1c86fea78524 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:51:32.268300 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-7567da4d-4a4b-459c-94ac-1c86fea78524 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:51:32.268820 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-7567da4d-4a4b-459c-94ac-1c86fea78524 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:51:32.450441 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-7567da4d-4a4b-459c-94ac-1c86fea78524 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac99f60384fe4a119d019cedfe1d3557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f18ee8c7d4cfe9f4b879505ca6605', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:51:32.457918 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-7567da4d-4a4b-459c-94ac-1c86fea78524 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] 10.222.0.66 "GET /compute/v2.1/servers/43706117-d608-45d0-87cf-1ad6774c77ce" status: 200 len: 1366 microversion: 2.1 time: 0.203442 Aug 04 03:51:32.458480 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 571/1145] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:51:32 2022] GET /compute/v2.1/servers/43706117-d608-45d0-87cf-1ad6774c77ce => generated 1366 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:51:33.480030 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-1528cc01-8498-4629-9148-3599ca154b12 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:51:33.480667 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-1528cc01-8498-4629-9148-3599ca154b12 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] [instance: 43706117-d608-45d0-87cf-1ad6774c77ce] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:51:33.486962 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-1528cc01-8498-4629-9148-3599ca154b12 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:51:33.487416 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-1528cc01-8498-4629-9148-3599ca154b12 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:51:33.488181 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-1528cc01-8498-4629-9148-3599ca154b12 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:51:33.488627 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-1528cc01-8498-4629-9148-3599ca154b12 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:51:33.622726 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-1528cc01-8498-4629-9148-3599ca154b12 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac99f60384fe4a119d019cedfe1d3557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f18ee8c7d4cfe9f4b879505ca6605', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:51:33.630146 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-1528cc01-8498-4629-9148-3599ca154b12 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] 10.222.0.66 "GET /compute/v2.1/servers/43706117-d608-45d0-87cf-1ad6774c77ce" status: 200 len: 1366 microversion: 2.1 time: 0.155367 Aug 04 03:51:33.630705 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 575/1146] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:51:33 2022] GET /compute/v2.1/servers/43706117-d608-45d0-87cf-1ad6774c77ce => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:51:34.651994 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-2766fa3f-cad7-4b20-a174-3529fbbef01c tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:51:34.652715 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-2766fa3f-cad7-4b20-a174-3529fbbef01c tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] [instance: 43706117-d608-45d0-87cf-1ad6774c77ce] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:51:34.659240 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-2766fa3f-cad7-4b20-a174-3529fbbef01c tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:51:34.659690 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-2766fa3f-cad7-4b20-a174-3529fbbef01c tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:51:34.660448 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-2766fa3f-cad7-4b20-a174-3529fbbef01c tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:51:34.660882 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-2766fa3f-cad7-4b20-a174-3529fbbef01c tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:51:34.877737 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-2766fa3f-cad7-4b20-a174-3529fbbef01c tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac99f60384fe4a119d019cedfe1d3557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f18ee8c7d4cfe9f4b879505ca6605', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:51:34.885155 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-2766fa3f-cad7-4b20-a174-3529fbbef01c tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] 10.222.0.66 "GET /compute/v2.1/servers/43706117-d608-45d0-87cf-1ad6774c77ce" status: 200 len: 1366 microversion: 2.1 time: 0.237652 Aug 04 03:51:34.886316 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 572/1147] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:51:34 2022] GET /compute/v2.1/servers/43706117-d608-45d0-87cf-1ad6774c77ce => generated 1366 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:51:35.906898 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-f98fd2ac-aa9e-436c-ad46-79558033da56 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:51:35.907506 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-f98fd2ac-aa9e-436c-ad46-79558033da56 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] [instance: 43706117-d608-45d0-87cf-1ad6774c77ce] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:51:35.913996 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-f98fd2ac-aa9e-436c-ad46-79558033da56 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:51:35.914446 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-f98fd2ac-aa9e-436c-ad46-79558033da56 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:51:35.915209 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-f98fd2ac-aa9e-436c-ad46-79558033da56 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:51:35.915662 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-f98fd2ac-aa9e-436c-ad46-79558033da56 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:51:36.049466 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-f98fd2ac-aa9e-436c-ad46-79558033da56 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac99f60384fe4a119d019cedfe1d3557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f18ee8c7d4cfe9f4b879505ca6605', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:51:36.057068 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-f98fd2ac-aa9e-436c-ad46-79558033da56 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] 10.222.0.66 "GET /compute/v2.1/servers/43706117-d608-45d0-87cf-1ad6774c77ce" status: 200 len: 1366 microversion: 2.1 time: 0.154079 Aug 04 03:51:36.058256 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 576/1148] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:51:35 2022] GET /compute/v2.1/servers/43706117-d608-45d0-87cf-1ad6774c77ce => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:51:37.078839 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-dbbfba7f-2bbc-4325-807b-063262e27874 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:51:37.079450 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-dbbfba7f-2bbc-4325-807b-063262e27874 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] [instance: 43706117-d608-45d0-87cf-1ad6774c77ce] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:51:37.085901 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-dbbfba7f-2bbc-4325-807b-063262e27874 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:51:37.086347 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-dbbfba7f-2bbc-4325-807b-063262e27874 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:51:37.087100 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-dbbfba7f-2bbc-4325-807b-063262e27874 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:51:37.087527 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-dbbfba7f-2bbc-4325-807b-063262e27874 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:51:37.219299 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-dbbfba7f-2bbc-4325-807b-063262e27874 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac99f60384fe4a119d019cedfe1d3557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f18ee8c7d4cfe9f4b879505ca6605', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:51:37.226818 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-dbbfba7f-2bbc-4325-807b-063262e27874 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] 10.222.0.66 "GET /compute/v2.1/servers/43706117-d608-45d0-87cf-1ad6774c77ce" status: 200 len: 1366 microversion: 2.1 time: 0.151873 Aug 04 03:51:37.227398 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 573/1149] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:51:37 2022] GET /compute/v2.1/servers/43706117-d608-45d0-87cf-1ad6774c77ce => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 03:51:38.113486 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [req-13df2f7b-2218-4766-b7b0-dbfc33e8a9a1 req-262b2921-cfac-4e29-86c7-a0ccf813f3e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43706117-d608-45d0-87cf-1ad6774c77ce", "name": "network-vif-plugged", "status": "completed", "tag": "83d43a55-4b64-465b-9c04-5ce731a9f525"}]} {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 03:51:38.118908 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG dbcounter [-] [130262] Writing DB stats nova_cell0:SELECT=6 {{(pid=130262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:51:38.124618 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [req-13df2f7b-2218-4766-b7b0-dbfc33e8a9a1 req-262b2921-cfac-4e29-86c7-a0ccf813f3e9 service nova] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:51:38.125062 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [req-13df2f7b-2218-4766-b7b0-dbfc33e8a9a1 req-262b2921-cfac-4e29-86c7-a0ccf813f3e9 service nova] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:51:38.136850 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.compute.server_external_events [req-13df2f7b-2218-4766-b7b0-dbfc33e8a9a1 req-262b2921-cfac-4e29-86c7-a0ccf813f3e9 service nova] Creating event network-vif-plugged:83d43a55-4b64-465b-9c04-5ce731a9f525 for instance 43706117-d608-45d0-87cf-1ad6774c77ce on hv-cinder-73306 Aug 04 03:51:38.141994 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [req-13df2f7b-2218-4766-b7b0-dbfc33e8a9a1 req-262b2921-cfac-4e29-86c7-a0ccf813f3e9 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032201 Aug 04 03:51:38.142764 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 577/1150] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 03:51:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 03:51:38.248222 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-1dc89308-b9e4-42b7-8db1-b578779d7190 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:51:38.248943 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-1dc89308-b9e4-42b7-8db1-b578779d7190 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] [instance: 43706117-d608-45d0-87cf-1ad6774c77ce] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:51:38.250934 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG dbcounter [-] [130263] Writing DB stats nova_cell0:SELECT=2 {{(pid=130263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:51:38.251598 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG dbcounter [-] [130263] Writing DB stats nova_cell0:SELECT=6 {{(pid=130263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:51:38.256890 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-1dc89308-b9e4-42b7-8db1-b578779d7190 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:51:38.259729 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-1dc89308-b9e4-42b7-8db1-b578779d7190 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:51:38.259729 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-1dc89308-b9e4-42b7-8db1-b578779d7190 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:51:38.259729 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-1dc89308-b9e4-42b7-8db1-b578779d7190 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:51:38.391888 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-1dc89308-b9e4-42b7-8db1-b578779d7190 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac99f60384fe4a119d019cedfe1d3557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f18ee8c7d4cfe9f4b879505ca6605', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:51:38.399426 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-1dc89308-b9e4-42b7-8db1-b578779d7190 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] 10.222.0.66 "GET /compute/v2.1/servers/43706117-d608-45d0-87cf-1ad6774c77ce" status: 200 len: 1366 microversion: 2.1 time: 0.155421 Aug 04 03:51:38.405510 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 574/1151] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:51:38 2022] GET /compute/v2.1/servers/43706117-d608-45d0-87cf-1ad6774c77ce => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:51:39.478615 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-a2d05607-33c0-4985-9747-28a711a4a57a tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:51:39.480143 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-a2d05607-33c0-4985-9747-28a711a4a57a tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] [instance: 43706117-d608-45d0-87cf-1ad6774c77ce] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:51:39.486841 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-a2d05607-33c0-4985-9747-28a711a4a57a tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:51:39.487291 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-a2d05607-33c0-4985-9747-28a711a4a57a tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:51:39.488044 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-a2d05607-33c0-4985-9747-28a711a4a57a tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:51:39.488477 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-a2d05607-33c0-4985-9747-28a711a4a57a tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:51:39.619034 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-a2d05607-33c0-4985-9747-28a711a4a57a tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac99f60384fe4a119d019cedfe1d3557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f18ee8c7d4cfe9f4b879505ca6605', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:51:39.622593 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG dbcounter [-] [130262] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=130262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:51:39.626909 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-a2d05607-33c0-4985-9747-28a711a4a57a tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] 10.222.0.66 "GET /compute/v2.1/servers/43706117-d608-45d0-87cf-1ad6774c77ce" status: 200 len: 1366 microversion: 2.1 time: 0.207848 Aug 04 03:51:39.627468 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 578/1152] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:51:39 2022] GET /compute/v2.1/servers/43706117-d608-45d0-87cf-1ad6774c77ce => generated 1366 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:51:39.820343 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-efecd09f-1a70-4021-ad8c-1eaea323bcf4 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:51:39.829253 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-efecd09f-1a70-4021-ad8c-1eaea323bcf4 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] [instance: 62affd75-bad1-417a-aac7-3495d56d9f19] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:51:39.829774 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-efecd09f-1a70-4021-ad8c-1eaea323bcf4 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:51:39.830229 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-efecd09f-1a70-4021-ad8c-1eaea323bcf4 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:51:39.830988 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-efecd09f-1a70-4021-ad8c-1eaea323bcf4 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:51:39.831430 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-efecd09f-1a70-4021-ad8c-1eaea323bcf4 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:51:39.848506 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG dbcounter [-] [130263] Writing DB stats nova_cell1:SELECT=100 {{(pid=130263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:51:39.860619 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-efecd09f-1a70-4021-ad8c-1eaea323bcf4 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] 10.222.0.66 "GET /compute/v2.1/servers/62affd75-bad1-417a-aac7-3495d56d9f19/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.044375 Aug 04 03:51:39.861170 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 575/1153] 10.222.0.66 () {60 vars in 1343 bytes} [Thu Aug 4 03:51:39 2022] GET /compute/v2.1/servers/62affd75-bad1-417a-aac7-3495d56d9f19/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:51:39.922333 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-b30f06e2-6cef-4445-9f3b-e7b78c010178 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:51:39.922834 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-b30f06e2-6cef-4445-9f3b-e7b78c010178 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] [instance: 62affd75-bad1-417a-aac7-3495d56d9f19] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:51:39.929954 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-b30f06e2-6cef-4445-9f3b-e7b78c010178 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:51:39.930408 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-b30f06e2-6cef-4445-9f3b-e7b78c010178 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:51:39.931180 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-b30f06e2-6cef-4445-9f3b-e7b78c010178 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:51:39.931624 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-b30f06e2-6cef-4445-9f3b-e7b78c010178 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:51:39.957851 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-b30f06e2-6cef-4445-9f3b-e7b78c010178 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] [instance: 62affd75-bad1-417a-aac7-3495d56d9f19] Going to try to terminate instance {{(pid=130262) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 03:51:40.193636 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-b30f06e2-6cef-4445-9f3b-e7b78c010178 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] 10.222.0.66 "DELETE /compute/v2.1/servers/62affd75-bad1-417a-aac7-3495d56d9f19" status: 204 len: 0 microversion: 2.20 time: 0.274776 Aug 04 03:51:40.194221 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 579/1154] 10.222.0.66 () {60 vars in 1280 bytes} [Thu Aug 4 03:51:39 2022] DELETE /compute/v2.1/servers/62affd75-bad1-417a-aac7-3495d56d9f19 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 04 03:51:40.203420 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-9a7542a0-5f11-4d9a-b809-e32729b690d0 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:51:40.204032 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-9a7542a0-5f11-4d9a-b809-e32729b690d0 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] [instance: 62affd75-bad1-417a-aac7-3495d56d9f19] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:51:40.210240 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-9a7542a0-5f11-4d9a-b809-e32729b690d0 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:51:40.210690 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-9a7542a0-5f11-4d9a-b809-e32729b690d0 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:51:40.211449 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-9a7542a0-5f11-4d9a-b809-e32729b690d0 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:51:40.211890 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-9a7542a0-5f11-4d9a-b809-e32729b690d0 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:51:40.341476 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-9a7542a0-5f11-4d9a-b809-e32729b690d0 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:51:40.349472 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-9a7542a0-5f11-4d9a-b809-e32729b690d0 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:51:40.350985 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-9a7542a0-5f11-4d9a-b809-e32729b690d0 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:51:40.352147 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-9a7542a0-5f11-4d9a-b809-e32729b690d0 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] 10.222.0.66 "GET /compute/v2.1/servers/62affd75-bad1-417a-aac7-3495d56d9f19" status: 200 len: 1724 microversion: 2.20 time: 0.153018 Aug 04 03:51:40.352709 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 576/1155] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 03:51:40 2022] GET /compute/v2.1/servers/62affd75-bad1-417a-aac7-3495d56d9f19 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 03:51:40.648313 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-228ecc67-86bc-46de-97f0-689c31125bee tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:51:40.649012 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-228ecc67-86bc-46de-97f0-689c31125bee tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] [instance: 43706117-d608-45d0-87cf-1ad6774c77ce] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:51:40.652125 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG dbcounter [-] [130262] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=3,nova_api:INSERT=1 {{(pid=130262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:51:40.656920 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-228ecc67-86bc-46de-97f0-689c31125bee tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:51:40.657419 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-228ecc67-86bc-46de-97f0-689c31125bee tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:51:40.658189 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-228ecc67-86bc-46de-97f0-689c31125bee tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:51:40.658624 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-228ecc67-86bc-46de-97f0-689c31125bee tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:51:40.788534 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-228ecc67-86bc-46de-97f0-689c31125bee tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac99f60384fe4a119d019cedfe1d3557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f18ee8c7d4cfe9f4b879505ca6605', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:51:40.796211 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-228ecc67-86bc-46de-97f0-689c31125bee tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] 10.222.0.66 "GET /compute/v2.1/servers/43706117-d608-45d0-87cf-1ad6774c77ce" status: 200 len: 1556 microversion: 2.1 time: 0.152257 Aug 04 03:51:40.796776 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 580/1156] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:51:40 2022] GET /compute/v2.1/servers/43706117-d608-45d0-87cf-1ad6774c77ce => generated 1556 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:51:40.816497 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-cab31ea0-dc6d-4de9-b208-ea016a6caa76 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:51:40.816993 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-cab31ea0-dc6d-4de9-b208-ea016a6caa76 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] [instance: 43706117-d608-45d0-87cf-1ad6774c77ce] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:51:40.819392 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG dbcounter [-] [130263] Writing DB stats nova_api:SELECT=60,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=130263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:51:40.824765 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-cab31ea0-dc6d-4de9-b208-ea016a6caa76 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:51:40.825327 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-cab31ea0-dc6d-4de9-b208-ea016a6caa76 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:51:40.825989 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-cab31ea0-dc6d-4de9-b208-ea016a6caa76 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:51:40.826427 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-cab31ea0-dc6d-4de9-b208-ea016a6caa76 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:51:40.908175 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-cab31ea0-dc6d-4de9-b208-ea016a6caa76 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] 10.222.0.66 "GET /compute/v2.1/servers/43706117-d608-45d0-87cf-1ad6774c77ce/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.095565 Aug 04 03:51:40.908769 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 577/1157] 10.222.0.66 () {58 vars in 1275 bytes} [Thu Aug 4 03:51:40 2022] GET /compute/v2.1/servers/43706117-d608-45d0-87cf-1ad6774c77ce/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 03:51:41.376892 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-e630e221-0b1b-4378-8f45-07cd6b012f6c tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:51:41.377527 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-e630e221-0b1b-4378-8f45-07cd6b012f6c tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] [instance: 62affd75-bad1-417a-aac7-3495d56d9f19] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:51:41.383732 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-e630e221-0b1b-4378-8f45-07cd6b012f6c tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:51:41.384180 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-e630e221-0b1b-4378-8f45-07cd6b012f6c tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:51:41.384935 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-e630e221-0b1b-4378-8f45-07cd6b012f6c tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:51:41.385401 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-e630e221-0b1b-4378-8f45-07cd6b012f6c tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:51:41.516616 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-e630e221-0b1b-4378-8f45-07cd6b012f6c tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:51:41.525509 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-e630e221-0b1b-4378-8f45-07cd6b012f6c tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:51:41.528027 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-e630e221-0b1b-4378-8f45-07cd6b012f6c tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:51:41.529189 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-e630e221-0b1b-4378-8f45-07cd6b012f6c tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] 10.222.0.66 "GET /compute/v2.1/servers/62affd75-bad1-417a-aac7-3495d56d9f19" status: 200 len: 1724 microversion: 2.20 time: 0.156659 Aug 04 03:51:41.529795 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 581/1158] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 03:51:41 2022] GET /compute/v2.1/servers/62affd75-bad1-417a-aac7-3495d56d9f19 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 03:51:41.915747 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [req-d6b6c855-7885-4edc-ba32-5cdd49879be8 req-ba7a61e8-8d5c-4918-af39-22eb758d1cd4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "43706117-d608-45d0-87cf-1ad6774c77ce", "tag": "83d43a55-4b64-465b-9c04-5ce731a9f525"}]} {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 03:51:41.925907 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [req-d6b6c855-7885-4edc-ba32-5cdd49879be8 req-ba7a61e8-8d5c-4918-af39-22eb758d1cd4 service nova] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:51:41.926362 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [req-d6b6c855-7885-4edc-ba32-5cdd49879be8 req-ba7a61e8-8d5c-4918-af39-22eb758d1cd4 service nova] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:51:41.938696 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.compute.server_external_events [req-d6b6c855-7885-4edc-ba32-5cdd49879be8 req-ba7a61e8-8d5c-4918-af39-22eb758d1cd4 service nova] Creating event network-changed:83d43a55-4b64-465b-9c04-5ce731a9f525 for instance 43706117-d608-45d0-87cf-1ad6774c77ce on hv-cinder-73306 Aug 04 03:51:41.943922 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [req-d6b6c855-7885-4edc-ba32-5cdd49879be8 req-ba7a61e8-8d5c-4918-af39-22eb758d1cd4 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032364 Aug 04 03:51:41.944522 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 578/1159] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 03:51:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 03:51:42.551873 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-7ad586e6-065f-4b82-9a3f-c47d6cc186b0 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:51:42.552582 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-7ad586e6-065f-4b82-9a3f-c47d6cc186b0 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] [instance: 62affd75-bad1-417a-aac7-3495d56d9f19] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:51:42.559829 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-7ad586e6-065f-4b82-9a3f-c47d6cc186b0 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:51:42.560285 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-7ad586e6-065f-4b82-9a3f-c47d6cc186b0 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:51:42.561065 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-7ad586e6-065f-4b82-9a3f-c47d6cc186b0 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:51:42.561561 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-7ad586e6-065f-4b82-9a3f-c47d6cc186b0 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:51:42.720516 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-7ad586e6-065f-4b82-9a3f-c47d6cc186b0 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:51:42.732489 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-7ad586e6-065f-4b82-9a3f-c47d6cc186b0 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:51:42.734028 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-7ad586e6-065f-4b82-9a3f-c47d6cc186b0 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:51:42.735226 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-7ad586e6-065f-4b82-9a3f-c47d6cc186b0 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] 10.222.0.66 "GET /compute/v2.1/servers/62affd75-bad1-417a-aac7-3495d56d9f19" status: 200 len: 1724 microversion: 2.20 time: 0.187224 Aug 04 03:51:42.735778 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 582/1160] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 03:51:42 2022] GET /compute/v2.1/servers/62affd75-bad1-417a-aac7-3495d56d9f19 => generated 1724 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 03:51:43.760414 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-5719cb2e-f328-4030-b30f-da0e4f942e73 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:51:43.761171 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-5719cb2e-f328-4030-b30f-da0e4f942e73 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] [instance: 62affd75-bad1-417a-aac7-3495d56d9f19] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:51:43.767712 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-5719cb2e-f328-4030-b30f-da0e4f942e73 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:51:43.768231 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-5719cb2e-f328-4030-b30f-da0e4f942e73 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:51:43.769003 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-5719cb2e-f328-4030-b30f-da0e4f942e73 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:51:43.769484 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-5719cb2e-f328-4030-b30f-da0e4f942e73 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:51:43.802636 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-5719cb2e-f328-4030-b30f-da0e4f942e73 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:51:43.803082 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-5719cb2e-f328-4030-b30f-da0e4f942e73 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:51:43.803530 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.objects.instance [None req-5719cb2e-f328-4030-b30f-da0e4f942e73 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lazy-loading 'fault' on Instance uuid 62affd75-bad1-417a-aac7-3495d56d9f19 {{(pid=130263) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 03:51:43.847797 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-5719cb2e-f328-4030-b30f-da0e4f942e73 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:51:43.857043 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-5719cb2e-f328-4030-b30f-da0e4f942e73 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:51:43.858598 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-5719cb2e-f328-4030-b30f-da0e4f942e73 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '55beb38ea2994ea7987fe546235b58a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '274bea7582354f49841b893c0a39ffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:51:43.859763 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-5719cb2e-f328-4030-b30f-da0e4f942e73 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] 10.222.0.66 "GET /compute/v2.1/servers/62affd75-bad1-417a-aac7-3495d56d9f19" status: 200 len: 1371 microversion: 2.20 time: 0.104301 Aug 04 03:51:43.860565 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 579/1161] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 03:51:43 2022] GET /compute/v2.1/servers/62affd75-bad1-417a-aac7-3495d56d9f19 => generated 1371 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 04 03:51:43.958081 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [req-7fc38b3c-123a-4300-ab0f-aca1b51c233b req-b88a1f61-a501-4125-806f-e5bb7315c18d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62affd75-bad1-417a-aac7-3495d56d9f19", "name": "network-vif-deleted", "tag": "de2fd866-0219-43e7-a73a-fd446fc3c7ba"}]} {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 03:51:43.969944 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [req-7fc38b3c-123a-4300-ab0f-aca1b51c233b req-b88a1f61-a501-4125-806f-e5bb7315c18d service nova] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:51:43.971175 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [req-7fc38b3c-123a-4300-ab0f-aca1b51c233b req-b88a1f61-a501-4125-806f-e5bb7315c18d service nova] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:51:43.986930 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.compute.server_external_events [req-7fc38b3c-123a-4300-ab0f-aca1b51c233b req-b88a1f61-a501-4125-806f-e5bb7315c18d service nova] Creating event network-vif-deleted:de2fd866-0219-43e7-a73a-fd446fc3c7ba for instance 62affd75-bad1-417a-aac7-3495d56d9f19 on hv-cinder-73306 Aug 04 03:51:43.991940 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [req-7fc38b3c-123a-4300-ab0f-aca1b51c233b req-b88a1f61-a501-4125-806f-e5bb7315c18d service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037406 Aug 04 03:51:43.993665 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 583/1162] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 03:51:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 03:51:44.887201 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-0cd52412-6f29-44ca-ba30-f07e90e6ac0d tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:51:44.887812 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-0cd52412-6f29-44ca-ba30-f07e90e6ac0d tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] [instance: 62affd75-bad1-417a-aac7-3495d56d9f19] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:51:44.894395 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-0cd52412-6f29-44ca-ba30-f07e90e6ac0d tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:51:44.894838 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-0cd52412-6f29-44ca-ba30-f07e90e6ac0d tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:51:44.895589 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-0cd52412-6f29-44ca-ba30-f07e90e6ac0d tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:51:44.896019 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-0cd52412-6f29-44ca-ba30-f07e90e6ac0d tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:51:44.909607 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.wsgi [None req-0cd52412-6f29-44ca-ba30-f07e90e6ac0d tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] HTTP exception thrown: Instance 62affd75-bad1-417a-aac7-3495d56d9f19 could not be found. Aug 04 03:51:44.911232 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-0cd52412-6f29-44ca-ba30-f07e90e6ac0d tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Request method failure captured: Aug 04 03:51:44.911232 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: request: GET /compute/v2.1/servers/62affd75-bad1-417a-aac7-3495d56d9f19 HTTP/1.1 Aug 04 03:51:44.911232 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Accept: application/json Aug 04 03:51:44.911232 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Accept-Encoding: identity Aug 04 03:51:44.911232 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Connection: close Aug 04 03:51:44.911232 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Content-Length: 0 Aug 04 03:51:44.911232 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Content-Type: application/json Aug 04 03:51:44.911232 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Host: 10.222.0.66 Aug 04 03:51:44.911232 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Openstack-System-Scope: None Aug 04 03:51:44.911232 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: User-Agent: python-urllib3/1.26.11 Aug 04 03:51:44.911232 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Auth-Token: gAAAAABi6z_6eWpflhTHAR3k3-3-Ak9FHGaJVefRoBRycC9xcveJTyS3VydXfkrfjNWpmddv6tXX_m9fThQticZOp_TpGnnbBBZrV9UfFxUpSnkrNgFZrKBKp35EjTPK7UxdKFU_Z27hg5qNhGcQL_Kq5UIMJbwlYCTazf0GoGyA8EbjGBcubh4 Aug 04 03:51:44.911232 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Domain-Id: None Aug 04 03:51:44.911232 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Domain-Name: None Aug 04 03:51:44.911232 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Identity-Status: Confirmed Aug 04 03:51:44.911232 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Is-Admin-Project: True Aug 04 03:51:44.911232 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Openstack-Nova-Api-Version: 2.20 Aug 04 03:51:44.911232 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Project-Domain-Id: default Aug 04 03:51:44.911232 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Project-Domain-Name: Default Aug 04 03:51:44.911232 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Project-Id: 274bea7582354f49841b893c0a39ffdf Aug 04 03:51:44.911232 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-558990152 Aug 04 03:51:44.911232 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Role: member,reader Aug 04 03:51:44.911232 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Roles: member,reader Aug 04 03:51:44.912964 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/274bea7582354f49841b893c0a39ffdf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/274bea7582354f49841b893c0a39ffdf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/274bea7582354f49841b893c0a39ffdf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_274bea7582354f49841b893c0a39ffdf"}]}] Aug 04 03:51:44.912964 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Tenant: tempest-AttachVolumeShelveTestJSON-558990152 Aug 04 03:51:44.912964 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Tenant-Id: 274bea7582354f49841b893c0a39ffdf Aug 04 03:51:44.912964 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-558990152 Aug 04 03:51:44.912964 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-User: tempest-AttachVolumeShelveTestJSON-558990152-project Aug 04 03:51:44.912964 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-User-Domain-Id: default Aug 04 03:51:44.912964 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-User-Domain-Name: Default Aug 04 03:51:44.912964 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-User-Id: 55beb38ea2994ea7987fe546235b58a5 Aug 04 03:51:44.912964 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-User-Name: tempest-AttachVolumeShelveTestJSON-558990152-project Aug 04 03:51:44.912964 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: method: > Aug 04 03:51:44.912964 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: exception: Instance 62affd75-bad1-417a-aac7-3495d56d9f19 could not be found. Aug 04 03:51:44.912964 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: action_args: {'id': '62affd75-bad1-417a-aac7-3495d56d9f19'} Aug 04 03:51:44.913935 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 03:51:44.913935 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 03:51:44.913935 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 03:51:44.913935 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 03:51:44.913935 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 03:51:44.913935 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 03:51:44.913935 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 03:51:44.913935 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 03:51:44.913935 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 03:51:44.913935 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 03:51:44.913935 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62affd75-bad1-417a-aac7-3495d56d9f19 could not be found. Aug 04 03:51:44.913935 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Aug 04 03:51:44.913935 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 03:51:44.913935 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Aug 04 03:51:44.913935 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 03:51:44.913935 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 03:51:44.913935 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 03:51:44.913935 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 03:51:44.913935 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 03:51:44.913935 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 03:51:44.915471 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 03:51:44.915471 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 03:51:44.915471 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 03:51:44.915471 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 03:51:44.915471 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 03:51:44.915471 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 03:51:44.915471 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 03:51:44.915471 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62affd75-bad1-417a-aac7-3495d56d9f19 could not be found. Aug 04 03:51:44.915471 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Aug 04 03:51:44.915471 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 03:51:44.915471 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Aug 04 03:51:44.915471 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 03:51:44.915471 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 03:51:44.915471 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 03:51:44.915471 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 03:51:44.915471 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 03:51:44.915471 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62affd75-bad1-417a-aac7-3495d56d9f19 could not be found. Aug 04 03:51:44.915471 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Aug 04 03:51:44.917805 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-0cd52412-6f29-44ca-ba30-f07e90e6ac0d tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Returning 404 to user: Instance 62affd75-bad1-417a-aac7-3495d56d9f19 could not be found. {{(pid=130263) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 03:51:44.917805 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-0cd52412-6f29-44ca-ba30-f07e90e6ac0d tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] 10.222.0.66 "GET /compute/v2.1/servers/62affd75-bad1-417a-aac7-3495d56d9f19" status: 404 len: 111 microversion: 2.20 time: 0.029440 Aug 04 03:51:44.917805 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 580/1163] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 03:51:44 2022] GET /compute/v2.1/servers/62affd75-bad1-417a-aac7-3495d56d9f19 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 04 03:51:44.922472 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-1fb22bc8-f0de-468f-875f-626af061b711 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Calling method '.version_select at 0x7f72e8119ee0>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:51:45.012498 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-1fb22bc8-f0de-468f-875f-626af061b711 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1797702810" status: 204 len: 0 microversion: 2.20 time: 0.094028 Aug 04 03:51:45.013192 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 584/1164] 10.222.0.66 () {60 vars in 1262 bytes} [Thu Aug 4 03:51:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1797702810 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 04 03:51:46.991821 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-6f1db7f9-7d99-4720-a072-0f15258237ec tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:51:46.992317 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-6f1db7f9-7d99-4720-a072-0f15258237ec tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] [instance: 62affd75-bad1-417a-aac7-3495d56d9f19] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:51:46.999256 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-6f1db7f9-7d99-4720-a072-0f15258237ec tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:51:46.999708 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-6f1db7f9-7d99-4720-a072-0f15258237ec tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:51:47.000473 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-6f1db7f9-7d99-4720-a072-0f15258237ec tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:51:47.000914 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-6f1db7f9-7d99-4720-a072-0f15258237ec tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:51:47.014498 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.wsgi [None req-6f1db7f9-7d99-4720-a072-0f15258237ec tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] HTTP exception thrown: Instance 62affd75-bad1-417a-aac7-3495d56d9f19 could not be found. Aug 04 03:51:47.016042 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-6f1db7f9-7d99-4720-a072-0f15258237ec tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Request method failure captured: Aug 04 03:51:47.016042 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: request: DELETE /compute/v2.1/servers/62affd75-bad1-417a-aac7-3495d56d9f19 HTTP/1.1 Aug 04 03:51:47.016042 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Accept: application/json Aug 04 03:51:47.016042 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Accept-Encoding: identity Aug 04 03:51:47.016042 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Connection: close Aug 04 03:51:47.016042 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Content-Length: 0 Aug 04 03:51:47.016042 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Content-Type: application/json Aug 04 03:51:47.016042 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Host: 10.222.0.66 Aug 04 03:51:47.016042 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Openstack-System-Scope: None Aug 04 03:51:47.016042 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: User-Agent: python-urllib3/1.26.11 Aug 04 03:51:47.016042 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Auth-Token: gAAAAABi6z_6eWpflhTHAR3k3-3-Ak9FHGaJVefRoBRycC9xcveJTyS3VydXfkrfjNWpmddv6tXX_m9fThQticZOp_TpGnnbBBZrV9UfFxUpSnkrNgFZrKBKp35EjTPK7UxdKFU_Z27hg5qNhGcQL_Kq5UIMJbwlYCTazf0GoGyA8EbjGBcubh4 Aug 04 03:51:47.016042 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Domain-Id: None Aug 04 03:51:47.016042 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Domain-Name: None Aug 04 03:51:47.016042 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Identity-Status: Confirmed Aug 04 03:51:47.016042 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Is-Admin-Project: True Aug 04 03:51:47.016042 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Openstack-Nova-Api-Version: 2.20 Aug 04 03:51:47.016042 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Project-Domain-Id: default Aug 04 03:51:47.016042 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Project-Domain-Name: Default Aug 04 03:51:47.016042 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Project-Id: 274bea7582354f49841b893c0a39ffdf Aug 04 03:51:47.016042 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-558990152 Aug 04 03:51:47.016042 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Role: member,reader Aug 04 03:51:47.016042 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Roles: member,reader Aug 04 03:51:47.017701 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/274bea7582354f49841b893c0a39ffdf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/274bea7582354f49841b893c0a39ffdf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/274bea7582354f49841b893c0a39ffdf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_274bea7582354f49841b893c0a39ffdf"}]}] Aug 04 03:51:47.017701 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Tenant: tempest-AttachVolumeShelveTestJSON-558990152 Aug 04 03:51:47.017701 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Tenant-Id: 274bea7582354f49841b893c0a39ffdf Aug 04 03:51:47.017701 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-558990152 Aug 04 03:51:47.017701 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-User: tempest-AttachVolumeShelveTestJSON-558990152-project Aug 04 03:51:47.017701 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-User-Domain-Id: default Aug 04 03:51:47.017701 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-User-Domain-Name: Default Aug 04 03:51:47.017701 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-User-Id: 55beb38ea2994ea7987fe546235b58a5 Aug 04 03:51:47.017701 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-User-Name: tempest-AttachVolumeShelveTestJSON-558990152-project Aug 04 03:51:47.017701 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: method: > Aug 04 03:51:47.017701 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: exception: Instance 62affd75-bad1-417a-aac7-3495d56d9f19 could not be found. Aug 04 03:51:47.017701 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: action_args: {'id': '62affd75-bad1-417a-aac7-3495d56d9f19'} Aug 04 03:51:47.018747 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 03:51:47.018747 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 03:51:47.018747 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 03:51:47.018747 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 03:51:47.018747 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 03:51:47.018747 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 03:51:47.018747 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 03:51:47.018747 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 03:51:47.018747 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 03:51:47.018747 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 03:51:47.018747 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62affd75-bad1-417a-aac7-3495d56d9f19 could not be found. Aug 04 03:51:47.018747 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Aug 04 03:51:47.018747 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 03:51:47.018747 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Aug 04 03:51:47.018747 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 03:51:47.018747 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 03:51:47.018747 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 03:51:47.018747 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 03:51:47.018747 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 03:51:47.018747 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 03:51:47.020312 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 03:51:47.020312 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 03:51:47.020312 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 03:51:47.020312 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 03:51:47.020312 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 03:51:47.020312 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 03:51:47.020312 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 03:51:47.020312 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 03:51:47.020312 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 03:51:47.020312 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62affd75-bad1-417a-aac7-3495d56d9f19 could not be found. Aug 04 03:51:47.020312 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Aug 04 03:51:47.020312 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 03:51:47.020312 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Aug 04 03:51:47.020312 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 03:51:47.020312 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 03:51:47.020312 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 03:51:47.020312 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 03:51:47.020312 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 03:51:47.020312 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62affd75-bad1-417a-aac7-3495d56d9f19 could not be found. Aug 04 03:51:47.020312 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Aug 04 03:51:47.021996 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-6f1db7f9-7d99-4720-a072-0f15258237ec tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Returning 404 to user: Instance 62affd75-bad1-417a-aac7-3495d56d9f19 could not be found. {{(pid=130263) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 03:51:47.021996 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-6f1db7f9-7d99-4720-a072-0f15258237ec tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] 10.222.0.66 "DELETE /compute/v2.1/servers/62affd75-bad1-417a-aac7-3495d56d9f19" status: 404 len: 111 microversion: 2.20 time: 0.029566 Aug 04 03:51:47.021996 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 581/1165] 10.222.0.66 () {60 vars in 1280 bytes} [Thu Aug 4 03:51:46 2022] DELETE /compute/v2.1/servers/62affd75-bad1-417a-aac7-3495d56d9f19 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 04 03:51:47.027074 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-075546b3-0866-4eb8-a03f-771f3d9019c6 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:51:47.027808 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-075546b3-0866-4eb8-a03f-771f3d9019c6 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] [instance: 62affd75-bad1-417a-aac7-3495d56d9f19] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:51:47.034518 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-075546b3-0866-4eb8-a03f-771f3d9019c6 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:51:47.034977 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-075546b3-0866-4eb8-a03f-771f3d9019c6 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:51:47.035742 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-075546b3-0866-4eb8-a03f-771f3d9019c6 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:51:47.036182 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-075546b3-0866-4eb8-a03f-771f3d9019c6 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:51:47.049750 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.wsgi [None req-075546b3-0866-4eb8-a03f-771f3d9019c6 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] HTTP exception thrown: Instance 62affd75-bad1-417a-aac7-3495d56d9f19 could not be found. Aug 04 03:51:47.051366 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-075546b3-0866-4eb8-a03f-771f3d9019c6 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Request method failure captured: Aug 04 03:51:47.051366 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: request: GET /compute/v2.1/servers/62affd75-bad1-417a-aac7-3495d56d9f19 HTTP/1.1 Aug 04 03:51:47.051366 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: Accept: application/json Aug 04 03:51:47.051366 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: Accept-Encoding: identity Aug 04 03:51:47.051366 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: Connection: close Aug 04 03:51:47.051366 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: Content-Length: 0 Aug 04 03:51:47.051366 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: Content-Type: application/json Aug 04 03:51:47.051366 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: Host: 10.222.0.66 Aug 04 03:51:47.051366 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: Openstack-System-Scope: None Aug 04 03:51:47.051366 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: User-Agent: python-urllib3/1.26.11 Aug 04 03:51:47.051366 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Auth-Token: gAAAAABi6z_6eWpflhTHAR3k3-3-Ak9FHGaJVefRoBRycC9xcveJTyS3VydXfkrfjNWpmddv6tXX_m9fThQticZOp_TpGnnbBBZrV9UfFxUpSnkrNgFZrKBKp35EjTPK7UxdKFU_Z27hg5qNhGcQL_Kq5UIMJbwlYCTazf0GoGyA8EbjGBcubh4 Aug 04 03:51:47.051366 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Domain-Id: None Aug 04 03:51:47.051366 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Domain-Name: None Aug 04 03:51:47.051366 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Identity-Status: Confirmed Aug 04 03:51:47.051366 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Is-Admin-Project: True Aug 04 03:51:47.051366 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Openstack-Nova-Api-Version: 2.20 Aug 04 03:51:47.051366 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Project-Domain-Id: default Aug 04 03:51:47.051366 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Project-Domain-Name: Default Aug 04 03:51:47.051366 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Project-Id: 274bea7582354f49841b893c0a39ffdf Aug 04 03:51:47.051366 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-558990152 Aug 04 03:51:47.051366 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Role: member,reader Aug 04 03:51:47.051366 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Roles: member,reader Aug 04 03:51:47.053023 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/274bea7582354f49841b893c0a39ffdf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/274bea7582354f49841b893c0a39ffdf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/274bea7582354f49841b893c0a39ffdf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_274bea7582354f49841b893c0a39ffdf"}]}] Aug 04 03:51:47.053023 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Tenant: tempest-AttachVolumeShelveTestJSON-558990152 Aug 04 03:51:47.053023 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Tenant-Id: 274bea7582354f49841b893c0a39ffdf Aug 04 03:51:47.053023 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-558990152 Aug 04 03:51:47.053023 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-User: tempest-AttachVolumeShelveTestJSON-558990152-project Aug 04 03:51:47.053023 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-User-Domain-Id: default Aug 04 03:51:47.053023 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-User-Domain-Name: Default Aug 04 03:51:47.053023 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-User-Id: 55beb38ea2994ea7987fe546235b58a5 Aug 04 03:51:47.053023 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-User-Name: tempest-AttachVolumeShelveTestJSON-558990152-project Aug 04 03:51:47.053023 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: method: > Aug 04 03:51:47.053023 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: exception: Instance 62affd75-bad1-417a-aac7-3495d56d9f19 could not be found. Aug 04 03:51:47.053023 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: action_args: {'id': '62affd75-bad1-417a-aac7-3495d56d9f19'} Aug 04 03:51:47.053974 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 03:51:47.053974 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 03:51:47.053974 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 03:51:47.053974 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 03:51:47.053974 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 03:51:47.053974 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 03:51:47.053974 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 03:51:47.053974 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 03:51:47.053974 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 03:51:47.053974 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 03:51:47.053974 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62affd75-bad1-417a-aac7-3495d56d9f19 could not be found. Aug 04 03:51:47.053974 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi Aug 04 03:51:47.053974 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 03:51:47.053974 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi Aug 04 03:51:47.053974 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 03:51:47.053974 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 03:51:47.053974 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 03:51:47.053974 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 03:51:47.053974 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 03:51:47.053974 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 03:51:47.055453 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 03:51:47.055453 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 03:51:47.055453 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 03:51:47.055453 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 03:51:47.055453 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 03:51:47.055453 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 03:51:47.055453 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 03:51:47.055453 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62affd75-bad1-417a-aac7-3495d56d9f19 could not be found. Aug 04 03:51:47.055453 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi Aug 04 03:51:47.055453 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 03:51:47.055453 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi Aug 04 03:51:47.055453 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 03:51:47.055453 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 03:51:47.055453 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 03:51:47.055453 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 03:51:47.055453 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 03:51:47.055453 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62affd75-bad1-417a-aac7-3495d56d9f19 could not be found. Aug 04 03:51:47.055453 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi Aug 04 03:51:47.056742 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-075546b3-0866-4eb8-a03f-771f3d9019c6 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Returning 404 to user: Instance 62affd75-bad1-417a-aac7-3495d56d9f19 could not be found. {{(pid=130262) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 03:51:47.056742 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-075546b3-0866-4eb8-a03f-771f3d9019c6 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] 10.222.0.66 "GET /compute/v2.1/servers/62affd75-bad1-417a-aac7-3495d56d9f19" status: 404 len: 111 microversion: 2.20 time: 0.030786 Aug 04 03:51:47.056742 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 585/1166] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 03:51:47 2022] GET /compute/v2.1/servers/62affd75-bad1-417a-aac7-3495d56d9f19 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 04 03:51:48.505989 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-0f236e9d-48ab-452d-a82c-98b0badcbb47 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:51:48.506537 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-0f236e9d-48ab-452d-a82c-98b0badcbb47 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] [instance: 3bf41d49-2b84-4f59-a019-a8b1e45891d1] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:51:48.513502 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-0f236e9d-48ab-452d-a82c-98b0badcbb47 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:51:48.513955 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-0f236e9d-48ab-452d-a82c-98b0badcbb47 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:51:48.514714 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-0f236e9d-48ab-452d-a82c-98b0badcbb47 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:51:48.515149 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-0f236e9d-48ab-452d-a82c-98b0badcbb47 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:51:48.529023 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.wsgi [None req-0f236e9d-48ab-452d-a82c-98b0badcbb47 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] HTTP exception thrown: Instance 3bf41d49-2b84-4f59-a019-a8b1e45891d1 could not be found. Aug 04 03:51:48.530587 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-0f236e9d-48ab-452d-a82c-98b0badcbb47 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Request method failure captured: Aug 04 03:51:48.530587 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: request: DELETE /compute/v2.1/servers/3bf41d49-2b84-4f59-a019-a8b1e45891d1 HTTP/1.1 Aug 04 03:51:48.530587 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Accept: application/json Aug 04 03:51:48.530587 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Accept-Encoding: identity Aug 04 03:51:48.530587 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Connection: close Aug 04 03:51:48.530587 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Content-Length: 0 Aug 04 03:51:48.530587 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Content-Type: application/json Aug 04 03:51:48.530587 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Host: 10.222.0.66 Aug 04 03:51:48.530587 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Openstack-System-Scope: None Aug 04 03:51:48.530587 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: User-Agent: python-urllib3/1.26.11 Aug 04 03:51:48.530587 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Auth-Token: gAAAAABi6z_6eWpflhTHAR3k3-3-Ak9FHGaJVefRoBRycC9xcveJTyS3VydXfkrfjNWpmddv6tXX_m9fThQticZOp_TpGnnbBBZrV9UfFxUpSnkrNgFZrKBKp35EjTPK7UxdKFU_Z27hg5qNhGcQL_Kq5UIMJbwlYCTazf0GoGyA8EbjGBcubh4 Aug 04 03:51:48.530587 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Domain-Id: None Aug 04 03:51:48.530587 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Domain-Name: None Aug 04 03:51:48.530587 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Identity-Status: Confirmed Aug 04 03:51:48.530587 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Is-Admin-Project: True Aug 04 03:51:48.530587 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Openstack-Nova-Api-Version: 2.20 Aug 04 03:51:48.530587 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Project-Domain-Id: default Aug 04 03:51:48.530587 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Project-Domain-Name: Default Aug 04 03:51:48.530587 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Project-Id: 274bea7582354f49841b893c0a39ffdf Aug 04 03:51:48.530587 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-558990152 Aug 04 03:51:48.530587 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Role: member,reader Aug 04 03:51:48.530587 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Roles: member,reader Aug 04 03:51:48.532215 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/274bea7582354f49841b893c0a39ffdf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/274bea7582354f49841b893c0a39ffdf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/274bea7582354f49841b893c0a39ffdf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_274bea7582354f49841b893c0a39ffdf"}]}] Aug 04 03:51:48.532215 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Tenant: tempest-AttachVolumeShelveTestJSON-558990152 Aug 04 03:51:48.532215 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Tenant-Id: 274bea7582354f49841b893c0a39ffdf Aug 04 03:51:48.532215 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-558990152 Aug 04 03:51:48.532215 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-User: tempest-AttachVolumeShelveTestJSON-558990152-project Aug 04 03:51:48.532215 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-User-Domain-Id: default Aug 04 03:51:48.532215 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-User-Domain-Name: Default Aug 04 03:51:48.532215 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-User-Id: 55beb38ea2994ea7987fe546235b58a5 Aug 04 03:51:48.532215 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-User-Name: tempest-AttachVolumeShelveTestJSON-558990152-project Aug 04 03:51:48.532215 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: method: > Aug 04 03:51:48.532215 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: exception: Instance 3bf41d49-2b84-4f59-a019-a8b1e45891d1 could not be found. Aug 04 03:51:48.532215 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: action_args: {'id': '3bf41d49-2b84-4f59-a019-a8b1e45891d1'} Aug 04 03:51:48.533224 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 03:51:48.533224 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 03:51:48.533224 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 03:51:48.533224 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 03:51:48.533224 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 03:51:48.533224 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 03:51:48.533224 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 03:51:48.533224 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 03:51:48.533224 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 03:51:48.533224 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 03:51:48.533224 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3bf41d49-2b84-4f59-a019-a8b1e45891d1 could not be found. Aug 04 03:51:48.533224 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Aug 04 03:51:48.533224 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 03:51:48.533224 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Aug 04 03:51:48.533224 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 03:51:48.533224 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 03:51:48.533224 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 03:51:48.533224 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 03:51:48.533224 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 03:51:48.533224 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 03:51:48.534684 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 03:51:48.534684 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 03:51:48.534684 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 03:51:48.534684 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 03:51:48.534684 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 03:51:48.534684 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 03:51:48.534684 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 03:51:48.534684 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 03:51:48.534684 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 03:51:48.534684 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3bf41d49-2b84-4f59-a019-a8b1e45891d1 could not be found. Aug 04 03:51:48.534684 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Aug 04 03:51:48.534684 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 03:51:48.534684 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Aug 04 03:51:48.534684 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 03:51:48.534684 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 03:51:48.534684 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 03:51:48.534684 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 03:51:48.534684 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 03:51:48.534684 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3bf41d49-2b84-4f59-a019-a8b1e45891d1 could not be found. Aug 04 03:51:48.534684 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Aug 04 03:51:48.536207 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-0f236e9d-48ab-452d-a82c-98b0badcbb47 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Returning 404 to user: Instance 3bf41d49-2b84-4f59-a019-a8b1e45891d1 could not be found. {{(pid=130263) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 03:51:48.536207 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-0f236e9d-48ab-452d-a82c-98b0badcbb47 tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] 10.222.0.66 "DELETE /compute/v2.1/servers/3bf41d49-2b84-4f59-a019-a8b1e45891d1" status: 404 len: 111 microversion: 2.20 time: 0.029817 Aug 04 03:51:48.536207 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 582/1167] 10.222.0.66 () {60 vars in 1280 bytes} [Thu Aug 4 03:51:48 2022] DELETE /compute/v2.1/servers/3bf41d49-2b84-4f59-a019-a8b1e45891d1 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 04 03:51:48.540399 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-cc8a8057-121e-4b8e-9ac3-74be0fdd8fec tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:51:48.541042 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-cc8a8057-121e-4b8e-9ac3-74be0fdd8fec tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] [instance: 3bf41d49-2b84-4f59-a019-a8b1e45891d1] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:51:48.548186 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-cc8a8057-121e-4b8e-9ac3-74be0fdd8fec tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:51:48.548640 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-cc8a8057-121e-4b8e-9ac3-74be0fdd8fec tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:51:48.549441 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-cc8a8057-121e-4b8e-9ac3-74be0fdd8fec tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:51:48.549886 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-cc8a8057-121e-4b8e-9ac3-74be0fdd8fec tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:51:48.562795 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.wsgi [None req-cc8a8057-121e-4b8e-9ac3-74be0fdd8fec tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] HTTP exception thrown: Instance 3bf41d49-2b84-4f59-a019-a8b1e45891d1 could not be found. Aug 04 03:51:48.564339 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-cc8a8057-121e-4b8e-9ac3-74be0fdd8fec tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Request method failure captured: Aug 04 03:51:48.564339 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: request: GET /compute/v2.1/servers/3bf41d49-2b84-4f59-a019-a8b1e45891d1 HTTP/1.1 Aug 04 03:51:48.564339 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: Accept: application/json Aug 04 03:51:48.564339 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: Accept-Encoding: identity Aug 04 03:51:48.564339 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: Connection: close Aug 04 03:51:48.564339 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: Content-Length: 0 Aug 04 03:51:48.564339 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: Content-Type: application/json Aug 04 03:51:48.564339 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: Host: 10.222.0.66 Aug 04 03:51:48.564339 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: Openstack-System-Scope: None Aug 04 03:51:48.564339 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: User-Agent: python-urllib3/1.26.11 Aug 04 03:51:48.564339 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Auth-Token: gAAAAABi6z_6eWpflhTHAR3k3-3-Ak9FHGaJVefRoBRycC9xcveJTyS3VydXfkrfjNWpmddv6tXX_m9fThQticZOp_TpGnnbBBZrV9UfFxUpSnkrNgFZrKBKp35EjTPK7UxdKFU_Z27hg5qNhGcQL_Kq5UIMJbwlYCTazf0GoGyA8EbjGBcubh4 Aug 04 03:51:48.564339 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Domain-Id: None Aug 04 03:51:48.564339 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Domain-Name: None Aug 04 03:51:48.564339 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Identity-Status: Confirmed Aug 04 03:51:48.564339 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Is-Admin-Project: True Aug 04 03:51:48.564339 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Openstack-Nova-Api-Version: 2.20 Aug 04 03:51:48.564339 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Project-Domain-Id: default Aug 04 03:51:48.564339 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Project-Domain-Name: Default Aug 04 03:51:48.564339 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Project-Id: 274bea7582354f49841b893c0a39ffdf Aug 04 03:51:48.564339 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-558990152 Aug 04 03:51:48.564339 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Role: member,reader Aug 04 03:51:48.564339 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Roles: member,reader Aug 04 03:51:48.565960 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/274bea7582354f49841b893c0a39ffdf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/274bea7582354f49841b893c0a39ffdf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/274bea7582354f49841b893c0a39ffdf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_274bea7582354f49841b893c0a39ffdf"}]}] Aug 04 03:51:48.565960 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Tenant: tempest-AttachVolumeShelveTestJSON-558990152 Aug 04 03:51:48.565960 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Tenant-Id: 274bea7582354f49841b893c0a39ffdf Aug 04 03:51:48.565960 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-558990152 Aug 04 03:51:48.565960 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-User: tempest-AttachVolumeShelveTestJSON-558990152-project Aug 04 03:51:48.565960 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-User-Domain-Id: default Aug 04 03:51:48.565960 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-User-Domain-Name: Default Aug 04 03:51:48.565960 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-User-Id: 55beb38ea2994ea7987fe546235b58a5 Aug 04 03:51:48.565960 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-User-Name: tempest-AttachVolumeShelveTestJSON-558990152-project Aug 04 03:51:48.565960 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: method: > Aug 04 03:51:48.565960 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: exception: Instance 3bf41d49-2b84-4f59-a019-a8b1e45891d1 could not be found. Aug 04 03:51:48.565960 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: action_args: {'id': '3bf41d49-2b84-4f59-a019-a8b1e45891d1'} Aug 04 03:51:48.566966 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 03:51:48.566966 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 03:51:48.566966 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 03:51:48.566966 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 03:51:48.566966 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 03:51:48.566966 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 03:51:48.566966 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 03:51:48.566966 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 03:51:48.566966 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 03:51:48.566966 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 03:51:48.566966 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3bf41d49-2b84-4f59-a019-a8b1e45891d1 could not be found. Aug 04 03:51:48.566966 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi Aug 04 03:51:48.566966 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 03:51:48.566966 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi Aug 04 03:51:48.566966 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 03:51:48.566966 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 03:51:48.566966 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 03:51:48.566966 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 03:51:48.566966 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 03:51:48.566966 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 03:51:48.568415 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 03:51:48.568415 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 03:51:48.568415 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 03:51:48.568415 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 03:51:48.568415 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 03:51:48.568415 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 03:51:48.568415 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 03:51:48.568415 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3bf41d49-2b84-4f59-a019-a8b1e45891d1 could not be found. Aug 04 03:51:48.568415 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi Aug 04 03:51:48.568415 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 03:51:48.568415 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi Aug 04 03:51:48.568415 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 03:51:48.568415 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 03:51:48.568415 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 03:51:48.568415 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 03:51:48.568415 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 03:51:48.568415 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3bf41d49-2b84-4f59-a019-a8b1e45891d1 could not be found. Aug 04 03:51:48.568415 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi Aug 04 03:51:48.569791 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-cc8a8057-121e-4b8e-9ac3-74be0fdd8fec tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] Returning 404 to user: Instance 3bf41d49-2b84-4f59-a019-a8b1e45891d1 could not be found. {{(pid=130262) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 03:51:48.569791 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-cc8a8057-121e-4b8e-9ac3-74be0fdd8fec tempest-AttachVolumeShelveTestJSON-558990152 tempest-AttachVolumeShelveTestJSON-558990152-project] 10.222.0.66 "GET /compute/v2.1/servers/3bf41d49-2b84-4f59-a019-a8b1e45891d1" status: 404 len: 111 microversion: 2.20 time: 0.029274 Aug 04 03:51:48.569791 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 586/1168] 10.222.0.66 () {60 vars in 1277 bytes} [Thu Aug 4 03:51:48 2022] GET /compute/v2.1/servers/3bf41d49-2b84-4f59-a019-a8b1e45891d1 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 04 03:52:36.165188 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [req-5e6aa237-502d-4e14-83fa-4796e5fa0b41 req-6f2d64a6-60cf-4dea-8044-260d7b2dcdf3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c94175f-2d56-454e-a834-4f54bf9df739", "tag": "f138a127-97be-4818-9ebe-61a13e12b1e2"}]} {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 03:52:36.170140 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-29f84e97-e5e5-4762-ac56-e1e11074c554 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:52:36.171242 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-29f84e97-e5e5-4762-ac56-e1e11074c554 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] [instance: 9c94175f-2d56-454e-a834-4f54bf9df739] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:52:36.174026 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG dbcounter [-] [130262] Writing DB stats nova_api:SELECT=14,nova_api:DELETE=1 {{(pid=130262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:52:36.175451 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG dbcounter [-] [130262] Writing DB stats nova_cell1:SELECT=38,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:52:36.177102 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG dbcounter [-] [130263] Writing DB stats nova_api:SELECT=13 {{(pid=130263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:52:36.177355 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [req-5e6aa237-502d-4e14-83fa-4796e5fa0b41 req-6f2d64a6-60cf-4dea-8044-260d7b2dcdf3 service nova] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:52:36.177995 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [req-5e6aa237-502d-4e14-83fa-4796e5fa0b41 req-6f2d64a6-60cf-4dea-8044-260d7b2dcdf3 service nova] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:52:36.178132 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG dbcounter [-] [130263] Writing DB stats nova_cell1:SELECT=28 {{(pid=130263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:52:36.182078 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-29f84e97-e5e5-4762-ac56-e1e11074c554 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:52:36.184368 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-29f84e97-e5e5-4762-ac56-e1e11074c554 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:52:36.184368 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-29f84e97-e5e5-4762-ac56-e1e11074c554 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:52:36.184368 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-29f84e97-e5e5-4762-ac56-e1e11074c554 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:52:36.191512 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.compute.server_external_events [req-5e6aa237-502d-4e14-83fa-4796e5fa0b41 req-6f2d64a6-60cf-4dea-8044-260d7b2dcdf3 service nova] Creating event network-changed:f138a127-97be-4818-9ebe-61a13e12b1e2 for instance 9c94175f-2d56-454e-a834-4f54bf9df739 on hv-cinder-73306 Aug 04 03:52:36.199135 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [req-5e6aa237-502d-4e14-83fa-4796e5fa0b41 req-6f2d64a6-60cf-4dea-8044-260d7b2dcdf3 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037985 Aug 04 03:52:36.199737 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 587/1169] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 03:52:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 03:52:36.214160 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-29f84e97-e5e5-4762-ac56-e1e11074c554 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] [instance: 9c94175f-2d56-454e-a834-4f54bf9df739] Going to try to terminate instance {{(pid=130263) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 03:52:36.538192 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-29f84e97-e5e5-4762-ac56-e1e11074c554 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] 10.222.0.66 "DELETE /compute/v2.1/servers/9c94175f-2d56-454e-a834-4f54bf9df739" status: 204 len: 0 microversion: 2.1 time: 0.378633 Aug 04 03:52:36.539144 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 583/1170] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 03:52:36 2022] DELETE /compute/v2.1/servers/9c94175f-2d56-454e-a834-4f54bf9df739 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 03:52:36.552253 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-1077f6b9-8bba-43ec-bd89-71d076942871 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:52:36.553193 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-1077f6b9-8bba-43ec-bd89-71d076942871 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] [instance: 9c94175f-2d56-454e-a834-4f54bf9df739] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:52:36.561326 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-1077f6b9-8bba-43ec-bd89-71d076942871 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:52:36.562021 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-1077f6b9-8bba-43ec-bd89-71d076942871 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:52:36.563323 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-1077f6b9-8bba-43ec-bd89-71d076942871 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:52:36.564022 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-1077f6b9-8bba-43ec-bd89-71d076942871 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:52:36.722294 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-1077f6b9-8bba-43ec-bd89-71d076942871 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac48e585c133487dadbe0a1e095bfde0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32813adc26c64016b99c9c5fd838d391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:52:36.730634 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-1077f6b9-8bba-43ec-bd89-71d076942871 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] 10.222.0.66 "GET /compute/v2.1/servers/9c94175f-2d56-454e-a834-4f54bf9df739" status: 200 len: 1575 microversion: 2.1 time: 0.182730 Aug 04 03:52:36.731197 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 588/1171] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:52:36 2022] GET /compute/v2.1/servers/9c94175f-2d56-454e-a834-4f54bf9df739 => generated 1575 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:52:37.752106 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-5931a744-a1be-4ea2-8525-28c255d84089 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:52:37.752809 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-5931a744-a1be-4ea2-8525-28c255d84089 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] [instance: 9c94175f-2d56-454e-a834-4f54bf9df739] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:52:37.759430 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-5931a744-a1be-4ea2-8525-28c255d84089 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:52:37.759882 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-5931a744-a1be-4ea2-8525-28c255d84089 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:52:37.760645 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-5931a744-a1be-4ea2-8525-28c255d84089 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:52:37.761081 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-5931a744-a1be-4ea2-8525-28c255d84089 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:52:37.893720 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-5931a744-a1be-4ea2-8525-28c255d84089 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac48e585c133487dadbe0a1e095bfde0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32813adc26c64016b99c9c5fd838d391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:52:37.901377 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-5931a744-a1be-4ea2-8525-28c255d84089 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] 10.222.0.66 "GET /compute/v2.1/servers/9c94175f-2d56-454e-a834-4f54bf9df739" status: 200 len: 1456 microversion: 2.1 time: 0.153502 Aug 04 03:52:37.901966 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 584/1172] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:52:37 2022] GET /compute/v2.1/servers/9c94175f-2d56-454e-a834-4f54bf9df739 => generated 1456 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:52:38.922574 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-6b063ed2-a55f-43b8-940e-109d898f9b78 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:52:38.925445 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-6b063ed2-a55f-43b8-940e-109d898f9b78 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] [instance: 9c94175f-2d56-454e-a834-4f54bf9df739] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:52:38.933220 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-6b063ed2-a55f-43b8-940e-109d898f9b78 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:52:38.933702 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-6b063ed2-a55f-43b8-940e-109d898f9b78 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:52:38.934481 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-6b063ed2-a55f-43b8-940e-109d898f9b78 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:52:38.934929 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-6b063ed2-a55f-43b8-940e-109d898f9b78 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:52:39.011205 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-6b063ed2-a55f-43b8-940e-109d898f9b78 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac48e585c133487dadbe0a1e095bfde0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32813adc26c64016b99c9c5fd838d391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:52:39.014996 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [req-b60ee6d3-27d1-41e1-8b8b-1d691d2c46f7 req-ee16c527-995d-4cb0-8e6c-b9956feafdab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c94175f-2d56-454e-a834-4f54bf9df739", "name": "network-vif-deleted", "tag": "f138a127-97be-4818-9ebe-61a13e12b1e2"}]} {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 03:52:39.019773 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-6b063ed2-a55f-43b8-940e-109d898f9b78 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] 10.222.0.66 "GET /compute/v2.1/servers/9c94175f-2d56-454e-a834-4f54bf9df739" status: 200 len: 1389 microversion: 2.1 time: 0.101369 Aug 04 03:52:39.020556 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 589/1173] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:52:38 2022] GET /compute/v2.1/servers/9c94175f-2d56-454e-a834-4f54bf9df739 => generated 1389 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:52:39.025632 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [req-b60ee6d3-27d1-41e1-8b8b-1d691d2c46f7 req-ee16c527-995d-4cb0-8e6c-b9956feafdab service nova] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:52:39.026044 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [req-b60ee6d3-27d1-41e1-8b8b-1d691d2c46f7 req-ee16c527-995d-4cb0-8e6c-b9956feafdab service nova] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:52:39.036871 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.compute.server_external_events [req-b60ee6d3-27d1-41e1-8b8b-1d691d2c46f7 req-ee16c527-995d-4cb0-8e6c-b9956feafdab service nova] Creating event network-vif-deleted:f138a127-97be-4818-9ebe-61a13e12b1e2 for instance 9c94175f-2d56-454e-a834-4f54bf9df739 on hv-cinder-73306 Aug 04 03:52:39.042522 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [req-b60ee6d3-27d1-41e1-8b8b-1d691d2c46f7 req-ee16c527-995d-4cb0-8e6c-b9956feafdab service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031149 Aug 04 03:52:39.043104 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 585/1174] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 03:52:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 03:52:40.040423 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-20a0fa31-b1f9-439a-bd1e-6da1a660253c tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:52:40.041058 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-20a0fa31-b1f9-439a-bd1e-6da1a660253c tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] [instance: 9c94175f-2d56-454e-a834-4f54bf9df739] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:52:40.047484 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-20a0fa31-b1f9-439a-bd1e-6da1a660253c tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:52:40.047959 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-20a0fa31-b1f9-439a-bd1e-6da1a660253c tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:52:40.048719 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-20a0fa31-b1f9-439a-bd1e-6da1a660253c tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:52:40.049150 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-20a0fa31-b1f9-439a-bd1e-6da1a660253c tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:52:40.081321 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-20a0fa31-b1f9-439a-bd1e-6da1a660253c tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:52:40.081764 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-20a0fa31-b1f9-439a-bd1e-6da1a660253c tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:52:40.082213 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.objects.instance [None req-20a0fa31-b1f9-439a-bd1e-6da1a660253c tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lazy-loading 'fault' on Instance uuid 9c94175f-2d56-454e-a834-4f54bf9df739 {{(pid=130262) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 03:52:40.125689 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-20a0fa31-b1f9-439a-bd1e-6da1a660253c tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac48e585c133487dadbe0a1e095bfde0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32813adc26c64016b99c9c5fd838d391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:52:40.131794 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-20a0fa31-b1f9-439a-bd1e-6da1a660253c tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] 10.222.0.66 "GET /compute/v2.1/servers/9c94175f-2d56-454e-a834-4f54bf9df739" status: 200 len: 1229 microversion: 2.1 time: 0.095303 Aug 04 03:52:40.132387 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 590/1175] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:52:40 2022] GET /compute/v2.1/servers/9c94175f-2d56-454e-a834-4f54bf9df739 => generated 1229 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:52:41.157012 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-f22887bb-bb1e-4217-82ed-baa26045bba1 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:52:41.157784 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-f22887bb-bb1e-4217-82ed-baa26045bba1 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] [instance: 9c94175f-2d56-454e-a834-4f54bf9df739] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:52:41.164583 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-f22887bb-bb1e-4217-82ed-baa26045bba1 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:52:41.165043 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-f22887bb-bb1e-4217-82ed-baa26045bba1 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:52:41.165857 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-f22887bb-bb1e-4217-82ed-baa26045bba1 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:52:41.166309 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-f22887bb-bb1e-4217-82ed-baa26045bba1 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:52:41.180900 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.wsgi [None req-f22887bb-bb1e-4217-82ed-baa26045bba1 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] HTTP exception thrown: Instance 9c94175f-2d56-454e-a834-4f54bf9df739 could not be found. Aug 04 03:52:41.182586 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-f22887bb-bb1e-4217-82ed-baa26045bba1 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Request method failure captured: Aug 04 03:52:41.182586 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: request: GET /compute/v2.1/servers/9c94175f-2d56-454e-a834-4f54bf9df739 HTTP/1.1 Aug 04 03:52:41.182586 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Accept: application/json Aug 04 03:52:41.182586 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Accept-Encoding: identity Aug 04 03:52:41.182586 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Connection: close Aug 04 03:52:41.182586 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Content-Length: 0 Aug 04 03:52:41.182586 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Content-Type: application/json Aug 04 03:52:41.182586 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Host: 10.222.0.66 Aug 04 03:52:41.182586 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Openstack-System-Scope: None Aug 04 03:52:41.182586 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: User-Agent: python-urllib3/1.26.11 Aug 04 03:52:41.182586 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Auth-Token: gAAAAABi60AFF-wV8KTWO4eIZ97P_YfToxI7Zc8wk1Ll6AJptMYxHIRgKMY8RYQeg34D2Ep4--KnmrrLbBwKbOSHeJozvBoq6rPiXGsNCZLUOvhB94PYKPerNnuGns310VRY0tMD-AiqxinZNc3RewVLmHi_AQr9FFGEXLcupihluRXvsIMGG8Q Aug 04 03:52:41.182586 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Domain-Id: None Aug 04 03:52:41.182586 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Domain-Name: None Aug 04 03:52:41.182586 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Identity-Status: Confirmed Aug 04 03:52:41.182586 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Is-Admin-Project: True Aug 04 03:52:41.182586 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Project-Domain-Id: default Aug 04 03:52:41.182586 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Project-Domain-Name: Default Aug 04 03:52:41.182586 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Project-Id: 32813adc26c64016b99c9c5fd838d391 Aug 04 03:52:41.182586 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Project-Name: tempest-TestVolumeBootPattern-1823470116 Aug 04 03:52:41.182586 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Role: member,reader Aug 04 03:52:41.182586 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Roles: member,reader Aug 04 03:52:41.184368 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/32813adc26c64016b99c9c5fd838d391"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/32813adc26c64016b99c9c5fd838d391"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/32813adc26c64016b99c9c5fd838d391"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_32813adc26c64016b99c9c5fd838d391"}]}] Aug 04 03:52:41.184368 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Tenant: tempest-TestVolumeBootPattern-1823470116 Aug 04 03:52:41.184368 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Tenant-Id: 32813adc26c64016b99c9c5fd838d391 Aug 04 03:52:41.184368 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Tenant-Name: tempest-TestVolumeBootPattern-1823470116 Aug 04 03:52:41.184368 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-User: tempest-TestVolumeBootPattern-1823470116-project Aug 04 03:52:41.184368 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-User-Domain-Id: default Aug 04 03:52:41.184368 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-User-Domain-Name: Default Aug 04 03:52:41.184368 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-User-Id: ac48e585c133487dadbe0a1e095bfde0 Aug 04 03:52:41.184368 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-User-Name: tempest-TestVolumeBootPattern-1823470116-project Aug 04 03:52:41.184368 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: method: > Aug 04 03:52:41.184368 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: exception: Instance 9c94175f-2d56-454e-a834-4f54bf9df739 could not be found. Aug 04 03:52:41.184368 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: action_args: {'id': '9c94175f-2d56-454e-a834-4f54bf9df739'} Aug 04 03:52:41.185246 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 03:52:41.185246 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 03:52:41.185246 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 03:52:41.185246 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 03:52:41.185246 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 03:52:41.185246 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 03:52:41.185246 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 03:52:41.185246 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 03:52:41.185246 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 03:52:41.185246 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 03:52:41.185246 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c94175f-2d56-454e-a834-4f54bf9df739 could not be found. Aug 04 03:52:41.185246 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Aug 04 03:52:41.185246 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 03:52:41.185246 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Aug 04 03:52:41.185246 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 03:52:41.185246 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 03:52:41.185246 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 03:52:41.185246 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 03:52:41.185246 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 03:52:41.185246 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 03:52:41.186561 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 03:52:41.186561 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 03:52:41.186561 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 03:52:41.186561 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 03:52:41.186561 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 03:52:41.186561 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 03:52:41.186561 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 03:52:41.186561 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c94175f-2d56-454e-a834-4f54bf9df739 could not be found. Aug 04 03:52:41.186561 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Aug 04 03:52:41.186561 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 03:52:41.186561 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Aug 04 03:52:41.186561 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 03:52:41.186561 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 03:52:41.186561 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 03:52:41.186561 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 03:52:41.186561 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 03:52:41.186561 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c94175f-2d56-454e-a834-4f54bf9df739 could not be found. Aug 04 03:52:41.186561 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Aug 04 03:52:41.187694 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-f22887bb-bb1e-4217-82ed-baa26045bba1 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Returning 404 to user: Instance 9c94175f-2d56-454e-a834-4f54bf9df739 could not be found. {{(pid=130263) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 03:52:41.187694 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-f22887bb-bb1e-4217-82ed-baa26045bba1 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] 10.222.0.66 "GET /compute/v2.1/servers/9c94175f-2d56-454e-a834-4f54bf9df739" status: 404 len: 111 microversion: 2.1 time: 0.031765 Aug 04 03:52:41.187694 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 586/1176] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:52:41 2022] GET /compute/v2.1/servers/9c94175f-2d56-454e-a834-4f54bf9df739 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 03:52:44.484256 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-1e98219f-68d1-46d4-ae04-086b2cbd0d5a tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:52:44.485549 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-1e98219f-68d1-46d4-ae04-086b2cbd0d5a tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] [instance: 99218af9-c409-4074-bd4e-a3dff3731105] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:52:44.486264 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [req-07ef2ffd-85d9-4aa7-bfc2-cea4d7fc4736 req-2fe1e041-5bb9-4f63-b3bc-cdb1cb151bf3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99218af9-c409-4074-bd4e-a3dff3731105", "tag": "f4c20bb3-4881-4ace-8a51-334ca209dbbd"}]} {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 03:52:44.493805 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-1e98219f-68d1-46d4-ae04-086b2cbd0d5a tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:52:44.494612 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-1e98219f-68d1-46d4-ae04-086b2cbd0d5a tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:52:44.495719 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-1e98219f-68d1-46d4-ae04-086b2cbd0d5a tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:52:44.496386 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-1e98219f-68d1-46d4-ae04-086b2cbd0d5a tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:52:44.498063 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [req-07ef2ffd-85d9-4aa7-bfc2-cea4d7fc4736 req-2fe1e041-5bb9-4f63-b3bc-cdb1cb151bf3 service nova] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:52:44.498774 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [req-07ef2ffd-85d9-4aa7-bfc2-cea4d7fc4736 req-2fe1e041-5bb9-4f63-b3bc-cdb1cb151bf3 service nova] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:52:44.513833 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.compute.server_external_events [req-07ef2ffd-85d9-4aa7-bfc2-cea4d7fc4736 req-2fe1e041-5bb9-4f63-b3bc-cdb1cb151bf3 service nova] Creating event network-changed:f4c20bb3-4881-4ace-8a51-334ca209dbbd for instance 99218af9-c409-4074-bd4e-a3dff3731105 on hv-cinder-73306 Aug 04 03:52:44.519490 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [req-07ef2ffd-85d9-4aa7-bfc2-cea4d7fc4736 req-2fe1e041-5bb9-4f63-b3bc-cdb1cb151bf3 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036915 Aug 04 03:52:44.521383 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 587/1177] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 03:52:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 03:52:44.546507 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-1e98219f-68d1-46d4-ae04-086b2cbd0d5a tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] [instance: 99218af9-c409-4074-bd4e-a3dff3731105] Going to try to terminate instance {{(pid=130262) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 03:52:44.844585 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-1e98219f-68d1-46d4-ae04-086b2cbd0d5a tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] 10.222.0.66 "DELETE /compute/v2.1/servers/99218af9-c409-4074-bd4e-a3dff3731105" status: 204 len: 0 microversion: 2.1 time: 0.364713 Aug 04 03:52:44.845561 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 591/1178] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 03:52:44 2022] DELETE /compute/v2.1/servers/99218af9-c409-4074-bd4e-a3dff3731105 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 03:52:44.855360 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-84db70c4-da56-45a5-a0be-251e99f2a52a tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:52:44.856331 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-84db70c4-da56-45a5-a0be-251e99f2a52a tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] [instance: 99218af9-c409-4074-bd4e-a3dff3731105] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:52:44.863243 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-84db70c4-da56-45a5-a0be-251e99f2a52a tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:52:44.864107 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-84db70c4-da56-45a5-a0be-251e99f2a52a tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:52:44.865101 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-84db70c4-da56-45a5-a0be-251e99f2a52a tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:52:44.865802 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-84db70c4-da56-45a5-a0be-251e99f2a52a tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:52:45.022754 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-84db70c4-da56-45a5-a0be-251e99f2a52a tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac48e585c133487dadbe0a1e095bfde0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32813adc26c64016b99c9c5fd838d391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:52:45.030612 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-84db70c4-da56-45a5-a0be-251e99f2a52a tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] 10.222.0.66 "GET /compute/v2.1/servers/99218af9-c409-4074-bd4e-a3dff3731105" status: 200 len: 1574 microversion: 2.1 time: 0.180613 Aug 04 03:52:45.031385 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 588/1179] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:52:44 2022] GET /compute/v2.1/servers/99218af9-c409-4074-bd4e-a3dff3731105 => generated 1574 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:52:46.053127 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-cf72a1fc-ac0b-4624-9c3e-3d428332a86f tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:52:46.054090 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-cf72a1fc-ac0b-4624-9c3e-3d428332a86f tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] [instance: 99218af9-c409-4074-bd4e-a3dff3731105] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:52:46.061067 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-cf72a1fc-ac0b-4624-9c3e-3d428332a86f tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:52:46.061760 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-cf72a1fc-ac0b-4624-9c3e-3d428332a86f tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:52:46.062609 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-cf72a1fc-ac0b-4624-9c3e-3d428332a86f tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:52:46.063119 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-cf72a1fc-ac0b-4624-9c3e-3d428332a86f tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:52:46.154355 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-cf72a1fc-ac0b-4624-9c3e-3d428332a86f tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac48e585c133487dadbe0a1e095bfde0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32813adc26c64016b99c9c5fd838d391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:52:46.162087 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-cf72a1fc-ac0b-4624-9c3e-3d428332a86f tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] 10.222.0.66 "GET /compute/v2.1/servers/99218af9-c409-4074-bd4e-a3dff3731105" status: 200 len: 1389 microversion: 2.1 time: 0.113324 Aug 04 03:52:46.162876 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 592/1180] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:52:46 2022] GET /compute/v2.1/servers/99218af9-c409-4074-bd4e-a3dff3731105 => generated 1389 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:52:46.534680 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [req-4e1c798f-7084-4536-b087-a50348e04fa7 req-3ca49068-5cab-4441-a053-8694f995a3eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99218af9-c409-4074-bd4e-a3dff3731105", "name": "network-vif-deleted", "tag": "f4c20bb3-4881-4ace-8a51-334ca209dbbd"}]} {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 03:52:46.544691 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [req-4e1c798f-7084-4536-b087-a50348e04fa7 req-3ca49068-5cab-4441-a053-8694f995a3eb service nova] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:52:46.545137 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [req-4e1c798f-7084-4536-b087-a50348e04fa7 req-3ca49068-5cab-4441-a053-8694f995a3eb service nova] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:52:46.556179 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.compute.server_external_events [req-4e1c798f-7084-4536-b087-a50348e04fa7 req-3ca49068-5cab-4441-a053-8694f995a3eb service nova] Creating event network-vif-deleted:f4c20bb3-4881-4ace-8a51-334ca209dbbd for instance 99218af9-c409-4074-bd4e-a3dff3731105 on hv-cinder-73306 Aug 04 03:52:46.561094 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [req-4e1c798f-7084-4536-b087-a50348e04fa7 req-3ca49068-5cab-4441-a053-8694f995a3eb service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030023 Aug 04 03:52:46.561727 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 589/1181] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 03:52:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 03:52:47.184654 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-5cf261a9-75d9-4643-ac07-f5f093f391a7 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:52:47.185425 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-5cf261a9-75d9-4643-ac07-f5f093f391a7 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] [instance: 99218af9-c409-4074-bd4e-a3dff3731105] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:52:47.192409 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-5cf261a9-75d9-4643-ac07-f5f093f391a7 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:52:47.192926 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-5cf261a9-75d9-4643-ac07-f5f093f391a7 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:52:47.193729 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-5cf261a9-75d9-4643-ac07-f5f093f391a7 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:52:47.194347 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-5cf261a9-75d9-4643-ac07-f5f093f391a7 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:52:47.232117 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-5cf261a9-75d9-4643-ac07-f5f093f391a7 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:52:47.232638 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-5cf261a9-75d9-4643-ac07-f5f093f391a7 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:52:47.233247 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.objects.instance [None req-5cf261a9-75d9-4643-ac07-f5f093f391a7 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lazy-loading 'fault' on Instance uuid 99218af9-c409-4074-bd4e-a3dff3731105 {{(pid=130262) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 03:52:47.278816 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-5cf261a9-75d9-4643-ac07-f5f093f391a7 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac48e585c133487dadbe0a1e095bfde0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32813adc26c64016b99c9c5fd838d391', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:52:47.286440 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-5cf261a9-75d9-4643-ac07-f5f093f391a7 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] 10.222.0.66 "GET /compute/v2.1/servers/99218af9-c409-4074-bd4e-a3dff3731105" status: 200 len: 1229 microversion: 2.1 time: 0.106009 Aug 04 03:52:47.287016 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 593/1182] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:52:47 2022] GET /compute/v2.1/servers/99218af9-c409-4074-bd4e-a3dff3731105 => generated 1229 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:52:48.315046 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-c9599c4a-85f4-49ca-bca0-5e6e6d2e3e69 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:52:48.315774 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-c9599c4a-85f4-49ca-bca0-5e6e6d2e3e69 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] [instance: 99218af9-c409-4074-bd4e-a3dff3731105] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:52:48.322084 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-c9599c4a-85f4-49ca-bca0-5e6e6d2e3e69 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:52:48.322541 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-c9599c4a-85f4-49ca-bca0-5e6e6d2e3e69 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:52:48.323817 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-c9599c4a-85f4-49ca-bca0-5e6e6d2e3e69 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:52:48.324253 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-c9599c4a-85f4-49ca-bca0-5e6e6d2e3e69 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:52:48.337536 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.wsgi [None req-c9599c4a-85f4-49ca-bca0-5e6e6d2e3e69 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] HTTP exception thrown: Instance 99218af9-c409-4074-bd4e-a3dff3731105 could not be found. Aug 04 03:52:48.339804 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-c9599c4a-85f4-49ca-bca0-5e6e6d2e3e69 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Request method failure captured: Aug 04 03:52:48.339804 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: request: GET /compute/v2.1/servers/99218af9-c409-4074-bd4e-a3dff3731105 HTTP/1.1 Aug 04 03:52:48.339804 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Accept: application/json Aug 04 03:52:48.339804 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Accept-Encoding: identity Aug 04 03:52:48.339804 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Connection: close Aug 04 03:52:48.339804 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Content-Length: 0 Aug 04 03:52:48.339804 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Content-Type: application/json Aug 04 03:52:48.339804 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Host: 10.222.0.66 Aug 04 03:52:48.339804 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Openstack-System-Scope: None Aug 04 03:52:48.339804 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: User-Agent: python-urllib3/1.26.11 Aug 04 03:52:48.339804 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Auth-Token: gAAAAABi60AFF-wV8KTWO4eIZ97P_YfToxI7Zc8wk1Ll6AJptMYxHIRgKMY8RYQeg34D2Ep4--KnmrrLbBwKbOSHeJozvBoq6rPiXGsNCZLUOvhB94PYKPerNnuGns310VRY0tMD-AiqxinZNc3RewVLmHi_AQr9FFGEXLcupihluRXvsIMGG8Q Aug 04 03:52:48.339804 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Domain-Id: None Aug 04 03:52:48.339804 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Domain-Name: None Aug 04 03:52:48.339804 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Identity-Status: Confirmed Aug 04 03:52:48.339804 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Is-Admin-Project: True Aug 04 03:52:48.339804 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Project-Domain-Id: default Aug 04 03:52:48.339804 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Project-Domain-Name: Default Aug 04 03:52:48.339804 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Project-Id: 32813adc26c64016b99c9c5fd838d391 Aug 04 03:52:48.339804 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Project-Name: tempest-TestVolumeBootPattern-1823470116 Aug 04 03:52:48.339804 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Role: member,reader Aug 04 03:52:48.339804 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Roles: member,reader Aug 04 03:52:48.341265 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/32813adc26c64016b99c9c5fd838d391"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/32813adc26c64016b99c9c5fd838d391"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/32813adc26c64016b99c9c5fd838d391"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_32813adc26c64016b99c9c5fd838d391"}]}] Aug 04 03:52:48.341265 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Tenant: tempest-TestVolumeBootPattern-1823470116 Aug 04 03:52:48.341265 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Tenant-Id: 32813adc26c64016b99c9c5fd838d391 Aug 04 03:52:48.341265 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Tenant-Name: tempest-TestVolumeBootPattern-1823470116 Aug 04 03:52:48.341265 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-User: tempest-TestVolumeBootPattern-1823470116-project Aug 04 03:52:48.341265 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-User-Domain-Id: default Aug 04 03:52:48.341265 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-User-Domain-Name: Default Aug 04 03:52:48.341265 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-User-Id: ac48e585c133487dadbe0a1e095bfde0 Aug 04 03:52:48.341265 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-User-Name: tempest-TestVolumeBootPattern-1823470116-project Aug 04 03:52:48.341265 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: method: > Aug 04 03:52:48.341265 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: exception: Instance 99218af9-c409-4074-bd4e-a3dff3731105 could not be found. Aug 04 03:52:48.341265 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: action_args: {'id': '99218af9-c409-4074-bd4e-a3dff3731105'} Aug 04 03:52:48.342162 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 03:52:48.342162 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 03:52:48.342162 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 03:52:48.342162 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 03:52:48.342162 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 03:52:48.342162 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 03:52:48.342162 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 03:52:48.342162 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 03:52:48.342162 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 03:52:48.342162 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 03:52:48.342162 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 99218af9-c409-4074-bd4e-a3dff3731105 could not be found. Aug 04 03:52:48.342162 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Aug 04 03:52:48.342162 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 03:52:48.342162 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Aug 04 03:52:48.342162 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 03:52:48.342162 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 03:52:48.342162 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 03:52:48.342162 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 03:52:48.342162 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 03:52:48.342162 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 03:52:48.343597 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 03:52:48.343597 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 03:52:48.343597 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 03:52:48.343597 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 03:52:48.343597 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 03:52:48.343597 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 03:52:48.343597 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 03:52:48.343597 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99218af9-c409-4074-bd4e-a3dff3731105 could not be found. Aug 04 03:52:48.343597 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Aug 04 03:52:48.343597 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 03:52:48.343597 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Aug 04 03:52:48.343597 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 03:52:48.343597 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 03:52:48.343597 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 03:52:48.343597 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 03:52:48.343597 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 03:52:48.343597 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99218af9-c409-4074-bd4e-a3dff3731105 could not be found. Aug 04 03:52:48.343597 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Aug 04 03:52:48.344954 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-c9599c4a-85f4-49ca-bca0-5e6e6d2e3e69 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Returning 404 to user: Instance 99218af9-c409-4074-bd4e-a3dff3731105 could not be found. {{(pid=130263) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 03:52:48.344954 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-c9599c4a-85f4-49ca-bca0-5e6e6d2e3e69 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] 10.222.0.66 "GET /compute/v2.1/servers/99218af9-c409-4074-bd4e-a3dff3731105" status: 404 len: 111 microversion: 2.1 time: 0.030960 Aug 04 03:52:48.344954 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 590/1183] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:52:48 2022] GET /compute/v2.1/servers/99218af9-c409-4074-bd4e-a3dff3731105 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 03:52:48.858521 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-3072570a-da0b-469d-9fd0-5fb382b76cf5 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:52:48.859059 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-3072570a-da0b-469d-9fd0-5fb382b76cf5 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] [instance: eb7f2df0-7ac0-4253-a847-e0f797fa845c] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:52:48.865474 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-3072570a-da0b-469d-9fd0-5fb382b76cf5 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:52:48.865917 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-3072570a-da0b-469d-9fd0-5fb382b76cf5 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:52:48.866665 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-3072570a-da0b-469d-9fd0-5fb382b76cf5 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:52:48.867097 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-3072570a-da0b-469d-9fd0-5fb382b76cf5 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:52:48.880509 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.wsgi [None req-3072570a-da0b-469d-9fd0-5fb382b76cf5 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] HTTP exception thrown: Instance eb7f2df0-7ac0-4253-a847-e0f797fa845c could not be found. Aug 04 03:52:48.882227 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-3072570a-da0b-469d-9fd0-5fb382b76cf5 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Request method failure captured: Aug 04 03:52:48.882227 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: request: DELETE /compute/v2.1/servers/eb7f2df0-7ac0-4253-a847-e0f797fa845c HTTP/1.1 Aug 04 03:52:48.882227 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: Accept: application/json Aug 04 03:52:48.882227 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: Accept-Encoding: identity Aug 04 03:52:48.882227 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: Connection: close Aug 04 03:52:48.882227 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: Content-Length: 0 Aug 04 03:52:48.882227 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: Content-Type: application/json Aug 04 03:52:48.882227 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: Host: 10.222.0.66 Aug 04 03:52:48.882227 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: Openstack-System-Scope: None Aug 04 03:52:48.882227 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: User-Agent: python-urllib3/1.26.11 Aug 04 03:52:48.882227 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Auth-Token: gAAAAABi60AFF-wV8KTWO4eIZ97P_YfToxI7Zc8wk1Ll6AJptMYxHIRgKMY8RYQeg34D2Ep4--KnmrrLbBwKbOSHeJozvBoq6rPiXGsNCZLUOvhB94PYKPerNnuGns310VRY0tMD-AiqxinZNc3RewVLmHi_AQr9FFGEXLcupihluRXvsIMGG8Q Aug 04 03:52:48.882227 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Domain-Id: None Aug 04 03:52:48.882227 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Domain-Name: None Aug 04 03:52:48.882227 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Identity-Status: Confirmed Aug 04 03:52:48.882227 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Is-Admin-Project: True Aug 04 03:52:48.882227 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Project-Domain-Id: default Aug 04 03:52:48.882227 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Project-Domain-Name: Default Aug 04 03:52:48.882227 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Project-Id: 32813adc26c64016b99c9c5fd838d391 Aug 04 03:52:48.882227 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Project-Name: tempest-TestVolumeBootPattern-1823470116 Aug 04 03:52:48.882227 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Role: member,reader Aug 04 03:52:48.882227 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Roles: member,reader Aug 04 03:52:48.888618 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/32813adc26c64016b99c9c5fd838d391"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/32813adc26c64016b99c9c5fd838d391"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/32813adc26c64016b99c9c5fd838d391"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_32813adc26c64016b99c9c5fd838d391"}]}] Aug 04 03:52:48.888618 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Tenant: tempest-TestVolumeBootPattern-1823470116 Aug 04 03:52:48.888618 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Tenant-Id: 32813adc26c64016b99c9c5fd838d391 Aug 04 03:52:48.888618 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Tenant-Name: tempest-TestVolumeBootPattern-1823470116 Aug 04 03:52:48.888618 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-User: tempest-TestVolumeBootPattern-1823470116-project Aug 04 03:52:48.888618 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-User-Domain-Id: default Aug 04 03:52:48.888618 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-User-Domain-Name: Default Aug 04 03:52:48.888618 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-User-Id: ac48e585c133487dadbe0a1e095bfde0 Aug 04 03:52:48.888618 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-User-Name: tempest-TestVolumeBootPattern-1823470116-project Aug 04 03:52:48.888618 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: method: > Aug 04 03:52:48.888618 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: exception: Instance eb7f2df0-7ac0-4253-a847-e0f797fa845c could not be found. Aug 04 03:52:48.888618 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: action_args: {'id': 'eb7f2df0-7ac0-4253-a847-e0f797fa845c'} Aug 04 03:52:48.889896 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 03:52:48.889896 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 03:52:48.889896 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 03:52:48.889896 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 03:52:48.889896 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 03:52:48.889896 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 03:52:48.889896 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 03:52:48.889896 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 03:52:48.889896 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 03:52:48.889896 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 03:52:48.889896 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb7f2df0-7ac0-4253-a847-e0f797fa845c could not be found. Aug 04 03:52:48.889896 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi Aug 04 03:52:48.889896 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 03:52:48.889896 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi Aug 04 03:52:48.889896 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 03:52:48.889896 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 03:52:48.889896 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 03:52:48.889896 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 03:52:48.889896 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 03:52:48.889896 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 03:52:48.891521 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 03:52:48.891521 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 03:52:48.891521 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 03:52:48.891521 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 03:52:48.891521 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 03:52:48.891521 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 03:52:48.891521 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 03:52:48.891521 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 03:52:48.891521 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 03:52:48.891521 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb7f2df0-7ac0-4253-a847-e0f797fa845c could not be found. Aug 04 03:52:48.891521 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi Aug 04 03:52:48.891521 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 03:52:48.891521 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi Aug 04 03:52:48.891521 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 03:52:48.891521 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 03:52:48.891521 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 03:52:48.891521 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 03:52:48.891521 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 03:52:48.891521 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb7f2df0-7ac0-4253-a847-e0f797fa845c could not be found. Aug 04 03:52:48.891521 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi Aug 04 03:52:48.893291 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-3072570a-da0b-469d-9fd0-5fb382b76cf5 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Returning 404 to user: Instance eb7f2df0-7ac0-4253-a847-e0f797fa845c could not be found. {{(pid=130262) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 03:52:48.893291 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-3072570a-da0b-469d-9fd0-5fb382b76cf5 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] 10.222.0.66 "DELETE /compute/v2.1/servers/eb7f2df0-7ac0-4253-a847-e0f797fa845c" status: 404 len: 111 microversion: 2.1 time: 0.029452 Aug 04 03:52:48.893291 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 594/1184] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 03:52:48 2022] DELETE /compute/v2.1/servers/eb7f2df0-7ac0-4253-a847-e0f797fa845c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 03:52:48.894586 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-4f60b84a-7a62-4256-84d4-81f0670e9d34 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:52:48.895193 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-4f60b84a-7a62-4256-84d4-81f0670e9d34 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] [instance: eb7f2df0-7ac0-4253-a847-e0f797fa845c] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:52:48.901807 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-4f60b84a-7a62-4256-84d4-81f0670e9d34 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:52:48.902341 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-4f60b84a-7a62-4256-84d4-81f0670e9d34 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:52:48.903103 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-4f60b84a-7a62-4256-84d4-81f0670e9d34 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:52:48.903533 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-4f60b84a-7a62-4256-84d4-81f0670e9d34 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:52:48.919468 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.wsgi [None req-4f60b84a-7a62-4256-84d4-81f0670e9d34 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] HTTP exception thrown: Instance eb7f2df0-7ac0-4253-a847-e0f797fa845c could not be found. Aug 04 03:52:48.922030 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-4f60b84a-7a62-4256-84d4-81f0670e9d34 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Request method failure captured: Aug 04 03:52:48.922030 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: request: GET /compute/v2.1/servers/eb7f2df0-7ac0-4253-a847-e0f797fa845c HTTP/1.1 Aug 04 03:52:48.922030 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Accept: application/json Aug 04 03:52:48.922030 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Accept-Encoding: identity Aug 04 03:52:48.922030 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Connection: close Aug 04 03:52:48.922030 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Content-Length: 0 Aug 04 03:52:48.922030 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Content-Type: application/json Aug 04 03:52:48.922030 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Host: 10.222.0.66 Aug 04 03:52:48.922030 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Openstack-System-Scope: None Aug 04 03:52:48.922030 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: User-Agent: python-urllib3/1.26.11 Aug 04 03:52:48.922030 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Auth-Token: gAAAAABi60AFF-wV8KTWO4eIZ97P_YfToxI7Zc8wk1Ll6AJptMYxHIRgKMY8RYQeg34D2Ep4--KnmrrLbBwKbOSHeJozvBoq6rPiXGsNCZLUOvhB94PYKPerNnuGns310VRY0tMD-AiqxinZNc3RewVLmHi_AQr9FFGEXLcupihluRXvsIMGG8Q Aug 04 03:52:48.922030 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Domain-Id: None Aug 04 03:52:48.922030 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Domain-Name: None Aug 04 03:52:48.922030 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Identity-Status: Confirmed Aug 04 03:52:48.922030 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Is-Admin-Project: True Aug 04 03:52:48.922030 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Project-Domain-Id: default Aug 04 03:52:48.922030 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Project-Domain-Name: Default Aug 04 03:52:48.922030 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Project-Id: 32813adc26c64016b99c9c5fd838d391 Aug 04 03:52:48.922030 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Project-Name: tempest-TestVolumeBootPattern-1823470116 Aug 04 03:52:48.922030 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Role: member,reader Aug 04 03:52:48.922030 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Roles: member,reader Aug 04 03:52:48.923585 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/32813adc26c64016b99c9c5fd838d391"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/32813adc26c64016b99c9c5fd838d391"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/32813adc26c64016b99c9c5fd838d391"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_32813adc26c64016b99c9c5fd838d391"}]}] Aug 04 03:52:48.923585 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Tenant: tempest-TestVolumeBootPattern-1823470116 Aug 04 03:52:48.923585 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Tenant-Id: 32813adc26c64016b99c9c5fd838d391 Aug 04 03:52:48.923585 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Tenant-Name: tempest-TestVolumeBootPattern-1823470116 Aug 04 03:52:48.923585 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-User: tempest-TestVolumeBootPattern-1823470116-project Aug 04 03:52:48.923585 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-User-Domain-Id: default Aug 04 03:52:48.923585 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-User-Domain-Name: Default Aug 04 03:52:48.923585 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-User-Id: ac48e585c133487dadbe0a1e095bfde0 Aug 04 03:52:48.923585 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-User-Name: tempest-TestVolumeBootPattern-1823470116-project Aug 04 03:52:48.923585 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: method: > Aug 04 03:52:48.923585 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: exception: Instance eb7f2df0-7ac0-4253-a847-e0f797fa845c could not be found. Aug 04 03:52:48.923585 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: action_args: {'id': 'eb7f2df0-7ac0-4253-a847-e0f797fa845c'} Aug 04 03:52:48.924380 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 03:52:48.924380 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 03:52:48.924380 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 03:52:48.924380 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 03:52:48.924380 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 03:52:48.924380 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 03:52:48.924380 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 03:52:48.924380 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 03:52:48.924380 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 03:52:48.924380 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 03:52:48.924380 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb7f2df0-7ac0-4253-a847-e0f797fa845c could not be found. Aug 04 03:52:48.924380 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Aug 04 03:52:48.924380 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 03:52:48.924380 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Aug 04 03:52:48.924380 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 03:52:48.924380 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 03:52:48.924380 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 03:52:48.924380 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 03:52:48.924380 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 03:52:48.924380 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 03:52:48.925834 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 03:52:48.925834 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 03:52:48.925834 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 03:52:48.925834 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 03:52:48.925834 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 03:52:48.925834 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 03:52:48.925834 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 03:52:48.925834 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb7f2df0-7ac0-4253-a847-e0f797fa845c could not be found. Aug 04 03:52:48.925834 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Aug 04 03:52:48.925834 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 03:52:48.925834 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Aug 04 03:52:48.925834 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 03:52:48.925834 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 03:52:48.925834 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 03:52:48.925834 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 03:52:48.925834 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 03:52:48.925834 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb7f2df0-7ac0-4253-a847-e0f797fa845c could not be found. Aug 04 03:52:48.925834 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Aug 04 03:52:48.927567 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-4f60b84a-7a62-4256-84d4-81f0670e9d34 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Returning 404 to user: Instance eb7f2df0-7ac0-4253-a847-e0f797fa845c could not be found. {{(pid=130263) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 03:52:48.927567 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-4f60b84a-7a62-4256-84d4-81f0670e9d34 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] 10.222.0.66 "GET /compute/v2.1/servers/eb7f2df0-7ac0-4253-a847-e0f797fa845c" status: 404 len: 111 microversion: 2.1 time: 0.031758 Aug 04 03:52:48.927567 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 591/1185] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:52:48 2022] GET /compute/v2.1/servers/eb7f2df0-7ac0-4253-a847-e0f797fa845c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 03:52:50.415023 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-3912b5f8-b031-4a0e-9e39-eff271b52059 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] Calling method '.version_select at 0x7f72e84658b0>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:52:50.548952 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-3912b5f8-b031-4a0e-9e39-eff271b52059 tempest-TestVolumeBootPattern-1823470116 tempest-TestVolumeBootPattern-1823470116-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-908000990" status: 202 len: 0 microversion: 2.1 time: 0.137796 Aug 04 03:52:50.549564 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 595/1186] 10.222.0.66 () {58 vars in 1260 bytes} [Thu Aug 4 03:52:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-908000990 => generated 0 bytes in 139 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 03:53:06.297596 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-c871b494-d34d-4ac5-be72-4f1821797d2c tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:53:06.298202 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-c871b494-d34d-4ac5-be72-4f1821797d2c tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] [instance: 43706117-d608-45d0-87cf-1ad6774c77ce] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:53:06.300688 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG dbcounter [-] [130263] Writing DB stats nova_api:SELECT=23,nova_api:UPDATE=1 {{(pid=130263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:53:06.301373 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG dbcounter [-] [130263] Writing DB stats nova_cell1:SELECT=38,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:53:06.306088 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-c871b494-d34d-4ac5-be72-4f1821797d2c tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:53:06.306522 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-c871b494-d34d-4ac5-be72-4f1821797d2c tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:53:06.307276 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-c871b494-d34d-4ac5-be72-4f1821797d2c tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:53:06.307799 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-c871b494-d34d-4ac5-be72-4f1821797d2c tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:53:06.331424 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-c871b494-d34d-4ac5-be72-4f1821797d2c tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] 10.222.0.66 "GET /compute/v2.1/servers/43706117-d608-45d0-87cf-1ad6774c77ce/ips" status: 200 len: 150 microversion: 2.1 time: 0.038354 Aug 04 03:53:06.331987 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 592/1187] 10.222.0.66 () {58 vars in 1248 bytes} [Thu Aug 4 03:53:06 2022] GET /compute/v2.1/servers/43706117-d608-45d0-87cf-1ad6774c77ce/ips => generated 150 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 03:53:07.934575 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG dbcounter [-] [130262] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:53:07.935322 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG dbcounter [-] [130262] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=130262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:53:07.939968 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-59c57f27-f16b-43bf-81f0-159416c9234a tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ebaac22c-d440-4561-b7b6-52bc05cab0a4"}} {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 03:53:07.945428 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-59c57f27-f16b-43bf-81f0-159416c9234a tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] [instance: 43706117-d608-45d0-87cf-1ad6774c77ce] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:53:07.949119 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-59c57f27-f16b-43bf-81f0-159416c9234a tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:53:07.949604 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-59c57f27-f16b-43bf-81f0-159416c9234a tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:53:07.950374 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-59c57f27-f16b-43bf-81f0-159416c9234a tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:53:07.950858 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-59c57f27-f16b-43bf-81f0-159416c9234a tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:53:08.637194 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-59c57f27-f16b-43bf-81f0-159416c9234a tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] 10.222.0.66 "POST /compute/v2.1/servers/43706117-d608-45d0-87cf-1ad6774c77ce/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.703970 Aug 04 03:53:08.637822 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 596/1188] 10.222.0.66 () {60 vars in 1323 bytes} [Thu Aug 4 03:53:07 2022] POST /compute/v2.1/servers/43706117-d608-45d0-87cf-1ad6774c77ce/os-volume_attachments => generated 194 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 03:53:16.195937 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-0baa4989-7f45-4c4c-bd74-118e733c33f0 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ebaac22c-d440-4561-b7b6-52bc05cab0a4"}} {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 03:53:16.198305 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-0baa4989-7f45-4c4c-bd74-118e733c33f0 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] [instance: 43706117-d608-45d0-87cf-1ad6774c77ce] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:53:16.206139 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-0baa4989-7f45-4c4c-bd74-118e733c33f0 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:53:16.206587 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-0baa4989-7f45-4c4c-bd74-118e733c33f0 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:53:16.207351 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-0baa4989-7f45-4c4c-bd74-118e733c33f0 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:53:16.207788 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-0baa4989-7f45-4c4c-bd74-118e733c33f0 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:53:16.286963 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.wsgi [None req-0baa4989-7f45-4c4c-bd74-118e733c33f0 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] HTTP exception thrown: Invalid volume: volume ebaac22c-d440-4561-b7b6-52bc05cab0a4 is already attached to instances: 43706117-d608-45d0-87cf-1ad6774c77ce Aug 04 03:53:16.291772 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-0baa4989-7f45-4c4c-bd74-118e733c33f0 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Request method failure captured: Aug 04 03:53:16.291772 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: request: POST /compute/v2.1/servers/43706117-d608-45d0-87cf-1ad6774c77ce/os-volume_attachments HTTP/1.1 Aug 04 03:53:16.291772 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Accept: application/json Aug 04 03:53:16.291772 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Accept-Encoding: identity Aug 04 03:53:16.291772 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Connection: close Aug 04 03:53:16.291772 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Content-Length: 74 Aug 04 03:53:16.291772 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Content-Type: application/json Aug 04 03:53:16.291772 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Host: 10.222.0.66 Aug 04 03:53:16.291772 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Openstack-System-Scope: None Aug 04 03:53:16.291772 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: User-Agent: python-urllib3/1.26.11 Aug 04 03:53:16.291772 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Auth-Token: gAAAAABi60EfWo3pxV-WJerz4CV7aLU5sNdQOAjcWGxLQyzzVpQzfisgkZYPF0-VvjdP-4fhqH1P-iVrAYypOKaXop8hglb2CP9bQQNfaUgJfvrw6-mu2g-Bmn1rv5G9df81SkEqY2jauM8WPz4gyORIa-0zWCQz6JGM7HOO6Cyykhfv5KFcQRY Aug 04 03:53:16.291772 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Domain-Id: None Aug 04 03:53:16.291772 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Domain-Name: None Aug 04 03:53:16.291772 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Identity-Status: Confirmed Aug 04 03:53:16.291772 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Is-Admin-Project: True Aug 04 03:53:16.291772 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Project-Domain-Id: default Aug 04 03:53:16.291772 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Project-Domain-Name: Default Aug 04 03:53:16.291772 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Project-Id: a98f18ee8c7d4cfe9f4b879505ca6605 Aug 04 03:53:16.291772 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Project-Name: tempest-AttachVolumeNegativeTest-1888469620 Aug 04 03:53:16.291772 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Role: member,reader Aug 04 03:53:16.291772 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Roles: member,reader Aug 04 03:53:16.293453 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/a98f18ee8c7d4cfe9f4b879505ca6605"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/a98f18ee8c7d4cfe9f4b879505ca6605"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/a98f18ee8c7d4cfe9f4b879505ca6605"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_a98f18ee8c7d4cfe9f4b879505ca6605"}]}] Aug 04 03:53:16.293453 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Tenant: tempest-AttachVolumeNegativeTest-1888469620 Aug 04 03:53:16.293453 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Tenant-Id: a98f18ee8c7d4cfe9f4b879505ca6605 Aug 04 03:53:16.293453 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1888469620 Aug 04 03:53:16.293453 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-User: tempest-AttachVolumeNegativeTest-1888469620-project Aug 04 03:53:16.293453 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-User-Domain-Id: default Aug 04 03:53:16.293453 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-User-Domain-Name: Default Aug 04 03:53:16.293453 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-User-Id: ac99f60384fe4a119d019cedfe1d3557 Aug 04 03:53:16.293453 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-User-Name: tempest-AttachVolumeNegativeTest-1888469620-project Aug 04 03:53:16.293453 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Aug 04 03:53:16.293453 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: {"volumeAttachment": {"volumeId": "ebaac22c-d440-4561-b7b6-52bc05cab0a4"}} Aug 04 03:53:16.293453 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: method: > Aug 04 03:53:16.294392 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: exception: Invalid volume: volume ebaac22c-d440-4561-b7b6-52bc05cab0a4 is already attached to instances: 43706117-d608-45d0-87cf-1ad6774c77ce Aug 04 03:53:16.294392 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: action_args: {'server_id': '43706117-d608-45d0-87cf-1ad6774c77ce', 'body': {'volumeAttachment': {'volumeId': 'ebaac22c-d440-4561-b7b6-52bc05cab0a4'}}} Aug 04 03:53:16.294392 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 03:53:16.294392 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 03:53:16.294392 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 04 03:53:16.294392 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 04 03:53:16.294392 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 04 03:53:16.294392 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 04 03:53:16.294392 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 04 03:53:16.294392 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 04 03:53:16.294392 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5066, in attach_volume Aug 04 03:53:16.294392 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 04 03:53:16.294392 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4906, in _check_volume_already_attached Aug 04 03:53:16.294392 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 04 03:53:16.294392 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume ebaac22c-d440-4561-b7b6-52bc05cab0a4 is already attached to instances: 43706117-d608-45d0-87cf-1ad6774c77ce Aug 04 03:53:16.294392 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Aug 04 03:53:16.294392 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 03:53:16.294392 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Aug 04 03:53:16.294392 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 03:53:16.296455 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 03:53:16.296455 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 03:53:16.296455 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 03:53:16.296455 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 03:53:16.296455 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 03:53:16.296455 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 03:53:16.296455 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 03:53:16.296455 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 03:53:16.296455 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 03:53:16.296455 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 03:53:16.296455 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 04 03:53:16.296455 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 04 03:53:16.296455 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 04 03:53:16.296455 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 04 03:53:16.296455 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume ebaac22c-d440-4561-b7b6-52bc05cab0a4 is already attached to instances: 43706117-d608-45d0-87cf-1ad6774c77ce Aug 04 03:53:16.296455 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Aug 04 03:53:16.296455 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 03:53:16.296455 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Aug 04 03:53:16.296455 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 03:53:16.296455 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 03:53:16.298144 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 03:53:16.298144 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 03:53:16.298144 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 03:53:16.298144 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume ebaac22c-d440-4561-b7b6-52bc05cab0a4 is already attached to instances: 43706117-d608-45d0-87cf-1ad6774c77ce Aug 04 03:53:16.298144 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Aug 04 03:53:16.298144 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-0baa4989-7f45-4c4c-bd74-118e733c33f0 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Returning 400 to user: Invalid volume: volume ebaac22c-d440-4561-b7b6-52bc05cab0a4 is already attached to instances: 43706117-d608-45d0-87cf-1ad6774c77ce {{(pid=130263) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 03:53:16.298144 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-0baa4989-7f45-4c4c-bd74-118e733c33f0 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] 10.222.0.66 "POST /compute/v2.1/servers/43706117-d608-45d0-87cf-1ad6774c77ce/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.098697 Aug 04 03:53:16.298144 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 593/1189] 10.222.0.66 () {60 vars in 1323 bytes} [Thu Aug 4 03:53:16 2022] POST /compute/v2.1/servers/43706117-d608-45d0-87cf-1ad6774c77ce/os-volume_attachments => generated 174 bytes in 100 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 04 03:53:16.363885 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-7bdcbcee-b191-416d-abe7-79270279ee0d tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:53:16.364451 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-7bdcbcee-b191-416d-abe7-79270279ee0d tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] [instance: 43706117-d608-45d0-87cf-1ad6774c77ce] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:53:16.370818 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-7bdcbcee-b191-416d-abe7-79270279ee0d tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:53:16.371263 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-7bdcbcee-b191-416d-abe7-79270279ee0d tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:53:16.372027 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-7bdcbcee-b191-416d-abe7-79270279ee0d tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:53:16.372460 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-7bdcbcee-b191-416d-abe7-79270279ee0d tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:53:16.458517 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.objects.instance [None req-7bdcbcee-b191-416d-abe7-79270279ee0d tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lazy-loading 'services' on Instance uuid 43706117-d608-45d0-87cf-1ad6774c77ce {{(pid=130262) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 03:53:16.633265 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-7bdcbcee-b191-416d-abe7-79270279ee0d tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] 10.222.0.66 "DELETE /compute/v2.1/servers/43706117-d608-45d0-87cf-1ad6774c77ce/os-volume_attachments/ebaac22c-d440-4561-b7b6-52bc05cab0a4" status: 202 len: 0 microversion: 2.1 time: 0.274529 Aug 04 03:53:16.633863 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 597/1190] 10.222.0.66 () {58 vars in 1416 bytes} [Thu Aug 4 03:53:16 2022] DELETE /compute/v2.1/servers/43706117-d608-45d0-87cf-1ad6774c77ce/os-volume_attachments/ebaac22c-d440-4561-b7b6-52bc05cab0a4 => generated 0 bytes in 276 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 03:53:16.642837 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-bd7238fe-0ec3-4279-b28b-bfdacd06344f tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:53:16.647642 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-bd7238fe-0ec3-4279-b28b-bfdacd06344f tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] [instance: 43706117-d608-45d0-87cf-1ad6774c77ce] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:53:16.652235 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-bd7238fe-0ec3-4279-b28b-bfdacd06344f tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:53:16.652688 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-bd7238fe-0ec3-4279-b28b-bfdacd06344f tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:53:16.653534 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-bd7238fe-0ec3-4279-b28b-bfdacd06344f tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:53:16.653971 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-bd7238fe-0ec3-4279-b28b-bfdacd06344f tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:53:16.685917 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-bd7238fe-0ec3-4279-b28b-bfdacd06344f tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] 10.222.0.66 "GET /compute/v2.1/servers/43706117-d608-45d0-87cf-1ad6774c77ce/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047471 Aug 04 03:53:16.688484 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 594/1191] 10.222.0.66 () {58 vars in 1302 bytes} [Thu Aug 4 03:53:16 2022] GET /compute/v2.1/servers/43706117-d608-45d0-87cf-1ad6774c77ce/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 03:53:17.699806 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-b0bf19e3-e654-4309-9ab8-fd5811b69577 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:53:17.702151 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-b0bf19e3-e654-4309-9ab8-fd5811b69577 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] [instance: 43706117-d608-45d0-87cf-1ad6774c77ce] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:53:17.709946 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-b0bf19e3-e654-4309-9ab8-fd5811b69577 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:53:17.710587 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-b0bf19e3-e654-4309-9ab8-fd5811b69577 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:53:17.711692 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-b0bf19e3-e654-4309-9ab8-fd5811b69577 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:53:17.712373 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-b0bf19e3-e654-4309-9ab8-fd5811b69577 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:53:17.742764 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-b0bf19e3-e654-4309-9ab8-fd5811b69577 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] 10.222.0.66 "GET /compute/v2.1/servers/43706117-d608-45d0-87cf-1ad6774c77ce/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047795 Aug 04 03:53:17.743215 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 598/1192] 10.222.0.66 () {58 vars in 1302 bytes} [Thu Aug 4 03:53:17 2022] GET /compute/v2.1/servers/43706117-d608-45d0-87cf-1ad6774c77ce/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 03:53:17.807025 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-9dc5d741-ea6e-4631-a9c9-8d6b520764bb tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:53:17.807573 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-9dc5d741-ea6e-4631-a9c9-8d6b520764bb tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] [instance: 43706117-d608-45d0-87cf-1ad6774c77ce] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:53:17.814094 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-9dc5d741-ea6e-4631-a9c9-8d6b520764bb tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:53:17.815129 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-9dc5d741-ea6e-4631-a9c9-8d6b520764bb tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:53:17.815889 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-9dc5d741-ea6e-4631-a9c9-8d6b520764bb tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:53:17.816325 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-9dc5d741-ea6e-4631-a9c9-8d6b520764bb tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:53:17.842476 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-9dc5d741-ea6e-4631-a9c9-8d6b520764bb tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] [instance: 43706117-d608-45d0-87cf-1ad6774c77ce] Going to try to terminate instance {{(pid=130263) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 03:53:18.119053 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-9dc5d741-ea6e-4631-a9c9-8d6b520764bb tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] 10.222.0.66 "DELETE /compute/v2.1/servers/43706117-d608-45d0-87cf-1ad6774c77ce" status: 204 len: 0 microversion: 2.1 time: 0.315528 Aug 04 03:53:18.119637 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 595/1193] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 03:53:17 2022] DELETE /compute/v2.1/servers/43706117-d608-45d0-87cf-1ad6774c77ce => generated 0 bytes in 317 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 03:53:18.128876 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-a8ce0e63-4943-4865-af5f-0b1df0aefa0d tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:53:18.129689 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-a8ce0e63-4943-4865-af5f-0b1df0aefa0d tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] [instance: 43706117-d608-45d0-87cf-1ad6774c77ce] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:53:18.136265 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-a8ce0e63-4943-4865-af5f-0b1df0aefa0d tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:53:18.136811 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-a8ce0e63-4943-4865-af5f-0b1df0aefa0d tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:53:18.137715 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-a8ce0e63-4943-4865-af5f-0b1df0aefa0d tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:53:18.138213 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-a8ce0e63-4943-4865-af5f-0b1df0aefa0d tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:53:18.278296 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-a8ce0e63-4943-4865-af5f-0b1df0aefa0d tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac99f60384fe4a119d019cedfe1d3557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f18ee8c7d4cfe9f4b879505ca6605', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:53:18.286953 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-a8ce0e63-4943-4865-af5f-0b1df0aefa0d tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] 10.222.0.66 "GET /compute/v2.1/servers/43706117-d608-45d0-87cf-1ad6774c77ce" status: 200 len: 1681 microversion: 2.1 time: 0.162430 Aug 04 03:53:18.287525 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 599/1194] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:53:18 2022] GET /compute/v2.1/servers/43706117-d608-45d0-87cf-1ad6774c77ce => generated 1681 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:53:19.310170 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-489416b9-754f-415e-be1c-c5087245a7f2 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:53:19.310874 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-489416b9-754f-415e-be1c-c5087245a7f2 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] [instance: 43706117-d608-45d0-87cf-1ad6774c77ce] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:53:19.317670 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-489416b9-754f-415e-be1c-c5087245a7f2 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:53:19.318126 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-489416b9-754f-415e-be1c-c5087245a7f2 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:53:19.318891 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-489416b9-754f-415e-be1c-c5087245a7f2 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:53:19.319328 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-489416b9-754f-415e-be1c-c5087245a7f2 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:53:19.461629 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-489416b9-754f-415e-be1c-c5087245a7f2 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac99f60384fe4a119d019cedfe1d3557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f18ee8c7d4cfe9f4b879505ca6605', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:53:19.469079 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-489416b9-754f-415e-be1c-c5087245a7f2 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] 10.222.0.66 "GET /compute/v2.1/servers/43706117-d608-45d0-87cf-1ad6774c77ce" status: 200 len: 1681 microversion: 2.1 time: 0.163449 Aug 04 03:53:19.469666 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 596/1195] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:53:19 2022] GET /compute/v2.1/servers/43706117-d608-45d0-87cf-1ad6774c77ce => generated 1681 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:53:20.492642 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-f934d0fc-4772-411b-a066-b94103a3eb1a tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:53:20.494264 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-f934d0fc-4772-411b-a066-b94103a3eb1a tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] [instance: 43706117-d608-45d0-87cf-1ad6774c77ce] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:53:20.501041 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-f934d0fc-4772-411b-a066-b94103a3eb1a tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:53:20.501530 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-f934d0fc-4772-411b-a066-b94103a3eb1a tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:53:20.502489 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-f934d0fc-4772-411b-a066-b94103a3eb1a tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:53:20.502929 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-f934d0fc-4772-411b-a066-b94103a3eb1a tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:53:20.639835 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-f934d0fc-4772-411b-a066-b94103a3eb1a tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac99f60384fe4a119d019cedfe1d3557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f18ee8c7d4cfe9f4b879505ca6605', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:53:20.648149 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-f934d0fc-4772-411b-a066-b94103a3eb1a tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] 10.222.0.66 "GET /compute/v2.1/servers/43706117-d608-45d0-87cf-1ad6774c77ce" status: 200 len: 1681 microversion: 2.1 time: 0.159455 Aug 04 03:53:20.648872 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 600/1196] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:53:20 2022] GET /compute/v2.1/servers/43706117-d608-45d0-87cf-1ad6774c77ce => generated 1681 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:53:20.989718 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [req-5be1a7f4-eb66-41cc-9484-b9e188c62bf6 req-3a1b16da-ef11-4fb2-861e-bee4e8090bce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43706117-d608-45d0-87cf-1ad6774c77ce", "name": "network-vif-deleted", "tag": "83d43a55-4b64-465b-9c04-5ce731a9f525"}]} {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 03:53:20.999879 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [req-5be1a7f4-eb66-41cc-9484-b9e188c62bf6 req-3a1b16da-ef11-4fb2-861e-bee4e8090bce service nova] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:53:21.000324 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [req-5be1a7f4-eb66-41cc-9484-b9e188c62bf6 req-3a1b16da-ef11-4fb2-861e-bee4e8090bce service nova] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:53:21.013137 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.compute.server_external_events [req-5be1a7f4-eb66-41cc-9484-b9e188c62bf6 req-3a1b16da-ef11-4fb2-861e-bee4e8090bce service nova] Creating event network-vif-deleted:83d43a55-4b64-465b-9c04-5ce731a9f525 for instance 43706117-d608-45d0-87cf-1ad6774c77ce on hv-cinder-73306 Aug 04 03:53:21.018872 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [req-5be1a7f4-eb66-41cc-9484-b9e188c62bf6 req-3a1b16da-ef11-4fb2-861e-bee4e8090bce service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032903 Aug 04 03:53:21.019487 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 597/1197] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 03:53:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 03:53:21.676721 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-11177be6-7674-475b-b018-532c191b99e9 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:53:21.677364 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-11177be6-7674-475b-b018-532c191b99e9 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] [instance: 43706117-d608-45d0-87cf-1ad6774c77ce] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:53:21.683769 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-11177be6-7674-475b-b018-532c191b99e9 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:53:21.684223 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-11177be6-7674-475b-b018-532c191b99e9 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:53:21.684985 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-11177be6-7674-475b-b018-532c191b99e9 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:53:21.685483 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-11177be6-7674-475b-b018-532c191b99e9 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:53:21.717467 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-11177be6-7674-475b-b018-532c191b99e9 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:53:21.717921 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-11177be6-7674-475b-b018-532c191b99e9 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:53:21.718382 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.objects.instance [None req-11177be6-7674-475b-b018-532c191b99e9 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lazy-loading 'fault' on Instance uuid 43706117-d608-45d0-87cf-1ad6774c77ce {{(pid=130262) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 03:53:21.762775 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-11177be6-7674-475b-b018-532c191b99e9 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac99f60384fe4a119d019cedfe1d3557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f18ee8c7d4cfe9f4b879505ca6605', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:53:21.770587 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-11177be6-7674-475b-b018-532c191b99e9 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] 10.222.0.66 "GET /compute/v2.1/servers/43706117-d608-45d0-87cf-1ad6774c77ce" status: 200 len: 1332 microversion: 2.1 time: 0.099345 Aug 04 03:53:21.771150 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 601/1198] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:53:21 2022] GET /compute/v2.1/servers/43706117-d608-45d0-87cf-1ad6774c77ce => generated 1332 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:53:22.792568 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-50813b55-6265-4a4a-bc37-d62888fed7c3 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:53:22.793295 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-50813b55-6265-4a4a-bc37-d62888fed7c3 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] [instance: 43706117-d608-45d0-87cf-1ad6774c77ce] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:53:22.800177 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-50813b55-6265-4a4a-bc37-d62888fed7c3 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:53:22.800630 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-50813b55-6265-4a4a-bc37-d62888fed7c3 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:53:22.801461 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-50813b55-6265-4a4a-bc37-d62888fed7c3 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:53:22.801888 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-50813b55-6265-4a4a-bc37-d62888fed7c3 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:53:22.816045 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.wsgi [None req-50813b55-6265-4a4a-bc37-d62888fed7c3 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] HTTP exception thrown: Instance 43706117-d608-45d0-87cf-1ad6774c77ce could not be found. Aug 04 03:53:22.817704 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-50813b55-6265-4a4a-bc37-d62888fed7c3 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Request method failure captured: Aug 04 03:53:22.817704 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: request: GET /compute/v2.1/servers/43706117-d608-45d0-87cf-1ad6774c77ce HTTP/1.1 Aug 04 03:53:22.817704 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Accept: application/json Aug 04 03:53:22.817704 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Accept-Encoding: identity Aug 04 03:53:22.817704 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Connection: close Aug 04 03:53:22.817704 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Content-Length: 0 Aug 04 03:53:22.817704 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Content-Type: application/json Aug 04 03:53:22.817704 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Host: 10.222.0.66 Aug 04 03:53:22.817704 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Openstack-System-Scope: None Aug 04 03:53:22.817704 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: User-Agent: python-urllib3/1.26.11 Aug 04 03:53:22.817704 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Auth-Token: gAAAAABi60EfWo3pxV-WJerz4CV7aLU5sNdQOAjcWGxLQyzzVpQzfisgkZYPF0-VvjdP-4fhqH1P-iVrAYypOKaXop8hglb2CP9bQQNfaUgJfvrw6-mu2g-Bmn1rv5G9df81SkEqY2jauM8WPz4gyORIa-0zWCQz6JGM7HOO6Cyykhfv5KFcQRY Aug 04 03:53:22.817704 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Domain-Id: None Aug 04 03:53:22.817704 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Domain-Name: None Aug 04 03:53:22.817704 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Identity-Status: Confirmed Aug 04 03:53:22.817704 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Is-Admin-Project: True Aug 04 03:53:22.817704 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Project-Domain-Id: default Aug 04 03:53:22.817704 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Project-Domain-Name: Default Aug 04 03:53:22.817704 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Project-Id: a98f18ee8c7d4cfe9f4b879505ca6605 Aug 04 03:53:22.817704 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Project-Name: tempest-AttachVolumeNegativeTest-1888469620 Aug 04 03:53:22.817704 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Role: member,reader Aug 04 03:53:22.817704 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Roles: member,reader Aug 04 03:53:22.819302 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/a98f18ee8c7d4cfe9f4b879505ca6605"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/a98f18ee8c7d4cfe9f4b879505ca6605"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/a98f18ee8c7d4cfe9f4b879505ca6605"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_a98f18ee8c7d4cfe9f4b879505ca6605"}]}] Aug 04 03:53:22.819302 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Tenant: tempest-AttachVolumeNegativeTest-1888469620 Aug 04 03:53:22.819302 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Tenant-Id: a98f18ee8c7d4cfe9f4b879505ca6605 Aug 04 03:53:22.819302 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1888469620 Aug 04 03:53:22.819302 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-User: tempest-AttachVolumeNegativeTest-1888469620-project Aug 04 03:53:22.819302 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-User-Domain-Id: default Aug 04 03:53:22.819302 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-User-Domain-Name: Default Aug 04 03:53:22.819302 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-User-Id: ac99f60384fe4a119d019cedfe1d3557 Aug 04 03:53:22.819302 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-User-Name: tempest-AttachVolumeNegativeTest-1888469620-project Aug 04 03:53:22.819302 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: method: > Aug 04 03:53:22.819302 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: exception: Instance 43706117-d608-45d0-87cf-1ad6774c77ce could not be found. Aug 04 03:53:22.819302 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: action_args: {'id': '43706117-d608-45d0-87cf-1ad6774c77ce'} Aug 04 03:53:22.820194 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 03:53:22.820194 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 03:53:22.820194 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 03:53:22.820194 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 03:53:22.820194 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 03:53:22.820194 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 03:53:22.820194 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 03:53:22.820194 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 03:53:22.820194 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 03:53:22.820194 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 03:53:22.820194 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43706117-d608-45d0-87cf-1ad6774c77ce could not be found. Aug 04 03:53:22.820194 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Aug 04 03:53:22.820194 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 03:53:22.820194 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Aug 04 03:53:22.820194 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 03:53:22.820194 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 03:53:22.820194 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 03:53:22.820194 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 03:53:22.820194 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 03:53:22.820194 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 03:53:22.821769 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 03:53:22.821769 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 03:53:22.821769 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 03:53:22.821769 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 03:53:22.821769 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 03:53:22.821769 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 03:53:22.821769 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 03:53:22.821769 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43706117-d608-45d0-87cf-1ad6774c77ce could not be found. Aug 04 03:53:22.821769 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Aug 04 03:53:22.821769 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 03:53:22.821769 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Aug 04 03:53:22.821769 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 03:53:22.821769 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 03:53:22.821769 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 03:53:22.821769 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 03:53:22.821769 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 03:53:22.821769 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43706117-d608-45d0-87cf-1ad6774c77ce could not be found. Aug 04 03:53:22.821769 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Aug 04 03:53:22.823294 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-50813b55-6265-4a4a-bc37-d62888fed7c3 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Returning 404 to user: Instance 43706117-d608-45d0-87cf-1ad6774c77ce could not be found. {{(pid=130263) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 03:53:22.823294 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-50813b55-6265-4a4a-bc37-d62888fed7c3 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] 10.222.0.66 "GET /compute/v2.1/servers/43706117-d608-45d0-87cf-1ad6774c77ce" status: 404 len: 111 microversion: 2.1 time: 0.031456 Aug 04 03:53:22.823294 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 598/1199] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:53:22 2022] GET /compute/v2.1/servers/43706117-d608-45d0-87cf-1ad6774c77ce => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 03:53:22.828010 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-0393c0ac-caf1-4cbe-acdf-1509d9c63d91 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Calling method '.version_select at 0x7f72e806c040>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:53:22.943236 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-0393c0ac-caf1-4cbe-acdf-1509d9c63d91 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1244584001" status: 202 len: 0 microversion: 2.1 time: 0.118954 Aug 04 03:53:22.943818 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 602/1200] 10.222.0.66 () {58 vars in 1221 bytes} [Thu Aug 4 03:53:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1244584001 => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 03:53:23.760059 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-4b114e0c-7691-45e3-8373-e5dd586cb935 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Action: 'create', calling method: .version_select at 0x7f72e8142820>, body: {"keypair": {"name": "tempest-keypair-1734149132", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJhSoSNOepDyKF90eS7+4aN7up+XvCeehrnrwJ1Bs7cHsKFgwBb5kbAKpmAsvuiZDjDKlW3WyI882KdyiyDw16U5hhTr7F3sKc4fKHb0OUEhhwYPXnbRoaZOI2JABwTtHw=="}} {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 03:53:23.776325 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.quota [None req-4b114e0c-7691-45e3-8373-e5dd586cb935 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Getting quotas for project a98f18ee8c7d4cfe9f4b879505ca6605. Resources: {'key_pairs'} {{(pid=130263) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 03:53:23.780307 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.quota [None req-4b114e0c-7691-45e3-8373-e5dd586cb935 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Getting quotas for user ac99f60384fe4a119d019cedfe1d3557 and project a98f18ee8c7d4cfe9f4b879505ca6605. Resources: {'key_pairs'} {{(pid=130263) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 03:53:23.891673 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-4b114e0c-7691-45e3-8373-e5dd586cb935 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] 10.222.0.66 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.135300 Aug 04 03:53:23.893403 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 599/1201] 10.222.0.66 () {60 vars in 1159 bytes} [Thu Aug 4 03:53:23 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 03:53:25.983241 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-c0dbe22b-8bb9-4bad-951a-587e21c98dc1 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-201536898", "imageRef": "0208f4b3-1d2f-42e4-a9b4-528bf5066fe1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9a7b7e8a-baf9-483b-925f-a5723b52bbe6"}], "security_groups": [{"name": "tempest-securitygroup--1226182564"}], "key_name": "tempest-keypair-1734149132", "user_data": "}} {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 03:53:26.086670 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.network.neutron [None req-c0dbe22b-8bb9-4bad-951a-587e21c98dc1 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] validate_networks() for [('9a7b7e8a-baf9-483b-925f-a5723b52bbe6', None, None, None, None, None)] {{(pid=130262) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 03:53:26.558679 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.virt.hardware [None req-c0dbe22b-8bb9-4bad-951a-587e21c98dc1 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Flavor limits 0:0:0 {{(pid=130262) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 03:53:26.559104 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.virt.hardware [None req-c0dbe22b-8bb9-4bad-951a-587e21c98dc1 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Image limits 0:0:0 {{(pid=130262) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 03:53:26.559578 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.virt.hardware [None req-c0dbe22b-8bb9-4bad-951a-587e21c98dc1 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Flavor pref 0:0:0 {{(pid=130262) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 03:53:26.559990 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.virt.hardware [None req-c0dbe22b-8bb9-4bad-951a-587e21c98dc1 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Image pref 0:0:0 {{(pid=130262) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 03:53:26.560402 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.virt.hardware [None req-c0dbe22b-8bb9-4bad-951a-587e21c98dc1 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130262) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 03:53:26.569717 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-c0dbe22b-8bb9-4bad-951a-587e21c98dc1 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:53:26.570171 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-c0dbe22b-8bb9-4bad-951a-587e21c98dc1 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:53:26.570983 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-c0dbe22b-8bb9-4bad-951a-587e21c98dc1 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:53:26.571429 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-c0dbe22b-8bb9-4bad-951a-587e21c98dc1 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:53:26.588301 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.quota [None req-c0dbe22b-8bb9-4bad-951a-587e21c98dc1 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Getting quotas for project a98f18ee8c7d4cfe9f4b879505ca6605. Resources: {'instances', 'ram', 'cores'} {{(pid=130262) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 03:53:26.592583 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.quota [None req-c0dbe22b-8bb9-4bad-951a-587e21c98dc1 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Getting quotas for user ac99f60384fe4a119d019cedfe1d3557 and project a98f18ee8c7d4cfe9f4b879505ca6605. Resources: {'instances', 'ram', 'cores'} {{(pid=130262) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 03:53:26.604772 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-c0dbe22b-8bb9-4bad-951a-587e21c98dc1 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Going to run 1 instances... {{(pid=130262) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 03:53:26.607181 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-c0dbe22b-8bb9-4bad-951a-587e21c98dc1 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] [instance: dc5b13cc-82f3-4f36-abfb-0789cb84b279] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0208f4b3-1d2f-42e4-a9b4-528bf5066fe1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130262) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 03:53:26.737639 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-c0dbe22b-8bb9-4bad-951a-587e21c98dc1 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.759072 Aug 04 03:53:26.738286 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 603/1202] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 03:53:25 2022] POST /compute/v2.1/servers => generated 402 bytes in 760 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 03:53:26.749070 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-b204ffd4-d4f8-4298-a6e4-3a09373ea6ea tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:53:26.749705 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-b204ffd4-d4f8-4298-a6e4-3a09373ea6ea tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] [instance: dc5b13cc-82f3-4f36-abfb-0789cb84b279] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:53:26.805526 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-b204ffd4-d4f8-4298-a6e4-3a09373ea6ea tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac99f60384fe4a119d019cedfe1d3557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f18ee8c7d4cfe9f4b879505ca6605', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:53:26.812427 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-b204ffd4-d4f8-4298-a6e4-3a09373ea6ea tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] 10.222.0.66 "GET /compute/v2.1/servers/dc5b13cc-82f3-4f36-abfb-0789cb84b279" status: 200 len: 1241 microversion: 2.1 time: 0.067298 Aug 04 03:53:26.812990 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 600/1203] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:53:26 2022] GET /compute/v2.1/servers/dc5b13cc-82f3-4f36-abfb-0789cb84b279 => generated 1241 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:53:27.834381 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-5279ff19-af78-4ab0-957d-ee8bec0dc11e tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:53:27.834997 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-5279ff19-af78-4ab0-957d-ee8bec0dc11e tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] [instance: dc5b13cc-82f3-4f36-abfb-0789cb84b279] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:53:27.842346 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-5279ff19-af78-4ab0-957d-ee8bec0dc11e tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:53:27.842794 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-5279ff19-af78-4ab0-957d-ee8bec0dc11e tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:53:27.843559 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-5279ff19-af78-4ab0-957d-ee8bec0dc11e tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:53:27.843998 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-5279ff19-af78-4ab0-957d-ee8bec0dc11e tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:53:27.905363 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-5279ff19-af78-4ab0-957d-ee8bec0dc11e tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac99f60384fe4a119d019cedfe1d3557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f18ee8c7d4cfe9f4b879505ca6605', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:53:27.913326 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-5279ff19-af78-4ab0-957d-ee8bec0dc11e tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] 10.222.0.66 "GET /compute/v2.1/servers/dc5b13cc-82f3-4f36-abfb-0789cb84b279" status: 200 len: 1237 microversion: 2.1 time: 0.084140 Aug 04 03:53:27.913878 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 604/1204] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:53:27 2022] GET /compute/v2.1/servers/dc5b13cc-82f3-4f36-abfb-0789cb84b279 => generated 1237 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:53:28.934024 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-1685b0d1-6582-4519-a9b5-144c78678f10 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:53:28.934719 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-1685b0d1-6582-4519-a9b5-144c78678f10 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] [instance: dc5b13cc-82f3-4f36-abfb-0789cb84b279] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:53:28.941548 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-1685b0d1-6582-4519-a9b5-144c78678f10 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:53:28.942073 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-1685b0d1-6582-4519-a9b5-144c78678f10 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:53:28.942898 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-1685b0d1-6582-4519-a9b5-144c78678f10 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:53:28.943434 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-1685b0d1-6582-4519-a9b5-144c78678f10 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:53:29.010652 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-1685b0d1-6582-4519-a9b5-144c78678f10 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac99f60384fe4a119d019cedfe1d3557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f18ee8c7d4cfe9f4b879505ca6605', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:53:29.018384 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-1685b0d1-6582-4519-a9b5-144c78678f10 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] 10.222.0.66 "GET /compute/v2.1/servers/dc5b13cc-82f3-4f36-abfb-0789cb84b279" status: 200 len: 1299 microversion: 2.1 time: 0.088240 Aug 04 03:53:29.018993 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 601/1205] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:53:28 2022] GET /compute/v2.1/servers/dc5b13cc-82f3-4f36-abfb-0789cb84b279 => generated 1299 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:53:30.039627 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-713f4978-d9cc-4967-ad9c-f6312dffcd33 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:53:30.040262 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-713f4978-d9cc-4967-ad9c-f6312dffcd33 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] [instance: dc5b13cc-82f3-4f36-abfb-0789cb84b279] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:53:30.047043 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-713f4978-d9cc-4967-ad9c-f6312dffcd33 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:53:30.047508 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-713f4978-d9cc-4967-ad9c-f6312dffcd33 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:53:30.048844 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-713f4978-d9cc-4967-ad9c-f6312dffcd33 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:53:30.049449 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-713f4978-d9cc-4967-ad9c-f6312dffcd33 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:53:30.136683 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [req-a6744392-a743-4fd8-bee3-12991528a8b2 req-13fc85f1-dc34-4469-b474-9d14d7f425a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc5b13cc-82f3-4f36-abfb-0789cb84b279", "tag": "67d014b6-e38e-4584-a473-731bd8002e2b"}]} {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 03:53:30.148576 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [req-a6744392-a743-4fd8-bee3-12991528a8b2 req-13fc85f1-dc34-4469-b474-9d14d7f425a3 service nova] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:53:30.149024 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [req-a6744392-a743-4fd8-bee3-12991528a8b2 req-13fc85f1-dc34-4469-b474-9d14d7f425a3 service nova] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:53:30.161946 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.compute.server_external_events [req-a6744392-a743-4fd8-bee3-12991528a8b2 req-13fc85f1-dc34-4469-b474-9d14d7f425a3 service nova] Creating event network-changed:67d014b6-e38e-4584-a473-731bd8002e2b for instance dc5b13cc-82f3-4f36-abfb-0789cb84b279 on hv-cinder-73306 Aug 04 03:53:30.167423 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [req-a6744392-a743-4fd8-bee3-12991528a8b2 req-13fc85f1-dc34-4469-b474-9d14d7f425a3 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034295 Aug 04 03:53:30.168029 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 602/1206] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 03:53:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 03:53:30.202320 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-713f4978-d9cc-4967-ad9c-f6312dffcd33 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac99f60384fe4a119d019cedfe1d3557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f18ee8c7d4cfe9f4b879505ca6605', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:53:30.210040 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-713f4978-d9cc-4967-ad9c-f6312dffcd33 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] 10.222.0.66 "GET /compute/v2.1/servers/dc5b13cc-82f3-4f36-abfb-0789cb84b279" status: 200 len: 1367 microversion: 2.1 time: 0.174343 Aug 04 03:53:30.210605 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 605/1207] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:53:30 2022] GET /compute/v2.1/servers/dc5b13cc-82f3-4f36-abfb-0789cb84b279 => generated 1367 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:53:31.232767 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-0715880e-0973-4430-91e8-ecc706be194d tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:53:31.233489 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-0715880e-0973-4430-91e8-ecc706be194d tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] [instance: dc5b13cc-82f3-4f36-abfb-0789cb84b279] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:53:31.240470 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-0715880e-0973-4430-91e8-ecc706be194d tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:53:31.240918 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-0715880e-0973-4430-91e8-ecc706be194d tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:53:31.241797 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-0715880e-0973-4430-91e8-ecc706be194d tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:53:31.242236 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-0715880e-0973-4430-91e8-ecc706be194d tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:53:31.373076 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-0715880e-0973-4430-91e8-ecc706be194d tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac99f60384fe4a119d019cedfe1d3557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f18ee8c7d4cfe9f4b879505ca6605', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:53:31.380922 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-0715880e-0973-4430-91e8-ecc706be194d tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] 10.222.0.66 "GET /compute/v2.1/servers/dc5b13cc-82f3-4f36-abfb-0789cb84b279" status: 200 len: 1367 microversion: 2.1 time: 0.153030 Aug 04 03:53:31.381537 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 603/1208] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:53:31 2022] GET /compute/v2.1/servers/dc5b13cc-82f3-4f36-abfb-0789cb84b279 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 03:53:32.401254 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-92fcb9c7-92e2-4bed-9e9d-e84e3bfde5d6 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:53:32.401850 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-92fcb9c7-92e2-4bed-9e9d-e84e3bfde5d6 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] [instance: dc5b13cc-82f3-4f36-abfb-0789cb84b279] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:53:32.409279 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-92fcb9c7-92e2-4bed-9e9d-e84e3bfde5d6 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:53:32.409720 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-92fcb9c7-92e2-4bed-9e9d-e84e3bfde5d6 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:53:32.410481 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-92fcb9c7-92e2-4bed-9e9d-e84e3bfde5d6 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:53:32.410910 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-92fcb9c7-92e2-4bed-9e9d-e84e3bfde5d6 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:53:32.543093 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-92fcb9c7-92e2-4bed-9e9d-e84e3bfde5d6 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac99f60384fe4a119d019cedfe1d3557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f18ee8c7d4cfe9f4b879505ca6605', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:53:32.551311 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-92fcb9c7-92e2-4bed-9e9d-e84e3bfde5d6 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] 10.222.0.66 "GET /compute/v2.1/servers/dc5b13cc-82f3-4f36-abfb-0789cb84b279" status: 200 len: 1367 microversion: 2.1 time: 0.154007 Aug 04 03:53:32.551874 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 606/1209] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:53:32 2022] GET /compute/v2.1/servers/dc5b13cc-82f3-4f36-abfb-0789cb84b279 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:53:33.571926 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-c0c1122a-554b-4612-a3cd-75ed4bbd098c tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:53:33.572455 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-c0c1122a-554b-4612-a3cd-75ed4bbd098c tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] [instance: dc5b13cc-82f3-4f36-abfb-0789cb84b279] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:53:33.579113 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-c0c1122a-554b-4612-a3cd-75ed4bbd098c tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:53:33.579582 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-c0c1122a-554b-4612-a3cd-75ed4bbd098c tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:53:33.580332 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-c0c1122a-554b-4612-a3cd-75ed4bbd098c tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:53:33.580765 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-c0c1122a-554b-4612-a3cd-75ed4bbd098c tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:53:33.707476 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-c0c1122a-554b-4612-a3cd-75ed4bbd098c tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac99f60384fe4a119d019cedfe1d3557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f18ee8c7d4cfe9f4b879505ca6605', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:53:33.714949 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-c0c1122a-554b-4612-a3cd-75ed4bbd098c tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] 10.222.0.66 "GET /compute/v2.1/servers/dc5b13cc-82f3-4f36-abfb-0789cb84b279" status: 200 len: 1367 microversion: 2.1 time: 0.146950 Aug 04 03:53:33.715514 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 604/1210] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:53:33 2022] GET /compute/v2.1/servers/dc5b13cc-82f3-4f36-abfb-0789cb84b279 => generated 1367 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:53:34.736182 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-d399c1d0-cabf-421f-a4d8-f2a271b2d078 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:53:34.736962 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-d399c1d0-cabf-421f-a4d8-f2a271b2d078 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] [instance: dc5b13cc-82f3-4f36-abfb-0789cb84b279] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:53:34.743604 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-d399c1d0-cabf-421f-a4d8-f2a271b2d078 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:53:34.744060 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-d399c1d0-cabf-421f-a4d8-f2a271b2d078 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:53:34.744860 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-d399c1d0-cabf-421f-a4d8-f2a271b2d078 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:53:34.745307 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-d399c1d0-cabf-421f-a4d8-f2a271b2d078 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:53:34.882824 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-d399c1d0-cabf-421f-a4d8-f2a271b2d078 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac99f60384fe4a119d019cedfe1d3557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f18ee8c7d4cfe9f4b879505ca6605', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:53:34.890774 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-d399c1d0-cabf-421f-a4d8-f2a271b2d078 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] 10.222.0.66 "GET /compute/v2.1/servers/dc5b13cc-82f3-4f36-abfb-0789cb84b279" status: 200 len: 1367 microversion: 2.1 time: 0.158538 Aug 04 03:53:34.891443 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 607/1211] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:53:34 2022] GET /compute/v2.1/servers/dc5b13cc-82f3-4f36-abfb-0789cb84b279 => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:53:35.912659 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-db2e44ae-063e-494d-b241-c85ee785f9cf tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:53:35.913325 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-db2e44ae-063e-494d-b241-c85ee785f9cf tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] [instance: dc5b13cc-82f3-4f36-abfb-0789cb84b279] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:53:35.919875 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-db2e44ae-063e-494d-b241-c85ee785f9cf tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:53:35.920380 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-db2e44ae-063e-494d-b241-c85ee785f9cf tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:53:35.921128 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-db2e44ae-063e-494d-b241-c85ee785f9cf tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:53:35.921591 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-db2e44ae-063e-494d-b241-c85ee785f9cf tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:53:36.052860 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-db2e44ae-063e-494d-b241-c85ee785f9cf tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac99f60384fe4a119d019cedfe1d3557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f18ee8c7d4cfe9f4b879505ca6605', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:53:36.060792 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-db2e44ae-063e-494d-b241-c85ee785f9cf tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] 10.222.0.66 "GET /compute/v2.1/servers/dc5b13cc-82f3-4f36-abfb-0789cb84b279" status: 200 len: 1367 microversion: 2.1 time: 0.152050 Aug 04 03:53:36.061573 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 605/1212] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:53:35 2022] GET /compute/v2.1/servers/dc5b13cc-82f3-4f36-abfb-0789cb84b279 => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:53:37.082320 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-43d849d3-893d-46c9-8931-8e75b2f8c5c8 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:53:37.082888 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-43d849d3-893d-46c9-8931-8e75b2f8c5c8 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] [instance: dc5b13cc-82f3-4f36-abfb-0789cb84b279] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:53:37.085363 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG dbcounter [-] [130262] Writing DB stats nova_cell0:SELECT=2 {{(pid=130262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:53:37.086155 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG dbcounter [-] [130262] Writing DB stats nova_cell0:SELECT=6 {{(pid=130262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:53:37.090812 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-43d849d3-893d-46c9-8931-8e75b2f8c5c8 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:53:37.091258 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-43d849d3-893d-46c9-8931-8e75b2f8c5c8 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:53:37.092019 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-43d849d3-893d-46c9-8931-8e75b2f8c5c8 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:53:37.092454 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-43d849d3-893d-46c9-8931-8e75b2f8c5c8 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:53:37.225459 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-43d849d3-893d-46c9-8931-8e75b2f8c5c8 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac99f60384fe4a119d019cedfe1d3557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f18ee8c7d4cfe9f4b879505ca6605', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:53:37.234484 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-43d849d3-893d-46c9-8931-8e75b2f8c5c8 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] 10.222.0.66 "GET /compute/v2.1/servers/dc5b13cc-82f3-4f36-abfb-0789cb84b279" status: 200 len: 1367 microversion: 2.1 time: 0.155859 Aug 04 03:53:37.237182 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 608/1213] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:53:37 2022] GET /compute/v2.1/servers/dc5b13cc-82f3-4f36-abfb-0789cb84b279 => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:53:38.256366 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-3f4e653a-7dab-4e2c-abbd-3b016fb9f171 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:53:38.256974 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-3f4e653a-7dab-4e2c-abbd-3b016fb9f171 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] [instance: dc5b13cc-82f3-4f36-abfb-0789cb84b279] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:53:38.258996 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG dbcounter [-] [130263] Writing DB stats nova_cell0:SELECT=6 {{(pid=130263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:53:38.264239 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-3f4e653a-7dab-4e2c-abbd-3b016fb9f171 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:53:38.264736 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-3f4e653a-7dab-4e2c-abbd-3b016fb9f171 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:53:38.265520 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-3f4e653a-7dab-4e2c-abbd-3b016fb9f171 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:53:38.265948 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-3f4e653a-7dab-4e2c-abbd-3b016fb9f171 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:53:38.399785 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-3f4e653a-7dab-4e2c-abbd-3b016fb9f171 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac99f60384fe4a119d019cedfe1d3557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f18ee8c7d4cfe9f4b879505ca6605', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:53:38.407233 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-3f4e653a-7dab-4e2c-abbd-3b016fb9f171 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] 10.222.0.66 "GET /compute/v2.1/servers/dc5b13cc-82f3-4f36-abfb-0789cb84b279" status: 200 len: 1367 microversion: 2.1 time: 0.154685 Aug 04 03:53:38.408500 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 606/1214] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:53:38 2022] GET /compute/v2.1/servers/dc5b13cc-82f3-4f36-abfb-0789cb84b279 => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:53:39.428532 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-fdfd253b-cff9-47ff-b53d-8c24d37bb5a9 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:53:39.429056 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-fdfd253b-cff9-47ff-b53d-8c24d37bb5a9 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] [instance: dc5b13cc-82f3-4f36-abfb-0789cb84b279] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:53:39.431345 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG dbcounter [-] [130262] Writing DB stats nova_api:SELECT=43,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=130262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:53:39.436242 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-fdfd253b-cff9-47ff-b53d-8c24d37bb5a9 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:53:39.436683 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-fdfd253b-cff9-47ff-b53d-8c24d37bb5a9 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:53:39.437480 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-fdfd253b-cff9-47ff-b53d-8c24d37bb5a9 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:53:39.437907 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-fdfd253b-cff9-47ff-b53d-8c24d37bb5a9 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:53:39.442828 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG dbcounter [-] [130262] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=130262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:53:39.569846 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-fdfd253b-cff9-47ff-b53d-8c24d37bb5a9 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac99f60384fe4a119d019cedfe1d3557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f18ee8c7d4cfe9f4b879505ca6605', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:53:39.577762 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-fdfd253b-cff9-47ff-b53d-8c24d37bb5a9 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] 10.222.0.66 "GET /compute/v2.1/servers/dc5b13cc-82f3-4f36-abfb-0789cb84b279" status: 200 len: 1367 microversion: 2.1 time: 0.153389 Aug 04 03:53:39.578531 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 609/1215] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:53:39 2022] GET /compute/v2.1/servers/dc5b13cc-82f3-4f36-abfb-0789cb84b279 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 03:53:40.599227 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-c9880277-e6d0-4d3b-be3e-720d72003283 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:53:40.599830 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-c9880277-e6d0-4d3b-be3e-720d72003283 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] [instance: dc5b13cc-82f3-4f36-abfb-0789cb84b279] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:53:40.606350 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-c9880277-e6d0-4d3b-be3e-720d72003283 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:53:40.606796 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-c9880277-e6d0-4d3b-be3e-720d72003283 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:53:40.607547 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-c9880277-e6d0-4d3b-be3e-720d72003283 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:53:40.607976 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-c9880277-e6d0-4d3b-be3e-720d72003283 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:53:40.741301 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-c9880277-e6d0-4d3b-be3e-720d72003283 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac99f60384fe4a119d019cedfe1d3557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f18ee8c7d4cfe9f4b879505ca6605', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:53:40.748619 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-c9880277-e6d0-4d3b-be3e-720d72003283 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] 10.222.0.66 "GET /compute/v2.1/servers/dc5b13cc-82f3-4f36-abfb-0789cb84b279" status: 200 len: 1367 microversion: 2.1 time: 0.153418 Aug 04 03:53:40.749174 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 607/1216] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:53:40 2022] GET /compute/v2.1/servers/dc5b13cc-82f3-4f36-abfb-0789cb84b279 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 03:53:41.708305 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [req-9eefb1ae-71d7-4b93-929d-a41c25d1c645 req-234054cd-41b9-48bc-948e-a462bce7970e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc5b13cc-82f3-4f36-abfb-0789cb84b279", "name": "network-vif-plugged", "status": "completed", "tag": "67d014b6-e38e-4584-a473-731bd8002e2b"}]} {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 03:53:41.719779 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [req-9eefb1ae-71d7-4b93-929d-a41c25d1c645 req-234054cd-41b9-48bc-948e-a462bce7970e service nova] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:53:41.720796 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [req-9eefb1ae-71d7-4b93-929d-a41c25d1c645 req-234054cd-41b9-48bc-948e-a462bce7970e service nova] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:53:41.731895 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.compute.server_external_events [req-9eefb1ae-71d7-4b93-929d-a41c25d1c645 req-234054cd-41b9-48bc-948e-a462bce7970e service nova] Creating event network-vif-plugged:67d014b6-e38e-4584-a473-731bd8002e2b for instance dc5b13cc-82f3-4f36-abfb-0789cb84b279 on hv-cinder-73306 Aug 04 03:53:41.737451 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [req-9eefb1ae-71d7-4b93-929d-a41c25d1c645 req-234054cd-41b9-48bc-948e-a462bce7970e service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033004 Aug 04 03:53:41.738034 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 610/1217] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 03:53:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 03:53:41.770127 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-974a4dd7-d6fa-4cc7-a306-a5f7543dae09 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:53:41.776337 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-974a4dd7-d6fa-4cc7-a306-a5f7543dae09 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] [instance: dc5b13cc-82f3-4f36-abfb-0789cb84b279] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:53:41.778616 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-974a4dd7-d6fa-4cc7-a306-a5f7543dae09 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:53:41.779073 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-974a4dd7-d6fa-4cc7-a306-a5f7543dae09 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:53:41.779842 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-974a4dd7-d6fa-4cc7-a306-a5f7543dae09 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:53:41.780279 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-974a4dd7-d6fa-4cc7-a306-a5f7543dae09 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:53:41.924100 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-974a4dd7-d6fa-4cc7-a306-a5f7543dae09 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac99f60384fe4a119d019cedfe1d3557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f18ee8c7d4cfe9f4b879505ca6605', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:53:41.930266 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-974a4dd7-d6fa-4cc7-a306-a5f7543dae09 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] 10.222.0.66 "GET /compute/v2.1/servers/dc5b13cc-82f3-4f36-abfb-0789cb84b279" status: 200 len: 1367 microversion: 2.1 time: 0.164981 Aug 04 03:53:41.930832 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 608/1218] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:53:41 2022] GET /compute/v2.1/servers/dc5b13cc-82f3-4f36-abfb-0789cb84b279 => generated 1367 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 03:53:42.951838 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-915fb6ee-d878-46fe-a79e-1e1a3cd4ea32 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:53:42.952527 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-915fb6ee-d878-46fe-a79e-1e1a3cd4ea32 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] [instance: dc5b13cc-82f3-4f36-abfb-0789cb84b279] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:53:42.961272 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-915fb6ee-d878-46fe-a79e-1e1a3cd4ea32 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:53:42.962132 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-915fb6ee-d878-46fe-a79e-1e1a3cd4ea32 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:53:42.962914 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-915fb6ee-d878-46fe-a79e-1e1a3cd4ea32 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:53:42.963343 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-915fb6ee-d878-46fe-a79e-1e1a3cd4ea32 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:53:43.096135 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-915fb6ee-d878-46fe-a79e-1e1a3cd4ea32 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac99f60384fe4a119d019cedfe1d3557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f18ee8c7d4cfe9f4b879505ca6605', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:53:43.103768 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-915fb6ee-d878-46fe-a79e-1e1a3cd4ea32 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] 10.222.0.66 "GET /compute/v2.1/servers/dc5b13cc-82f3-4f36-abfb-0789cb84b279" status: 200 len: 1367 microversion: 2.1 time: 0.156802 Aug 04 03:53:43.104328 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 611/1219] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:53:42 2022] GET /compute/v2.1/servers/dc5b13cc-82f3-4f36-abfb-0789cb84b279 => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 04 03:53:44.124236 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-73f1124e-f789-4fe2-a793-55ea52f4001f tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:53:44.124976 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-73f1124e-f789-4fe2-a793-55ea52f4001f tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] [instance: dc5b13cc-82f3-4f36-abfb-0789cb84b279] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:53:44.132425 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-73f1124e-f789-4fe2-a793-55ea52f4001f tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:53:44.132905 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-73f1124e-f789-4fe2-a793-55ea52f4001f tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:53:44.133835 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-73f1124e-f789-4fe2-a793-55ea52f4001f tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:53:44.134265 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-73f1124e-f789-4fe2-a793-55ea52f4001f tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:53:44.263750 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-73f1124e-f789-4fe2-a793-55ea52f4001f tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac99f60384fe4a119d019cedfe1d3557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f18ee8c7d4cfe9f4b879505ca6605', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:53:44.271294 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-73f1124e-f789-4fe2-a793-55ea52f4001f tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] 10.222.0.66 "GET /compute/v2.1/servers/dc5b13cc-82f3-4f36-abfb-0789cb84b279" status: 200 len: 1558 microversion: 2.1 time: 0.150985 Aug 04 03:53:44.271856 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 609/1220] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:53:44 2022] GET /compute/v2.1/servers/dc5b13cc-82f3-4f36-abfb-0789cb84b279 => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:53:44.291230 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-58fe0895-367f-4cea-b62c-b9f2d47d2ebd tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:53:44.291758 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-58fe0895-367f-4cea-b62c-b9f2d47d2ebd tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] [instance: dc5b13cc-82f3-4f36-abfb-0789cb84b279] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:53:44.298918 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-58fe0895-367f-4cea-b62c-b9f2d47d2ebd tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:53:44.299363 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-58fe0895-367f-4cea-b62c-b9f2d47d2ebd tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:53:44.300124 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-58fe0895-367f-4cea-b62c-b9f2d47d2ebd tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:53:44.300554 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-58fe0895-367f-4cea-b62c-b9f2d47d2ebd tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:53:44.377113 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-58fe0895-367f-4cea-b62c-b9f2d47d2ebd tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] 10.222.0.66 "GET /compute/v2.1/servers/dc5b13cc-82f3-4f36-abfb-0789cb84b279/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.089050 Aug 04 03:53:44.377749 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 612/1221] 10.222.0.66 () {58 vars in 1275 bytes} [Thu Aug 4 03:53:44 2022] GET /compute/v2.1/servers/dc5b13cc-82f3-4f36-abfb-0789cb84b279/os-interface => generated 285 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 03:53:45.736923 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [req-32dc8f77-807b-4969-807f-c5a5b7bb704d req-fd583783-da21-4654-8093-523dad4a9627 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc5b13cc-82f3-4f36-abfb-0789cb84b279", "tag": "67d014b6-e38e-4584-a473-731bd8002e2b"}]} {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 03:53:45.746544 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [req-32dc8f77-807b-4969-807f-c5a5b7bb704d req-fd583783-da21-4654-8093-523dad4a9627 service nova] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:53:45.746988 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [req-32dc8f77-807b-4969-807f-c5a5b7bb704d req-fd583783-da21-4654-8093-523dad4a9627 service nova] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:53:45.759048 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.compute.server_external_events [req-32dc8f77-807b-4969-807f-c5a5b7bb704d req-fd583783-da21-4654-8093-523dad4a9627 service nova] Creating event network-changed:67d014b6-e38e-4584-a473-731bd8002e2b for instance dc5b13cc-82f3-4f36-abfb-0789cb84b279 on hv-cinder-73306 Aug 04 03:53:45.764158 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [req-32dc8f77-807b-4969-807f-c5a5b7bb704d req-fd583783-da21-4654-8093-523dad4a9627 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.157577 Aug 04 03:53:45.764760 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 610/1222] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 03:53:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 03:54:16.136096 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 03:54:16.136787 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Thu Aug 4 03:54:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 03:55:00.626565 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG dbcounter [-] [130262] Writing DB stats nova_api:SELECT=7 {{(pid=130262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:55:00.627316 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG dbcounter [-] [130262] Writing DB stats nova_cell1:SELECT=17 {{(pid=130262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:55:00.632169 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-091617c3-27ef-4866-9f96-007c66eb00ca tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:55:00.632664 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-091617c3-27ef-4866-9f96-007c66eb00ca tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] [instance: dc5b13cc-82f3-4f36-abfb-0789cb84b279] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:55:00.638535 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-091617c3-27ef-4866-9f96-007c66eb00ca tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:55:00.639040 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-091617c3-27ef-4866-9f96-007c66eb00ca tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:55:00.639802 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-091617c3-27ef-4866-9f96-007c66eb00ca tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:55:00.640249 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-091617c3-27ef-4866-9f96-007c66eb00ca tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:55:00.667624 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-091617c3-27ef-4866-9f96-007c66eb00ca tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] 10.222.0.66 "GET /compute/v2.1/servers/dc5b13cc-82f3-4f36-abfb-0789cb84b279/ips" status: 200 len: 150 microversion: 2.1 time: 0.043462 Aug 04 03:55:00.668194 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 613/1223] 10.222.0.66 () {58 vars in 1248 bytes} [Thu Aug 4 03:55:00 2022] GET /compute/v2.1/servers/dc5b13cc-82f3-4f36-abfb-0789cb84b279/ips => generated 150 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 03:55:02.255549 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG dbcounter [-] [130263] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=130263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:55:02.256234 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG dbcounter [-] [130263] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:55:02.260747 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-8e9a2f71-62db-44b9-a17c-9f63682904a7 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "acb5344c-9090-4423-a5d5-81ecc7a91aed"}} {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 03:55:02.263225 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-8e9a2f71-62db-44b9-a17c-9f63682904a7 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] [instance: dc5b13cc-82f3-4f36-abfb-0789cb84b279] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:55:02.269340 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-8e9a2f71-62db-44b9-a17c-9f63682904a7 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:55:02.270331 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-8e9a2f71-62db-44b9-a17c-9f63682904a7 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:55:02.271532 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-8e9a2f71-62db-44b9-a17c-9f63682904a7 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:55:02.271970 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-8e9a2f71-62db-44b9-a17c-9f63682904a7 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:55:03.074669 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-8e9a2f71-62db-44b9-a17c-9f63682904a7 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] 10.222.0.66 "POST /compute/v2.1/servers/dc5b13cc-82f3-4f36-abfb-0789cb84b279/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.821539 Aug 04 03:55:03.075269 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 611/1224] 10.222.0.66 () {60 vars in 1323 bytes} [Thu Aug 4 03:55:02 2022] POST /compute/v2.1/servers/dc5b13cc-82f3-4f36-abfb-0789cb84b279/os-volume_attachments => generated 194 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 03:55:10.691477 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-a8c2ed9c-c4c3-448e-81aa-62d9f61071a1 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:55:10.692006 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-a8c2ed9c-c4c3-448e-81aa-62d9f61071a1 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] [instance: dc5b13cc-82f3-4f36-abfb-0789cb84b279] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:55:10.695076 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG dbcounter [-] [130262] Writing DB stats nova_api:SELECT=2 {{(pid=130262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:55:10.700078 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-a8c2ed9c-c4c3-448e-81aa-62d9f61071a1 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:55:10.700549 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-a8c2ed9c-c4c3-448e-81aa-62d9f61071a1 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:55:10.701331 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-a8c2ed9c-c4c3-448e-81aa-62d9f61071a1 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:55:10.701772 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-a8c2ed9c-c4c3-448e-81aa-62d9f61071a1 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:55:10.831251 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.objects.instance [None req-a8c2ed9c-c4c3-448e-81aa-62d9f61071a1 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lazy-loading 'services' on Instance uuid dc5b13cc-82f3-4f36-abfb-0789cb84b279 {{(pid=130262) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 03:55:11.030611 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-a8c2ed9c-c4c3-448e-81aa-62d9f61071a1 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] 10.222.0.66 "DELETE /compute/v2.1/servers/dc5b13cc-82f3-4f36-abfb-0789cb84b279/os-volume_attachments/acb5344c-9090-4423-a5d5-81ecc7a91aed" status: 202 len: 0 microversion: 2.1 time: 0.343351 Aug 04 03:55:11.031248 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 614/1225] 10.222.0.66 () {58 vars in 1416 bytes} [Thu Aug 4 03:55:10 2022] DELETE /compute/v2.1/servers/dc5b13cc-82f3-4f36-abfb-0789cb84b279/os-volume_attachments/acb5344c-9090-4423-a5d5-81ecc7a91aed => generated 0 bytes in 345 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 03:55:11.042332 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-b956b81f-348d-48b8-9c38-30b036e37767 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:55:11.044820 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-b956b81f-348d-48b8-9c38-30b036e37767 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] [instance: dc5b13cc-82f3-4f36-abfb-0789cb84b279] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:55:11.052515 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-b956b81f-348d-48b8-9c38-30b036e37767 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:55:11.053684 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-b956b81f-348d-48b8-9c38-30b036e37767 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:55:11.054460 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-b956b81f-348d-48b8-9c38-30b036e37767 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:55:11.054894 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-b956b81f-348d-48b8-9c38-30b036e37767 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:55:11.086369 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-b956b81f-348d-48b8-9c38-30b036e37767 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] 10.222.0.66 "GET /compute/v2.1/servers/dc5b13cc-82f3-4f36-abfb-0789cb84b279/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050400 Aug 04 03:55:11.086920 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 612/1226] 10.222.0.66 () {58 vars in 1302 bytes} [Thu Aug 4 03:55:11 2022] GET /compute/v2.1/servers/dc5b13cc-82f3-4f36-abfb-0789cb84b279/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 03:55:12.099800 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-4473c2b7-2142-43c9-a087-ac0ebe749838 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:55:12.102342 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-4473c2b7-2142-43c9-a087-ac0ebe749838 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] [instance: dc5b13cc-82f3-4f36-abfb-0789cb84b279] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:55:12.108978 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-4473c2b7-2142-43c9-a087-ac0ebe749838 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:55:12.109470 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-4473c2b7-2142-43c9-a087-ac0ebe749838 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:55:12.110233 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-4473c2b7-2142-43c9-a087-ac0ebe749838 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:55:12.110668 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-4473c2b7-2142-43c9-a087-ac0ebe749838 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:55:12.140283 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-4473c2b7-2142-43c9-a087-ac0ebe749838 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] 10.222.0.66 "GET /compute/v2.1/servers/dc5b13cc-82f3-4f36-abfb-0789cb84b279/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045032 Aug 04 03:55:12.140848 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 615/1227] 10.222.0.66 () {58 vars in 1302 bytes} [Thu Aug 4 03:55:12 2022] GET /compute/v2.1/servers/dc5b13cc-82f3-4f36-abfb-0789cb84b279/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 04 03:55:12.213096 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-a156f4ac-4abb-4079-b572-2b17d8d29261 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:55:12.213627 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-a156f4ac-4abb-4079-b572-2b17d8d29261 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] [instance: dc5b13cc-82f3-4f36-abfb-0789cb84b279] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:55:12.220079 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-a156f4ac-4abb-4079-b572-2b17d8d29261 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:55:12.220527 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-a156f4ac-4abb-4079-b572-2b17d8d29261 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:55:12.221322 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-a156f4ac-4abb-4079-b572-2b17d8d29261 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:55:12.221757 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-a156f4ac-4abb-4079-b572-2b17d8d29261 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:55:12.249900 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-a156f4ac-4abb-4079-b572-2b17d8d29261 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] [instance: dc5b13cc-82f3-4f36-abfb-0789cb84b279] Going to try to terminate instance {{(pid=130263) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 03:55:12.551152 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-a156f4ac-4abb-4079-b572-2b17d8d29261 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] 10.222.0.66 "DELETE /compute/v2.1/servers/dc5b13cc-82f3-4f36-abfb-0789cb84b279" status: 204 len: 0 microversion: 2.1 time: 0.342650 Aug 04 03:55:12.551739 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 613/1228] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 03:55:12 2022] DELETE /compute/v2.1/servers/dc5b13cc-82f3-4f36-abfb-0789cb84b279 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 03:55:12.559893 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-b91a5b4a-10a9-4ac4-96c6-c8521ea315e9 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:55:12.560536 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-b91a5b4a-10a9-4ac4-96c6-c8521ea315e9 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] [instance: dc5b13cc-82f3-4f36-abfb-0789cb84b279] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:55:12.566515 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-b91a5b4a-10a9-4ac4-96c6-c8521ea315e9 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:55:12.566965 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-b91a5b4a-10a9-4ac4-96c6-c8521ea315e9 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:55:12.567720 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-b91a5b4a-10a9-4ac4-96c6-c8521ea315e9 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:55:12.568223 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-b91a5b4a-10a9-4ac4-96c6-c8521ea315e9 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:55:12.698370 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-b91a5b4a-10a9-4ac4-96c6-c8521ea315e9 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac99f60384fe4a119d019cedfe1d3557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f18ee8c7d4cfe9f4b879505ca6605', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:55:12.705883 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-b91a5b4a-10a9-4ac4-96c6-c8521ea315e9 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] 10.222.0.66 "GET /compute/v2.1/servers/dc5b13cc-82f3-4f36-abfb-0789cb84b279" status: 200 len: 1682 microversion: 2.1 time: 0.149820 Aug 04 03:55:12.706440 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 616/1229] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:55:12 2022] GET /compute/v2.1/servers/dc5b13cc-82f3-4f36-abfb-0789cb84b279 => generated 1682 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:55:13.728257 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-ee82fdac-4b98-4557-a604-3b7bf29bbdf0 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:55:13.728957 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-ee82fdac-4b98-4557-a604-3b7bf29bbdf0 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] [instance: dc5b13cc-82f3-4f36-abfb-0789cb84b279] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:55:13.735735 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-ee82fdac-4b98-4557-a604-3b7bf29bbdf0 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:55:13.736181 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-ee82fdac-4b98-4557-a604-3b7bf29bbdf0 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:55:13.736930 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-ee82fdac-4b98-4557-a604-3b7bf29bbdf0 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:55:13.737410 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-ee82fdac-4b98-4557-a604-3b7bf29bbdf0 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:55:13.869069 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-ee82fdac-4b98-4557-a604-3b7bf29bbdf0 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac99f60384fe4a119d019cedfe1d3557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f18ee8c7d4cfe9f4b879505ca6605', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:55:13.876704 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-ee82fdac-4b98-4557-a604-3b7bf29bbdf0 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] 10.222.0.66 "GET /compute/v2.1/servers/dc5b13cc-82f3-4f36-abfb-0789cb84b279" status: 200 len: 1682 microversion: 2.1 time: 0.153678 Aug 04 03:55:13.877279 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 614/1230] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:55:13 2022] GET /compute/v2.1/servers/dc5b13cc-82f3-4f36-abfb-0789cb84b279 => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:55:14.898972 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-18299e54-2e8e-4cd2-88ca-34a414ffe39d tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:55:14.899654 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-18299e54-2e8e-4cd2-88ca-34a414ffe39d tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] [instance: dc5b13cc-82f3-4f36-abfb-0789cb84b279] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:55:14.906154 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-18299e54-2e8e-4cd2-88ca-34a414ffe39d tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:55:14.906598 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-18299e54-2e8e-4cd2-88ca-34a414ffe39d tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:55:14.907362 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-18299e54-2e8e-4cd2-88ca-34a414ffe39d tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:55:14.907826 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-18299e54-2e8e-4cd2-88ca-34a414ffe39d tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:55:15.039057 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-18299e54-2e8e-4cd2-88ca-34a414ffe39d tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac99f60384fe4a119d019cedfe1d3557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f18ee8c7d4cfe9f4b879505ca6605', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:55:15.047212 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-18299e54-2e8e-4cd2-88ca-34a414ffe39d tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] 10.222.0.66 "GET /compute/v2.1/servers/dc5b13cc-82f3-4f36-abfb-0789cb84b279" status: 200 len: 1682 microversion: 2.1 time: 0.152700 Aug 04 03:55:15.047930 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 617/1231] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:55:14 2022] GET /compute/v2.1/servers/dc5b13cc-82f3-4f36-abfb-0789cb84b279 => generated 1682 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:55:15.308491 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [req-3fee14f7-041c-49dd-a0e7-8c4becca8335 req-c2d334e8-9068-4a2c-926b-021e484a6916 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc5b13cc-82f3-4f36-abfb-0789cb84b279", "name": "network-vif-deleted", "tag": "67d014b6-e38e-4584-a473-731bd8002e2b"}]} {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 03:55:15.320238 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [req-3fee14f7-041c-49dd-a0e7-8c4becca8335 req-c2d334e8-9068-4a2c-926b-021e484a6916 service nova] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:55:15.320238 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [req-3fee14f7-041c-49dd-a0e7-8c4becca8335 req-c2d334e8-9068-4a2c-926b-021e484a6916 service nova] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:55:15.331266 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.compute.server_external_events [req-3fee14f7-041c-49dd-a0e7-8c4becca8335 req-c2d334e8-9068-4a2c-926b-021e484a6916 service nova] Creating event network-vif-deleted:67d014b6-e38e-4584-a473-731bd8002e2b for instance dc5b13cc-82f3-4f36-abfb-0789cb84b279 on hv-cinder-73306 Aug 04 03:55:15.336861 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [req-3fee14f7-041c-49dd-a0e7-8c4becca8335 req-c2d334e8-9068-4a2c-926b-021e484a6916 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032038 Aug 04 03:55:15.337488 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 615/1232] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 03:55:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 03:55:16.070871 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-1e4327cd-85c8-4ce1-a04b-18a6fe82dc29 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:55:16.072265 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-1e4327cd-85c8-4ce1-a04b-18a6fe82dc29 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] [instance: dc5b13cc-82f3-4f36-abfb-0789cb84b279] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:55:16.082091 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-1e4327cd-85c8-4ce1-a04b-18a6fe82dc29 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:55:16.082544 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-1e4327cd-85c8-4ce1-a04b-18a6fe82dc29 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:55:16.083319 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-1e4327cd-85c8-4ce1-a04b-18a6fe82dc29 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:55:16.083859 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-1e4327cd-85c8-4ce1-a04b-18a6fe82dc29 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:55:16.121021 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-1e4327cd-85c8-4ce1-a04b-18a6fe82dc29 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:55:16.121518 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-1e4327cd-85c8-4ce1-a04b-18a6fe82dc29 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:55:16.122039 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.objects.instance [None req-1e4327cd-85c8-4ce1-a04b-18a6fe82dc29 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lazy-loading 'fault' on Instance uuid dc5b13cc-82f3-4f36-abfb-0789cb84b279 {{(pid=130262) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 03:55:16.167715 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-1e4327cd-85c8-4ce1-a04b-18a6fe82dc29 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac99f60384fe4a119d019cedfe1d3557', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a98f18ee8c7d4cfe9f4b879505ca6605', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:55:16.177084 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-1e4327cd-85c8-4ce1-a04b-18a6fe82dc29 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] 10.222.0.66 "GET /compute/v2.1/servers/dc5b13cc-82f3-4f36-abfb-0789cb84b279" status: 200 len: 1331 microversion: 2.1 time: 0.110219 Aug 04 03:55:16.178097 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 618/1233] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:55:16 2022] GET /compute/v2.1/servers/dc5b13cc-82f3-4f36-abfb-0789cb84b279 => generated 1331 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:55:17.199841 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-870699ac-d541-4eaa-8584-22b0eee443bd tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:55:17.200544 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-870699ac-d541-4eaa-8584-22b0eee443bd tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] [instance: dc5b13cc-82f3-4f36-abfb-0789cb84b279] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:55:17.206839 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-870699ac-d541-4eaa-8584-22b0eee443bd tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:55:17.207319 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-870699ac-d541-4eaa-8584-22b0eee443bd tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:55:17.208062 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-870699ac-d541-4eaa-8584-22b0eee443bd tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:55:17.208505 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-870699ac-d541-4eaa-8584-22b0eee443bd tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:55:17.221883 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.wsgi [None req-870699ac-d541-4eaa-8584-22b0eee443bd tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] HTTP exception thrown: Instance dc5b13cc-82f3-4f36-abfb-0789cb84b279 could not be found. Aug 04 03:55:17.223407 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-870699ac-d541-4eaa-8584-22b0eee443bd tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Request method failure captured: Aug 04 03:55:17.223407 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: request: GET /compute/v2.1/servers/dc5b13cc-82f3-4f36-abfb-0789cb84b279 HTTP/1.1 Aug 04 03:55:17.223407 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Accept: application/json Aug 04 03:55:17.223407 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Accept-Encoding: identity Aug 04 03:55:17.223407 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Connection: close Aug 04 03:55:17.223407 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Content-Length: 0 Aug 04 03:55:17.223407 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Content-Type: application/json Aug 04 03:55:17.223407 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Host: 10.222.0.66 Aug 04 03:55:17.223407 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Openstack-System-Scope: None Aug 04 03:55:17.223407 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: User-Agent: python-urllib3/1.26.11 Aug 04 03:55:17.223407 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Auth-Token: gAAAAABi60EfWo3pxV-WJerz4CV7aLU5sNdQOAjcWGxLQyzzVpQzfisgkZYPF0-VvjdP-4fhqH1P-iVrAYypOKaXop8hglb2CP9bQQNfaUgJfvrw6-mu2g-Bmn1rv5G9df81SkEqY2jauM8WPz4gyORIa-0zWCQz6JGM7HOO6Cyykhfv5KFcQRY Aug 04 03:55:17.223407 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Domain-Id: None Aug 04 03:55:17.223407 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Domain-Name: None Aug 04 03:55:17.223407 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Identity-Status: Confirmed Aug 04 03:55:17.223407 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Is-Admin-Project: True Aug 04 03:55:17.223407 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Project-Domain-Id: default Aug 04 03:55:17.223407 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Project-Domain-Name: Default Aug 04 03:55:17.223407 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Project-Id: a98f18ee8c7d4cfe9f4b879505ca6605 Aug 04 03:55:17.223407 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Project-Name: tempest-AttachVolumeNegativeTest-1888469620 Aug 04 03:55:17.223407 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Role: member,reader Aug 04 03:55:17.223407 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Roles: member,reader Aug 04 03:55:17.225656 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/a98f18ee8c7d4cfe9f4b879505ca6605"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/a98f18ee8c7d4cfe9f4b879505ca6605"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/a98f18ee8c7d4cfe9f4b879505ca6605"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_a98f18ee8c7d4cfe9f4b879505ca6605"}]}] Aug 04 03:55:17.225656 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Tenant: tempest-AttachVolumeNegativeTest-1888469620 Aug 04 03:55:17.225656 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Tenant-Id: a98f18ee8c7d4cfe9f4b879505ca6605 Aug 04 03:55:17.225656 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1888469620 Aug 04 03:55:17.225656 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-User: tempest-AttachVolumeNegativeTest-1888469620-project Aug 04 03:55:17.225656 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-User-Domain-Id: default Aug 04 03:55:17.225656 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-User-Domain-Name: Default Aug 04 03:55:17.225656 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-User-Id: ac99f60384fe4a119d019cedfe1d3557 Aug 04 03:55:17.225656 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-User-Name: tempest-AttachVolumeNegativeTest-1888469620-project Aug 04 03:55:17.225656 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: method: > Aug 04 03:55:17.225656 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: exception: Instance dc5b13cc-82f3-4f36-abfb-0789cb84b279 could not be found. Aug 04 03:55:17.225656 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: action_args: {'id': 'dc5b13cc-82f3-4f36-abfb-0789cb84b279'} Aug 04 03:55:17.226659 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 03:55:17.226659 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 03:55:17.226659 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 03:55:17.226659 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 03:55:17.226659 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 03:55:17.226659 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 03:55:17.226659 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 03:55:17.226659 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 03:55:17.226659 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 03:55:17.226659 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 03:55:17.226659 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc5b13cc-82f3-4f36-abfb-0789cb84b279 could not be found. Aug 04 03:55:17.226659 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Aug 04 03:55:17.226659 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 03:55:17.226659 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Aug 04 03:55:17.226659 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 03:55:17.226659 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 03:55:17.226659 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 03:55:17.226659 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 03:55:17.226659 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 03:55:17.226659 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 03:55:17.228322 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 03:55:17.228322 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 03:55:17.228322 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 03:55:17.228322 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 03:55:17.228322 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 03:55:17.228322 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 03:55:17.228322 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 03:55:17.228322 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc5b13cc-82f3-4f36-abfb-0789cb84b279 could not be found. Aug 04 03:55:17.228322 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Aug 04 03:55:17.228322 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 03:55:17.228322 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Aug 04 03:55:17.228322 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 03:55:17.228322 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 03:55:17.228322 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 03:55:17.228322 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 03:55:17.228322 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 03:55:17.228322 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc5b13cc-82f3-4f36-abfb-0789cb84b279 could not be found. Aug 04 03:55:17.228322 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Aug 04 03:55:17.229906 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-870699ac-d541-4eaa-8584-22b0eee443bd tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Returning 404 to user: Instance dc5b13cc-82f3-4f36-abfb-0789cb84b279 could not be found. {{(pid=130263) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 03:55:17.229906 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-870699ac-d541-4eaa-8584-22b0eee443bd tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] 10.222.0.66 "GET /compute/v2.1/servers/dc5b13cc-82f3-4f36-abfb-0789cb84b279" status: 404 len: 111 microversion: 2.1 time: 0.030595 Aug 04 03:55:17.229906 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 616/1234] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:55:17 2022] GET /compute/v2.1/servers/dc5b13cc-82f3-4f36-abfb-0789cb84b279 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 03:55:17.234611 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-468bdefd-d048-4a79-9f24-da7f8ab8ef6b tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Calling method '.version_select at 0x7f72e812faf0>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:55:17.294039 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-468bdefd-d048-4a79-9f24-da7f8ab8ef6b tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] 10.222.0.66 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1734149132" status: 202 len: 0 microversion: 2.1 time: 0.063156 Aug 04 03:55:17.294644 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 619/1235] 10.222.0.66 () {58 vars in 1221 bytes} [Thu Aug 4 03:55:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1734149132 => generated 0 bytes in 64 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 03:55:19.310066 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-65c16000-1155-4f5f-ad6a-b44abcb41666 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:55:19.310558 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-65c16000-1155-4f5f-ad6a-b44abcb41666 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] [instance: dc5b13cc-82f3-4f36-abfb-0789cb84b279] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:55:19.317105 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-65c16000-1155-4f5f-ad6a-b44abcb41666 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:55:19.317595 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-65c16000-1155-4f5f-ad6a-b44abcb41666 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:55:19.319198 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-65c16000-1155-4f5f-ad6a-b44abcb41666 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:55:19.319659 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-65c16000-1155-4f5f-ad6a-b44abcb41666 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:55:19.332766 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.wsgi [None req-65c16000-1155-4f5f-ad6a-b44abcb41666 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] HTTP exception thrown: Instance dc5b13cc-82f3-4f36-abfb-0789cb84b279 could not be found. Aug 04 03:55:19.334474 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-65c16000-1155-4f5f-ad6a-b44abcb41666 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Request method failure captured: Aug 04 03:55:19.334474 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: request: DELETE /compute/v2.1/servers/dc5b13cc-82f3-4f36-abfb-0789cb84b279 HTTP/1.1 Aug 04 03:55:19.334474 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Accept: application/json Aug 04 03:55:19.334474 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Accept-Encoding: identity Aug 04 03:55:19.334474 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Connection: close Aug 04 03:55:19.334474 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Content-Length: 0 Aug 04 03:55:19.334474 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Content-Type: application/json Aug 04 03:55:19.334474 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Host: 10.222.0.66 Aug 04 03:55:19.334474 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Openstack-System-Scope: None Aug 04 03:55:19.334474 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: User-Agent: python-urllib3/1.26.11 Aug 04 03:55:19.334474 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Auth-Token: gAAAAABi60EfWo3pxV-WJerz4CV7aLU5sNdQOAjcWGxLQyzzVpQzfisgkZYPF0-VvjdP-4fhqH1P-iVrAYypOKaXop8hglb2CP9bQQNfaUgJfvrw6-mu2g-Bmn1rv5G9df81SkEqY2jauM8WPz4gyORIa-0zWCQz6JGM7HOO6Cyykhfv5KFcQRY Aug 04 03:55:19.334474 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Domain-Id: None Aug 04 03:55:19.334474 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Domain-Name: None Aug 04 03:55:19.334474 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Identity-Status: Confirmed Aug 04 03:55:19.334474 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Is-Admin-Project: True Aug 04 03:55:19.334474 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Project-Domain-Id: default Aug 04 03:55:19.334474 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Project-Domain-Name: Default Aug 04 03:55:19.334474 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Project-Id: a98f18ee8c7d4cfe9f4b879505ca6605 Aug 04 03:55:19.334474 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Project-Name: tempest-AttachVolumeNegativeTest-1888469620 Aug 04 03:55:19.334474 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Role: member,reader Aug 04 03:55:19.334474 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Roles: member,reader Aug 04 03:55:19.336063 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/a98f18ee8c7d4cfe9f4b879505ca6605"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/a98f18ee8c7d4cfe9f4b879505ca6605"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/a98f18ee8c7d4cfe9f4b879505ca6605"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_a98f18ee8c7d4cfe9f4b879505ca6605"}]}] Aug 04 03:55:19.336063 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Tenant: tempest-AttachVolumeNegativeTest-1888469620 Aug 04 03:55:19.336063 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Tenant-Id: a98f18ee8c7d4cfe9f4b879505ca6605 Aug 04 03:55:19.336063 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1888469620 Aug 04 03:55:19.336063 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-User: tempest-AttachVolumeNegativeTest-1888469620-project Aug 04 03:55:19.336063 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-User-Domain-Id: default Aug 04 03:55:19.336063 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-User-Domain-Name: Default Aug 04 03:55:19.336063 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-User-Id: ac99f60384fe4a119d019cedfe1d3557 Aug 04 03:55:19.336063 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-User-Name: tempest-AttachVolumeNegativeTest-1888469620-project Aug 04 03:55:19.336063 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: method: > Aug 04 03:55:19.336063 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: exception: Instance dc5b13cc-82f3-4f36-abfb-0789cb84b279 could not be found. Aug 04 03:55:19.336063 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: action_args: {'id': 'dc5b13cc-82f3-4f36-abfb-0789cb84b279'} Aug 04 03:55:19.336972 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 03:55:19.336972 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 03:55:19.336972 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 03:55:19.336972 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 03:55:19.336972 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 03:55:19.336972 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 03:55:19.336972 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 03:55:19.336972 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 03:55:19.336972 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 03:55:19.336972 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 03:55:19.336972 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc5b13cc-82f3-4f36-abfb-0789cb84b279 could not be found. Aug 04 03:55:19.336972 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Aug 04 03:55:19.336972 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 03:55:19.336972 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Aug 04 03:55:19.336972 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 03:55:19.336972 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 03:55:19.336972 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 03:55:19.336972 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 03:55:19.336972 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 03:55:19.336972 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 03:55:19.338543 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 03:55:19.338543 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 03:55:19.338543 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 03:55:19.338543 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 03:55:19.338543 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 03:55:19.338543 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 03:55:19.338543 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 03:55:19.338543 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 03:55:19.338543 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 03:55:19.338543 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc5b13cc-82f3-4f36-abfb-0789cb84b279 could not be found. Aug 04 03:55:19.338543 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Aug 04 03:55:19.338543 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 03:55:19.338543 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Aug 04 03:55:19.338543 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 03:55:19.338543 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 03:55:19.338543 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 03:55:19.338543 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 03:55:19.338543 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 03:55:19.338543 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc5b13cc-82f3-4f36-abfb-0789cb84b279 could not be found. Aug 04 03:55:19.338543 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Aug 04 03:55:19.340206 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-65c16000-1155-4f5f-ad6a-b44abcb41666 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Returning 404 to user: Instance dc5b13cc-82f3-4f36-abfb-0789cb84b279 could not be found. {{(pid=130263) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 03:55:19.340206 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-65c16000-1155-4f5f-ad6a-b44abcb41666 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] 10.222.0.66 "DELETE /compute/v2.1/servers/dc5b13cc-82f3-4f36-abfb-0789cb84b279" status: 404 len: 111 microversion: 2.1 time: 0.029624 Aug 04 03:55:19.340206 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 617/1236] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 03:55:19 2022] DELETE /compute/v2.1/servers/dc5b13cc-82f3-4f36-abfb-0789cb84b279 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 03:55:19.344685 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-5c8e0b0b-a449-480b-94ae-0c70a4588781 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:55:19.345337 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-5c8e0b0b-a449-480b-94ae-0c70a4588781 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] [instance: dc5b13cc-82f3-4f36-abfb-0789cb84b279] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:55:19.352255 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-5c8e0b0b-a449-480b-94ae-0c70a4588781 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:55:19.352707 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-5c8e0b0b-a449-480b-94ae-0c70a4588781 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:55:19.353512 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-5c8e0b0b-a449-480b-94ae-0c70a4588781 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:55:19.353950 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-5c8e0b0b-a449-480b-94ae-0c70a4588781 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:55:19.367171 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.wsgi [None req-5c8e0b0b-a449-480b-94ae-0c70a4588781 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] HTTP exception thrown: Instance dc5b13cc-82f3-4f36-abfb-0789cb84b279 could not be found. Aug 04 03:55:19.368789 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-5c8e0b0b-a449-480b-94ae-0c70a4588781 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Request method failure captured: Aug 04 03:55:19.368789 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: request: GET /compute/v2.1/servers/dc5b13cc-82f3-4f36-abfb-0789cb84b279 HTTP/1.1 Aug 04 03:55:19.368789 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: Accept: application/json Aug 04 03:55:19.368789 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: Accept-Encoding: identity Aug 04 03:55:19.368789 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: Connection: close Aug 04 03:55:19.368789 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: Content-Length: 0 Aug 04 03:55:19.368789 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: Content-Type: application/json Aug 04 03:55:19.368789 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: Host: 10.222.0.66 Aug 04 03:55:19.368789 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: Openstack-System-Scope: None Aug 04 03:55:19.368789 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: User-Agent: python-urllib3/1.26.11 Aug 04 03:55:19.368789 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Auth-Token: gAAAAABi60EfWo3pxV-WJerz4CV7aLU5sNdQOAjcWGxLQyzzVpQzfisgkZYPF0-VvjdP-4fhqH1P-iVrAYypOKaXop8hglb2CP9bQQNfaUgJfvrw6-mu2g-Bmn1rv5G9df81SkEqY2jauM8WPz4gyORIa-0zWCQz6JGM7HOO6Cyykhfv5KFcQRY Aug 04 03:55:19.368789 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Domain-Id: None Aug 04 03:55:19.368789 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Domain-Name: None Aug 04 03:55:19.368789 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Identity-Status: Confirmed Aug 04 03:55:19.368789 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Is-Admin-Project: True Aug 04 03:55:19.368789 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Project-Domain-Id: default Aug 04 03:55:19.368789 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Project-Domain-Name: Default Aug 04 03:55:19.368789 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Project-Id: a98f18ee8c7d4cfe9f4b879505ca6605 Aug 04 03:55:19.368789 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Project-Name: tempest-AttachVolumeNegativeTest-1888469620 Aug 04 03:55:19.368789 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Role: member,reader Aug 04 03:55:19.368789 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Roles: member,reader Aug 04 03:55:19.370400 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/a98f18ee8c7d4cfe9f4b879505ca6605"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/a98f18ee8c7d4cfe9f4b879505ca6605"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/a98f18ee8c7d4cfe9f4b879505ca6605"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_a98f18ee8c7d4cfe9f4b879505ca6605"}]}] Aug 04 03:55:19.370400 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Tenant: tempest-AttachVolumeNegativeTest-1888469620 Aug 04 03:55:19.370400 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Tenant-Id: a98f18ee8c7d4cfe9f4b879505ca6605 Aug 04 03:55:19.370400 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1888469620 Aug 04 03:55:19.370400 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-User: tempest-AttachVolumeNegativeTest-1888469620-project Aug 04 03:55:19.370400 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-User-Domain-Id: default Aug 04 03:55:19.370400 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-User-Domain-Name: Default Aug 04 03:55:19.370400 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-User-Id: ac99f60384fe4a119d019cedfe1d3557 Aug 04 03:55:19.370400 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-User-Name: tempest-AttachVolumeNegativeTest-1888469620-project Aug 04 03:55:19.370400 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: method: > Aug 04 03:55:19.370400 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: exception: Instance dc5b13cc-82f3-4f36-abfb-0789cb84b279 could not be found. Aug 04 03:55:19.370400 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: action_args: {'id': 'dc5b13cc-82f3-4f36-abfb-0789cb84b279'} Aug 04 03:55:19.371318 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 03:55:19.371318 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 03:55:19.371318 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 03:55:19.371318 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 03:55:19.371318 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 03:55:19.371318 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 03:55:19.371318 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 03:55:19.371318 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 03:55:19.371318 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 03:55:19.371318 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 03:55:19.371318 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc5b13cc-82f3-4f36-abfb-0789cb84b279 could not be found. Aug 04 03:55:19.371318 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi Aug 04 03:55:19.371318 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 03:55:19.371318 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi Aug 04 03:55:19.371318 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 03:55:19.371318 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 03:55:19.371318 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 03:55:19.371318 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 03:55:19.371318 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 03:55:19.371318 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 03:55:19.372785 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 03:55:19.372785 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 03:55:19.372785 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 03:55:19.372785 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 03:55:19.372785 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 03:55:19.372785 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 03:55:19.372785 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 03:55:19.372785 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc5b13cc-82f3-4f36-abfb-0789cb84b279 could not be found. Aug 04 03:55:19.372785 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi Aug 04 03:55:19.372785 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 03:55:19.372785 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi Aug 04 03:55:19.372785 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 03:55:19.372785 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 03:55:19.372785 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 03:55:19.372785 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 03:55:19.372785 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 03:55:19.372785 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc5b13cc-82f3-4f36-abfb-0789cb84b279 could not be found. Aug 04 03:55:19.372785 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi Aug 04 03:55:19.376722 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-5c8e0b0b-a449-480b-94ae-0c70a4588781 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Returning 404 to user: Instance dc5b13cc-82f3-4f36-abfb-0789cb84b279 could not be found. {{(pid=130262) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 03:55:19.376722 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-5c8e0b0b-a449-480b-94ae-0c70a4588781 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] 10.222.0.66 "GET /compute/v2.1/servers/dc5b13cc-82f3-4f36-abfb-0789cb84b279" status: 404 len: 111 microversion: 2.1 time: 0.029813 Aug 04 03:55:19.376722 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 620/1237] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:55:19 2022] GET /compute/v2.1/servers/dc5b13cc-82f3-4f36-abfb-0789cb84b279 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 03:55:20.642073 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-371adb8f-dabd-4587-bf21-4d1ce70004f7 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:55:20.642608 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-371adb8f-dabd-4587-bf21-4d1ce70004f7 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] [instance: 43706117-d608-45d0-87cf-1ad6774c77ce] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:55:20.650108 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-371adb8f-dabd-4587-bf21-4d1ce70004f7 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:55:20.650815 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-371adb8f-dabd-4587-bf21-4d1ce70004f7 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:55:20.651589 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-371adb8f-dabd-4587-bf21-4d1ce70004f7 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:55:20.652026 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-371adb8f-dabd-4587-bf21-4d1ce70004f7 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:55:20.665456 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.wsgi [None req-371adb8f-dabd-4587-bf21-4d1ce70004f7 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] HTTP exception thrown: Instance 43706117-d608-45d0-87cf-1ad6774c77ce could not be found. Aug 04 03:55:20.670544 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-371adb8f-dabd-4587-bf21-4d1ce70004f7 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Request method failure captured: Aug 04 03:55:20.670544 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: request: DELETE /compute/v2.1/servers/43706117-d608-45d0-87cf-1ad6774c77ce HTTP/1.1 Aug 04 03:55:20.670544 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Accept: application/json Aug 04 03:55:20.670544 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Accept-Encoding: identity Aug 04 03:55:20.670544 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Connection: close Aug 04 03:55:20.670544 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Content-Length: 0 Aug 04 03:55:20.670544 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Content-Type: application/json Aug 04 03:55:20.670544 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Host: 10.222.0.66 Aug 04 03:55:20.670544 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Openstack-System-Scope: None Aug 04 03:55:20.670544 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: User-Agent: python-urllib3/1.26.11 Aug 04 03:55:20.670544 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Auth-Token: gAAAAABi60EfWo3pxV-WJerz4CV7aLU5sNdQOAjcWGxLQyzzVpQzfisgkZYPF0-VvjdP-4fhqH1P-iVrAYypOKaXop8hglb2CP9bQQNfaUgJfvrw6-mu2g-Bmn1rv5G9df81SkEqY2jauM8WPz4gyORIa-0zWCQz6JGM7HOO6Cyykhfv5KFcQRY Aug 04 03:55:20.670544 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Domain-Id: None Aug 04 03:55:20.670544 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Domain-Name: None Aug 04 03:55:20.670544 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Identity-Status: Confirmed Aug 04 03:55:20.670544 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Is-Admin-Project: True Aug 04 03:55:20.670544 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Project-Domain-Id: default Aug 04 03:55:20.670544 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Project-Domain-Name: Default Aug 04 03:55:20.670544 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Project-Id: a98f18ee8c7d4cfe9f4b879505ca6605 Aug 04 03:55:20.670544 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Project-Name: tempest-AttachVolumeNegativeTest-1888469620 Aug 04 03:55:20.670544 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Role: member,reader Aug 04 03:55:20.670544 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Roles: member,reader Aug 04 03:55:20.672174 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/a98f18ee8c7d4cfe9f4b879505ca6605"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/a98f18ee8c7d4cfe9f4b879505ca6605"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/a98f18ee8c7d4cfe9f4b879505ca6605"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_a98f18ee8c7d4cfe9f4b879505ca6605"}]}] Aug 04 03:55:20.672174 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Tenant: tempest-AttachVolumeNegativeTest-1888469620 Aug 04 03:55:20.672174 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Tenant-Id: a98f18ee8c7d4cfe9f4b879505ca6605 Aug 04 03:55:20.672174 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1888469620 Aug 04 03:55:20.672174 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-User: tempest-AttachVolumeNegativeTest-1888469620-project Aug 04 03:55:20.672174 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-User-Domain-Id: default Aug 04 03:55:20.672174 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-User-Domain-Name: Default Aug 04 03:55:20.672174 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-User-Id: ac99f60384fe4a119d019cedfe1d3557 Aug 04 03:55:20.672174 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-User-Name: tempest-AttachVolumeNegativeTest-1888469620-project Aug 04 03:55:20.672174 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: method: > Aug 04 03:55:20.672174 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: exception: Instance 43706117-d608-45d0-87cf-1ad6774c77ce could not be found. Aug 04 03:55:20.672174 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: action_args: {'id': '43706117-d608-45d0-87cf-1ad6774c77ce'} Aug 04 03:55:20.673004 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 03:55:20.673004 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 03:55:20.673004 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 03:55:20.673004 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 03:55:20.673004 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 03:55:20.673004 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 03:55:20.673004 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 03:55:20.673004 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 03:55:20.673004 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 03:55:20.673004 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 03:55:20.673004 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43706117-d608-45d0-87cf-1ad6774c77ce could not be found. Aug 04 03:55:20.673004 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Aug 04 03:55:20.673004 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 03:55:20.673004 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Aug 04 03:55:20.673004 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 03:55:20.673004 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 03:55:20.673004 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 03:55:20.673004 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 03:55:20.673004 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 03:55:20.673004 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 03:55:20.674330 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 03:55:20.674330 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 03:55:20.674330 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 03:55:20.674330 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 03:55:20.674330 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 03:55:20.674330 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 03:55:20.674330 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 03:55:20.674330 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 03:55:20.674330 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 03:55:20.674330 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43706117-d608-45d0-87cf-1ad6774c77ce could not be found. Aug 04 03:55:20.674330 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Aug 04 03:55:20.674330 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 03:55:20.674330 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Aug 04 03:55:20.674330 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 03:55:20.674330 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 03:55:20.674330 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 03:55:20.674330 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 03:55:20.674330 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 03:55:20.674330 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43706117-d608-45d0-87cf-1ad6774c77ce could not be found. Aug 04 03:55:20.674330 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Aug 04 03:55:20.675546 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-371adb8f-dabd-4587-bf21-4d1ce70004f7 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Returning 404 to user: Instance 43706117-d608-45d0-87cf-1ad6774c77ce could not be found. {{(pid=130263) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 03:55:20.675546 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-371adb8f-dabd-4587-bf21-4d1ce70004f7 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] 10.222.0.66 "DELETE /compute/v2.1/servers/43706117-d608-45d0-87cf-1ad6774c77ce" status: 404 len: 111 microversion: 2.1 time: 0.030243 Aug 04 03:55:20.675546 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 618/1238] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 03:55:20 2022] DELETE /compute/v2.1/servers/43706117-d608-45d0-87cf-1ad6774c77ce => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 03:55:20.677922 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-f7cfa9ef-b225-4a2e-a1a1-7e19dc01b458 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:55:20.678921 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-f7cfa9ef-b225-4a2e-a1a1-7e19dc01b458 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] [instance: 43706117-d608-45d0-87cf-1ad6774c77ce] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:55:20.685404 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-f7cfa9ef-b225-4a2e-a1a1-7e19dc01b458 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:55:20.685847 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-f7cfa9ef-b225-4a2e-a1a1-7e19dc01b458 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:55:20.686600 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-f7cfa9ef-b225-4a2e-a1a1-7e19dc01b458 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:55:20.687032 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-f7cfa9ef-b225-4a2e-a1a1-7e19dc01b458 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:55:20.701407 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.wsgi [None req-f7cfa9ef-b225-4a2e-a1a1-7e19dc01b458 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] HTTP exception thrown: Instance 43706117-d608-45d0-87cf-1ad6774c77ce could not be found. Aug 04 03:55:20.703049 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-f7cfa9ef-b225-4a2e-a1a1-7e19dc01b458 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Request method failure captured: Aug 04 03:55:20.703049 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: request: GET /compute/v2.1/servers/43706117-d608-45d0-87cf-1ad6774c77ce HTTP/1.1 Aug 04 03:55:20.703049 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: Accept: application/json Aug 04 03:55:20.703049 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: Accept-Encoding: identity Aug 04 03:55:20.703049 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: Connection: close Aug 04 03:55:20.703049 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: Content-Length: 0 Aug 04 03:55:20.703049 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: Content-Type: application/json Aug 04 03:55:20.703049 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: Host: 10.222.0.66 Aug 04 03:55:20.703049 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: Openstack-System-Scope: None Aug 04 03:55:20.703049 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: User-Agent: python-urllib3/1.26.11 Aug 04 03:55:20.703049 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Auth-Token: gAAAAABi60EfWo3pxV-WJerz4CV7aLU5sNdQOAjcWGxLQyzzVpQzfisgkZYPF0-VvjdP-4fhqH1P-iVrAYypOKaXop8hglb2CP9bQQNfaUgJfvrw6-mu2g-Bmn1rv5G9df81SkEqY2jauM8WPz4gyORIa-0zWCQz6JGM7HOO6Cyykhfv5KFcQRY Aug 04 03:55:20.703049 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Domain-Id: None Aug 04 03:55:20.703049 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Domain-Name: None Aug 04 03:55:20.703049 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Identity-Status: Confirmed Aug 04 03:55:20.703049 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Is-Admin-Project: True Aug 04 03:55:20.703049 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Project-Domain-Id: default Aug 04 03:55:20.703049 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Project-Domain-Name: Default Aug 04 03:55:20.703049 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Project-Id: a98f18ee8c7d4cfe9f4b879505ca6605 Aug 04 03:55:20.703049 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Project-Name: tempest-AttachVolumeNegativeTest-1888469620 Aug 04 03:55:20.703049 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Role: member,reader Aug 04 03:55:20.703049 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Roles: member,reader Aug 04 03:55:20.704590 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/a98f18ee8c7d4cfe9f4b879505ca6605"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/a98f18ee8c7d4cfe9f4b879505ca6605"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/a98f18ee8c7d4cfe9f4b879505ca6605"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_a98f18ee8c7d4cfe9f4b879505ca6605"}]}] Aug 04 03:55:20.704590 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Tenant: tempest-AttachVolumeNegativeTest-1888469620 Aug 04 03:55:20.704590 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Tenant-Id: a98f18ee8c7d4cfe9f4b879505ca6605 Aug 04 03:55:20.704590 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1888469620 Aug 04 03:55:20.704590 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-User: tempest-AttachVolumeNegativeTest-1888469620-project Aug 04 03:55:20.704590 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-User-Domain-Id: default Aug 04 03:55:20.704590 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-User-Domain-Name: Default Aug 04 03:55:20.704590 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-User-Id: ac99f60384fe4a119d019cedfe1d3557 Aug 04 03:55:20.704590 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-User-Name: tempest-AttachVolumeNegativeTest-1888469620-project Aug 04 03:55:20.704590 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: method: > Aug 04 03:55:20.704590 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: exception: Instance 43706117-d608-45d0-87cf-1ad6774c77ce could not be found. Aug 04 03:55:20.704590 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: action_args: {'id': '43706117-d608-45d0-87cf-1ad6774c77ce'} Aug 04 03:55:20.705626 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 03:55:20.705626 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 03:55:20.705626 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 03:55:20.705626 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 03:55:20.705626 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 03:55:20.705626 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 03:55:20.705626 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 03:55:20.705626 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 03:55:20.705626 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 03:55:20.705626 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 03:55:20.705626 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43706117-d608-45d0-87cf-1ad6774c77ce could not be found. Aug 04 03:55:20.705626 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi Aug 04 03:55:20.705626 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 03:55:20.705626 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi Aug 04 03:55:20.705626 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 03:55:20.705626 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 03:55:20.705626 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 03:55:20.705626 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 03:55:20.705626 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 03:55:20.705626 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 03:55:20.707078 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 03:55:20.707078 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 03:55:20.707078 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 03:55:20.707078 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 03:55:20.707078 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 03:55:20.707078 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 03:55:20.707078 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 03:55:20.707078 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43706117-d608-45d0-87cf-1ad6774c77ce could not be found. Aug 04 03:55:20.707078 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi Aug 04 03:55:20.707078 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 03:55:20.707078 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi Aug 04 03:55:20.707078 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 03:55:20.707078 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 03:55:20.707078 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 03:55:20.707078 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 03:55:20.707078 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 03:55:20.707078 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43706117-d608-45d0-87cf-1ad6774c77ce could not be found. Aug 04 03:55:20.707078 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi Aug 04 03:55:20.708941 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-f7cfa9ef-b225-4a2e-a1a1-7e19dc01b458 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Returning 404 to user: Instance 43706117-d608-45d0-87cf-1ad6774c77ce could not be found. {{(pid=130262) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 03:55:20.708941 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-f7cfa9ef-b225-4a2e-a1a1-7e19dc01b458 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] 10.222.0.66 "GET /compute/v2.1/servers/43706117-d608-45d0-87cf-1ad6774c77ce" status: 404 len: 111 microversion: 2.1 time: 0.031008 Aug 04 03:55:20.708941 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 621/1239] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:55:20 2022] GET /compute/v2.1/servers/43706117-d608-45d0-87cf-1ad6774c77ce => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 03:55:20.713277 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-e6f78993-fe6a-4c57-8b4b-72818e3f89b8 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:55:20.713810 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-e6f78993-fe6a-4c57-8b4b-72818e3f89b8 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] [instance: edb69fe3-e255-4e54-8e08-fff8bbc28d4f] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:55:20.720203 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-e6f78993-fe6a-4c57-8b4b-72818e3f89b8 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:55:20.720656 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-e6f78993-fe6a-4c57-8b4b-72818e3f89b8 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:55:20.721725 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-e6f78993-fe6a-4c57-8b4b-72818e3f89b8 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:55:20.721933 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-e6f78993-fe6a-4c57-8b4b-72818e3f89b8 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:55:20.735826 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.wsgi [None req-e6f78993-fe6a-4c57-8b4b-72818e3f89b8 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] HTTP exception thrown: Instance edb69fe3-e255-4e54-8e08-fff8bbc28d4f could not be found. Aug 04 03:55:20.737401 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-e6f78993-fe6a-4c57-8b4b-72818e3f89b8 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Request method failure captured: Aug 04 03:55:20.737401 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: request: DELETE /compute/v2.1/servers/edb69fe3-e255-4e54-8e08-fff8bbc28d4f HTTP/1.1 Aug 04 03:55:20.737401 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Accept: application/json Aug 04 03:55:20.737401 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Accept-Encoding: identity Aug 04 03:55:20.737401 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Connection: close Aug 04 03:55:20.737401 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Content-Length: 0 Aug 04 03:55:20.737401 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Content-Type: application/json Aug 04 03:55:20.737401 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Host: 10.222.0.66 Aug 04 03:55:20.737401 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Openstack-System-Scope: None Aug 04 03:55:20.737401 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: User-Agent: python-urllib3/1.26.11 Aug 04 03:55:20.737401 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Auth-Token: gAAAAABi60EfWo3pxV-WJerz4CV7aLU5sNdQOAjcWGxLQyzzVpQzfisgkZYPF0-VvjdP-4fhqH1P-iVrAYypOKaXop8hglb2CP9bQQNfaUgJfvrw6-mu2g-Bmn1rv5G9df81SkEqY2jauM8WPz4gyORIa-0zWCQz6JGM7HOO6Cyykhfv5KFcQRY Aug 04 03:55:20.737401 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Domain-Id: None Aug 04 03:55:20.737401 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Domain-Name: None Aug 04 03:55:20.737401 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Identity-Status: Confirmed Aug 04 03:55:20.737401 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Is-Admin-Project: True Aug 04 03:55:20.737401 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Project-Domain-Id: default Aug 04 03:55:20.737401 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Project-Domain-Name: Default Aug 04 03:55:20.737401 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Project-Id: a98f18ee8c7d4cfe9f4b879505ca6605 Aug 04 03:55:20.737401 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Project-Name: tempest-AttachVolumeNegativeTest-1888469620 Aug 04 03:55:20.737401 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Role: member,reader Aug 04 03:55:20.737401 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Roles: member,reader Aug 04 03:55:20.738996 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/a98f18ee8c7d4cfe9f4b879505ca6605"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/a98f18ee8c7d4cfe9f4b879505ca6605"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/a98f18ee8c7d4cfe9f4b879505ca6605"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_a98f18ee8c7d4cfe9f4b879505ca6605"}]}] Aug 04 03:55:20.738996 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Tenant: tempest-AttachVolumeNegativeTest-1888469620 Aug 04 03:55:20.738996 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Tenant-Id: a98f18ee8c7d4cfe9f4b879505ca6605 Aug 04 03:55:20.738996 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1888469620 Aug 04 03:55:20.738996 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-User: tempest-AttachVolumeNegativeTest-1888469620-project Aug 04 03:55:20.738996 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-User-Domain-Id: default Aug 04 03:55:20.738996 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-User-Domain-Name: Default Aug 04 03:55:20.738996 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-User-Id: ac99f60384fe4a119d019cedfe1d3557 Aug 04 03:55:20.738996 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-User-Name: tempest-AttachVolumeNegativeTest-1888469620-project Aug 04 03:55:20.738996 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: method: > Aug 04 03:55:20.738996 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: exception: Instance edb69fe3-e255-4e54-8e08-fff8bbc28d4f could not be found. Aug 04 03:55:20.738996 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: action_args: {'id': 'edb69fe3-e255-4e54-8e08-fff8bbc28d4f'} Aug 04 03:55:20.740427 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 03:55:20.740427 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 03:55:20.740427 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 03:55:20.740427 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 03:55:20.740427 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 03:55:20.740427 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 03:55:20.740427 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 03:55:20.740427 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 03:55:20.740427 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 03:55:20.740427 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 03:55:20.740427 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance edb69fe3-e255-4e54-8e08-fff8bbc28d4f could not be found. Aug 04 03:55:20.740427 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Aug 04 03:55:20.740427 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 03:55:20.740427 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Aug 04 03:55:20.740427 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 03:55:20.740427 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 03:55:20.740427 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 03:55:20.740427 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 03:55:20.740427 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 03:55:20.740427 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 03:55:20.741928 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 03:55:20.741928 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 03:55:20.741928 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 03:55:20.741928 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 03:55:20.741928 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 03:55:20.741928 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 03:55:20.741928 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 03:55:20.741928 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 03:55:20.741928 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 03:55:20.741928 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance edb69fe3-e255-4e54-8e08-fff8bbc28d4f could not be found. Aug 04 03:55:20.741928 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Aug 04 03:55:20.741928 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 03:55:20.741928 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Aug 04 03:55:20.741928 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 03:55:20.741928 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 03:55:20.741928 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 03:55:20.741928 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 03:55:20.741928 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 03:55:20.741928 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance edb69fe3-e255-4e54-8e08-fff8bbc28d4f could not be found. Aug 04 03:55:20.741928 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Aug 04 03:55:20.743307 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-e6f78993-fe6a-4c57-8b4b-72818e3f89b8 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Returning 404 to user: Instance edb69fe3-e255-4e54-8e08-fff8bbc28d4f could not be found. {{(pid=130263) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 03:55:20.743307 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-e6f78993-fe6a-4c57-8b4b-72818e3f89b8 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] 10.222.0.66 "DELETE /compute/v2.1/servers/edb69fe3-e255-4e54-8e08-fff8bbc28d4f" status: 404 len: 111 microversion: 2.1 time: 0.029662 Aug 04 03:55:20.743307 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 619/1240] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 03:55:20 2022] DELETE /compute/v2.1/servers/edb69fe3-e255-4e54-8e08-fff8bbc28d4f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 03:55:20.748070 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-5f5fcc4d-c60f-4aaa-82c8-973681f7d951 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:55:20.748685 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-5f5fcc4d-c60f-4aaa-82c8-973681f7d951 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] [instance: edb69fe3-e255-4e54-8e08-fff8bbc28d4f] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:55:20.754904 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-5f5fcc4d-c60f-4aaa-82c8-973681f7d951 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:55:20.755355 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-5f5fcc4d-c60f-4aaa-82c8-973681f7d951 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:55:20.756700 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-5f5fcc4d-c60f-4aaa-82c8-973681f7d951 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:55:20.757139 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-5f5fcc4d-c60f-4aaa-82c8-973681f7d951 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:55:20.770805 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.wsgi [None req-5f5fcc4d-c60f-4aaa-82c8-973681f7d951 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] HTTP exception thrown: Instance edb69fe3-e255-4e54-8e08-fff8bbc28d4f could not be found. Aug 04 03:55:20.772366 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-5f5fcc4d-c60f-4aaa-82c8-973681f7d951 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Request method failure captured: Aug 04 03:55:20.772366 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: request: GET /compute/v2.1/servers/edb69fe3-e255-4e54-8e08-fff8bbc28d4f HTTP/1.1 Aug 04 03:55:20.772366 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: Accept: application/json Aug 04 03:55:20.772366 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: Accept-Encoding: identity Aug 04 03:55:20.772366 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: Connection: close Aug 04 03:55:20.772366 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: Content-Length: 0 Aug 04 03:55:20.772366 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: Content-Type: application/json Aug 04 03:55:20.772366 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: Host: 10.222.0.66 Aug 04 03:55:20.772366 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: Openstack-System-Scope: None Aug 04 03:55:20.772366 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: User-Agent: python-urllib3/1.26.11 Aug 04 03:55:20.772366 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Auth-Token: gAAAAABi60EfWo3pxV-WJerz4CV7aLU5sNdQOAjcWGxLQyzzVpQzfisgkZYPF0-VvjdP-4fhqH1P-iVrAYypOKaXop8hglb2CP9bQQNfaUgJfvrw6-mu2g-Bmn1rv5G9df81SkEqY2jauM8WPz4gyORIa-0zWCQz6JGM7HOO6Cyykhfv5KFcQRY Aug 04 03:55:20.772366 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Domain-Id: None Aug 04 03:55:20.772366 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Domain-Name: None Aug 04 03:55:20.772366 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Identity-Status: Confirmed Aug 04 03:55:20.772366 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Is-Admin-Project: True Aug 04 03:55:20.772366 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Project-Domain-Id: default Aug 04 03:55:20.772366 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Project-Domain-Name: Default Aug 04 03:55:20.772366 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Project-Id: a98f18ee8c7d4cfe9f4b879505ca6605 Aug 04 03:55:20.772366 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Project-Name: tempest-AttachVolumeNegativeTest-1888469620 Aug 04 03:55:20.772366 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Role: member,reader Aug 04 03:55:20.772366 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Roles: member,reader Aug 04 03:55:20.773979 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/a98f18ee8c7d4cfe9f4b879505ca6605"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/a98f18ee8c7d4cfe9f4b879505ca6605"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/a98f18ee8c7d4cfe9f4b879505ca6605"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_a98f18ee8c7d4cfe9f4b879505ca6605"}]}] Aug 04 03:55:20.773979 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Tenant: tempest-AttachVolumeNegativeTest-1888469620 Aug 04 03:55:20.773979 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Tenant-Id: a98f18ee8c7d4cfe9f4b879505ca6605 Aug 04 03:55:20.773979 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1888469620 Aug 04 03:55:20.773979 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-User: tempest-AttachVolumeNegativeTest-1888469620-project Aug 04 03:55:20.773979 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-User-Domain-Id: default Aug 04 03:55:20.773979 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-User-Domain-Name: Default Aug 04 03:55:20.773979 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-User-Id: ac99f60384fe4a119d019cedfe1d3557 Aug 04 03:55:20.773979 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-User-Name: tempest-AttachVolumeNegativeTest-1888469620-project Aug 04 03:55:20.773979 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: method: > Aug 04 03:55:20.773979 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: exception: Instance edb69fe3-e255-4e54-8e08-fff8bbc28d4f could not be found. Aug 04 03:55:20.773979 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: action_args: {'id': 'edb69fe3-e255-4e54-8e08-fff8bbc28d4f'} Aug 04 03:55:20.774883 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 03:55:20.774883 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 03:55:20.774883 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 03:55:20.774883 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 03:55:20.774883 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 03:55:20.774883 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 03:55:20.774883 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 03:55:20.774883 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 03:55:20.774883 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 03:55:20.774883 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 03:55:20.774883 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance edb69fe3-e255-4e54-8e08-fff8bbc28d4f could not be found. Aug 04 03:55:20.774883 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi Aug 04 03:55:20.774883 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 03:55:20.774883 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi Aug 04 03:55:20.774883 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 03:55:20.774883 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 03:55:20.774883 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 03:55:20.774883 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 03:55:20.774883 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 03:55:20.774883 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 03:55:20.776305 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 03:55:20.776305 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 03:55:20.776305 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 03:55:20.776305 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 03:55:20.776305 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 03:55:20.776305 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 03:55:20.776305 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 03:55:20.776305 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance edb69fe3-e255-4e54-8e08-fff8bbc28d4f could not be found. Aug 04 03:55:20.776305 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi Aug 04 03:55:20.776305 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 03:55:20.776305 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi Aug 04 03:55:20.776305 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 03:55:20.776305 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 03:55:20.776305 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 03:55:20.776305 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 03:55:20.776305 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 03:55:20.776305 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance edb69fe3-e255-4e54-8e08-fff8bbc28d4f could not be found. Aug 04 03:55:20.776305 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi Aug 04 03:55:20.777901 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-5f5fcc4d-c60f-4aaa-82c8-973681f7d951 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Returning 404 to user: Instance edb69fe3-e255-4e54-8e08-fff8bbc28d4f could not be found. {{(pid=130262) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 03:55:20.777901 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-5f5fcc4d-c60f-4aaa-82c8-973681f7d951 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] 10.222.0.66 "GET /compute/v2.1/servers/edb69fe3-e255-4e54-8e08-fff8bbc28d4f" status: 404 len: 111 microversion: 2.1 time: 0.029734 Aug 04 03:55:20.777901 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 622/1241] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:55:20 2022] GET /compute/v2.1/servers/edb69fe3-e255-4e54-8e08-fff8bbc28d4f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 03:55:22.096724 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-d3cd72a7-8fce-4e26-a309-61b0cc7ae536 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:55:22.097283 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-d3cd72a7-8fce-4e26-a309-61b0cc7ae536 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] [instance: 2ed39450-289e-4d51-b1b0-c5fe323e6201] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:55:22.104206 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-d3cd72a7-8fce-4e26-a309-61b0cc7ae536 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:55:22.104661 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-d3cd72a7-8fce-4e26-a309-61b0cc7ae536 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:55:22.105455 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-d3cd72a7-8fce-4e26-a309-61b0cc7ae536 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:55:22.105894 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-d3cd72a7-8fce-4e26-a309-61b0cc7ae536 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:55:22.119499 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.wsgi [None req-d3cd72a7-8fce-4e26-a309-61b0cc7ae536 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] HTTP exception thrown: Instance 2ed39450-289e-4d51-b1b0-c5fe323e6201 could not be found. Aug 04 03:55:22.121074 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-d3cd72a7-8fce-4e26-a309-61b0cc7ae536 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Request method failure captured: Aug 04 03:55:22.121074 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: request: DELETE /compute/v2.1/servers/2ed39450-289e-4d51-b1b0-c5fe323e6201 HTTP/1.1 Aug 04 03:55:22.121074 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Accept: application/json Aug 04 03:55:22.121074 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Accept-Encoding: identity Aug 04 03:55:22.121074 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Connection: close Aug 04 03:55:22.121074 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Content-Length: 0 Aug 04 03:55:22.121074 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Content-Type: application/json Aug 04 03:55:22.121074 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Host: 10.222.0.66 Aug 04 03:55:22.121074 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Openstack-System-Scope: None Aug 04 03:55:22.121074 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: User-Agent: python-urllib3/1.26.11 Aug 04 03:55:22.121074 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Auth-Token: gAAAAABi60EfWo3pxV-WJerz4CV7aLU5sNdQOAjcWGxLQyzzVpQzfisgkZYPF0-VvjdP-4fhqH1P-iVrAYypOKaXop8hglb2CP9bQQNfaUgJfvrw6-mu2g-Bmn1rv5G9df81SkEqY2jauM8WPz4gyORIa-0zWCQz6JGM7HOO6Cyykhfv5KFcQRY Aug 04 03:55:22.121074 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Domain-Id: None Aug 04 03:55:22.121074 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Domain-Name: None Aug 04 03:55:22.121074 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Identity-Status: Confirmed Aug 04 03:55:22.121074 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Is-Admin-Project: True Aug 04 03:55:22.121074 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Project-Domain-Id: default Aug 04 03:55:22.121074 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Project-Domain-Name: Default Aug 04 03:55:22.121074 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Project-Id: a98f18ee8c7d4cfe9f4b879505ca6605 Aug 04 03:55:22.121074 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Project-Name: tempest-AttachVolumeNegativeTest-1888469620 Aug 04 03:55:22.121074 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Role: member,reader Aug 04 03:55:22.121074 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Roles: member,reader Aug 04 03:55:22.122655 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/a98f18ee8c7d4cfe9f4b879505ca6605"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/a98f18ee8c7d4cfe9f4b879505ca6605"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/a98f18ee8c7d4cfe9f4b879505ca6605"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_a98f18ee8c7d4cfe9f4b879505ca6605"}]}] Aug 04 03:55:22.122655 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Tenant: tempest-AttachVolumeNegativeTest-1888469620 Aug 04 03:55:22.122655 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Tenant-Id: a98f18ee8c7d4cfe9f4b879505ca6605 Aug 04 03:55:22.122655 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1888469620 Aug 04 03:55:22.122655 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-User: tempest-AttachVolumeNegativeTest-1888469620-project Aug 04 03:55:22.122655 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-User-Domain-Id: default Aug 04 03:55:22.122655 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-User-Domain-Name: Default Aug 04 03:55:22.122655 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-User-Id: ac99f60384fe4a119d019cedfe1d3557 Aug 04 03:55:22.122655 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-User-Name: tempest-AttachVolumeNegativeTest-1888469620-project Aug 04 03:55:22.122655 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: method: > Aug 04 03:55:22.122655 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: exception: Instance 2ed39450-289e-4d51-b1b0-c5fe323e6201 could not be found. Aug 04 03:55:22.122655 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: action_args: {'id': '2ed39450-289e-4d51-b1b0-c5fe323e6201'} Aug 04 03:55:22.123531 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 03:55:22.123531 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 03:55:22.123531 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 03:55:22.123531 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 03:55:22.123531 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 03:55:22.123531 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 03:55:22.123531 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 03:55:22.123531 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 03:55:22.123531 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 03:55:22.123531 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 03:55:22.123531 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ed39450-289e-4d51-b1b0-c5fe323e6201 could not be found. Aug 04 03:55:22.123531 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Aug 04 03:55:22.123531 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 03:55:22.123531 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Aug 04 03:55:22.123531 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 03:55:22.123531 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 03:55:22.123531 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 03:55:22.123531 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 03:55:22.123531 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 03:55:22.123531 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 03:55:22.124996 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 03:55:22.124996 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 04 03:55:22.124996 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 04 03:55:22.124996 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 04 03:55:22.124996 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 04 03:55:22.124996 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 03:55:22.124996 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 03:55:22.124996 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 03:55:22.124996 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 03:55:22.124996 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ed39450-289e-4d51-b1b0-c5fe323e6201 could not be found. Aug 04 03:55:22.124996 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Aug 04 03:55:22.124996 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 03:55:22.124996 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Aug 04 03:55:22.124996 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 03:55:22.124996 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 03:55:22.124996 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 03:55:22.124996 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 03:55:22.124996 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 03:55:22.124996 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ed39450-289e-4d51-b1b0-c5fe323e6201 could not be found. Aug 04 03:55:22.124996 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Aug 04 03:55:22.126259 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-d3cd72a7-8fce-4e26-a309-61b0cc7ae536 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Returning 404 to user: Instance 2ed39450-289e-4d51-b1b0-c5fe323e6201 could not be found. {{(pid=130263) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 03:55:22.126259 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-d3cd72a7-8fce-4e26-a309-61b0cc7ae536 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] 10.222.0.66 "DELETE /compute/v2.1/servers/2ed39450-289e-4d51-b1b0-c5fe323e6201" status: 404 len: 111 microversion: 2.1 time: 0.029611 Aug 04 03:55:22.126259 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 620/1242] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 03:55:22 2022] DELETE /compute/v2.1/servers/2ed39450-289e-4d51-b1b0-c5fe323e6201 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 03:55:22.131731 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-426ce8e4-954d-4db6-bc09-8588a9713388 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:55:22.132353 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-426ce8e4-954d-4db6-bc09-8588a9713388 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] [instance: 2ed39450-289e-4d51-b1b0-c5fe323e6201] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:55:22.138822 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-426ce8e4-954d-4db6-bc09-8588a9713388 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:55:22.139272 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-426ce8e4-954d-4db6-bc09-8588a9713388 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:55:22.140041 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-426ce8e4-954d-4db6-bc09-8588a9713388 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:55:22.140479 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-426ce8e4-954d-4db6-bc09-8588a9713388 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:55:22.156050 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.wsgi [None req-426ce8e4-954d-4db6-bc09-8588a9713388 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] HTTP exception thrown: Instance 2ed39450-289e-4d51-b1b0-c5fe323e6201 could not be found. Aug 04 03:55:22.157588 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-426ce8e4-954d-4db6-bc09-8588a9713388 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Request method failure captured: Aug 04 03:55:22.157588 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: request: GET /compute/v2.1/servers/2ed39450-289e-4d51-b1b0-c5fe323e6201 HTTP/1.1 Aug 04 03:55:22.157588 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: Accept: application/json Aug 04 03:55:22.157588 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: Accept-Encoding: identity Aug 04 03:55:22.157588 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: Connection: close Aug 04 03:55:22.157588 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: Content-Length: 0 Aug 04 03:55:22.157588 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: Content-Type: application/json Aug 04 03:55:22.157588 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: Host: 10.222.0.66 Aug 04 03:55:22.157588 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: Openstack-System-Scope: None Aug 04 03:55:22.157588 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: User-Agent: python-urllib3/1.26.11 Aug 04 03:55:22.157588 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Auth-Token: gAAAAABi60EfWo3pxV-WJerz4CV7aLU5sNdQOAjcWGxLQyzzVpQzfisgkZYPF0-VvjdP-4fhqH1P-iVrAYypOKaXop8hglb2CP9bQQNfaUgJfvrw6-mu2g-Bmn1rv5G9df81SkEqY2jauM8WPz4gyORIa-0zWCQz6JGM7HOO6Cyykhfv5KFcQRY Aug 04 03:55:22.157588 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Domain-Id: None Aug 04 03:55:22.157588 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Domain-Name: None Aug 04 03:55:22.157588 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Identity-Status: Confirmed Aug 04 03:55:22.157588 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Is-Admin-Project: True Aug 04 03:55:22.157588 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Project-Domain-Id: default Aug 04 03:55:22.157588 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Project-Domain-Name: Default Aug 04 03:55:22.157588 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Project-Id: a98f18ee8c7d4cfe9f4b879505ca6605 Aug 04 03:55:22.157588 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Project-Name: tempest-AttachVolumeNegativeTest-1888469620 Aug 04 03:55:22.157588 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Role: member,reader Aug 04 03:55:22.157588 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Roles: member,reader Aug 04 03:55:22.159157 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/a98f18ee8c7d4cfe9f4b879505ca6605"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/a98f18ee8c7d4cfe9f4b879505ca6605"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/a98f18ee8c7d4cfe9f4b879505ca6605"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_a98f18ee8c7d4cfe9f4b879505ca6605"}]}] Aug 04 03:55:22.159157 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Tenant: tempest-AttachVolumeNegativeTest-1888469620 Aug 04 03:55:22.159157 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Tenant-Id: a98f18ee8c7d4cfe9f4b879505ca6605 Aug 04 03:55:22.159157 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1888469620 Aug 04 03:55:22.159157 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-User: tempest-AttachVolumeNegativeTest-1888469620-project Aug 04 03:55:22.159157 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-User-Domain-Id: default Aug 04 03:55:22.159157 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-User-Domain-Name: Default Aug 04 03:55:22.159157 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-User-Id: ac99f60384fe4a119d019cedfe1d3557 Aug 04 03:55:22.159157 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: X-User-Name: tempest-AttachVolumeNegativeTest-1888469620-project Aug 04 03:55:22.159157 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: method: > Aug 04 03:55:22.159157 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: exception: Instance 2ed39450-289e-4d51-b1b0-c5fe323e6201 could not be found. Aug 04 03:55:22.159157 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: action_args: {'id': '2ed39450-289e-4d51-b1b0-c5fe323e6201'} Aug 04 03:55:22.160020 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 03:55:22.160020 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 03:55:22.160020 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 03:55:22.160020 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 03:55:22.160020 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 03:55:22.160020 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 03:55:22.160020 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 03:55:22.160020 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 03:55:22.160020 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 03:55:22.160020 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 03:55:22.160020 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ed39450-289e-4d51-b1b0-c5fe323e6201 could not be found. Aug 04 03:55:22.160020 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi Aug 04 03:55:22.160020 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 03:55:22.160020 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi Aug 04 03:55:22.160020 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 03:55:22.160020 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 03:55:22.160020 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 03:55:22.160020 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 03:55:22.160020 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 03:55:22.160020 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 03:55:22.161593 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 03:55:22.161593 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 03:55:22.161593 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 03:55:22.161593 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 03:55:22.161593 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 03:55:22.161593 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 03:55:22.161593 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 03:55:22.161593 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ed39450-289e-4d51-b1b0-c5fe323e6201 could not be found. Aug 04 03:55:22.161593 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi Aug 04 03:55:22.161593 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 03:55:22.161593 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi Aug 04 03:55:22.161593 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 03:55:22.161593 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 03:55:22.161593 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 03:55:22.161593 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 03:55:22.161593 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 03:55:22.161593 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ed39450-289e-4d51-b1b0-c5fe323e6201 could not be found. Aug 04 03:55:22.161593 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: ERROR nova.api.openstack.wsgi Aug 04 03:55:22.163028 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-426ce8e4-954d-4db6-bc09-8588a9713388 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] Returning 404 to user: Instance 2ed39450-289e-4d51-b1b0-c5fe323e6201 could not be found. {{(pid=130262) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 03:55:22.163028 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-426ce8e4-954d-4db6-bc09-8588a9713388 tempest-AttachVolumeNegativeTest-1888469620 tempest-AttachVolumeNegativeTest-1888469620-project] 10.222.0.66 "GET /compute/v2.1/servers/2ed39450-289e-4d51-b1b0-c5fe323e6201" status: 404 len: 111 microversion: 2.1 time: 0.031675 Aug 04 03:55:22.163331 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 623/1243] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:55:22 2022] GET /compute/v2.1/servers/2ed39450-289e-4d51-b1b0-c5fe323e6201 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 03:55:56.787779 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 03:55:56.788287 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Thu Aug 4 03:55:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 03:56:06.233166 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-b5ae0ea0-5f42-43a0-b082-76652975192b tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1868348123", "imageRef": "0208f4b3-1d2f-42e4-a9b4-528bf5066fe1", "flavorRef": "452", "networks": [{"uuid": "03ed1f13-0e98-4f2e-985c-b6028da9a851"}]}} {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 03:56:06.241218 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG dbcounter [-] [130263] Writing DB stats nova_api:SELECT=25,nova_api:UPDATE=1 {{(pid=130263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:56:06.242039 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG dbcounter [-] [130263] Writing DB stats nova_cell1:SELECT=49,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=130263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:56:06.288559 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.network.neutron [None req-b5ae0ea0-5f42-43a0-b082-76652975192b tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] validate_networks() for [('03ed1f13-0e98-4f2e-985c-b6028da9a851', None, None, None, None, None)] {{(pid=130263) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 03:56:06.638698 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.virt.hardware [None req-b5ae0ea0-5f42-43a0-b082-76652975192b tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Flavor limits 0:0:0 {{(pid=130263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 03:56:06.639118 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.virt.hardware [None req-b5ae0ea0-5f42-43a0-b082-76652975192b tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Image limits 0:0:0 {{(pid=130263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 03:56:06.639595 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.virt.hardware [None req-b5ae0ea0-5f42-43a0-b082-76652975192b tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Flavor pref 0:0:0 {{(pid=130263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 03:56:06.640009 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.virt.hardware [None req-b5ae0ea0-5f42-43a0-b082-76652975192b tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Image pref 0:0:0 {{(pid=130263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 03:56:06.640423 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.virt.hardware [None req-b5ae0ea0-5f42-43a0-b082-76652975192b tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 03:56:06.649253 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-b5ae0ea0-5f42-43a0-b082-76652975192b tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:56:06.649757 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-b5ae0ea0-5f42-43a0-b082-76652975192b tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:56:06.650508 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-b5ae0ea0-5f42-43a0-b082-76652975192b tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:56:06.650949 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-b5ae0ea0-5f42-43a0-b082-76652975192b tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:56:06.670825 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.quota [None req-b5ae0ea0-5f42-43a0-b082-76652975192b tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Getting quotas for project 16033dcf8c904cb2af2c8701a4b6a716. Resources: {'instances', 'ram', 'cores'} {{(pid=130263) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 03:56:06.674799 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.quota [None req-b5ae0ea0-5f42-43a0-b082-76652975192b tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Getting quotas for user 47c57945a0bb4fc78a812b7d453fca81 and project 16033dcf8c904cb2af2c8701a4b6a716. Resources: {'instances', 'ram', 'cores'} {{(pid=130263) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 03:56:06.685955 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-b5ae0ea0-5f42-43a0-b082-76652975192b tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Going to run 1 instances... {{(pid=130263) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 03:56:06.688202 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-b5ae0ea0-5f42-43a0-b082-76652975192b tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] [instance: af80abaa-6f64-4133-b2a0-3007d3f17cc0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0208f4b3-1d2f-42e4-a9b4-528bf5066fe1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130263) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 03:56:06.792017 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-b5ae0ea0-5f42-43a0-b082-76652975192b tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.563048 Aug 04 03:56:06.792955 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 621/1244] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 03:56:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 564 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 03:56:06.803857 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-d247873e-e9e3-4505-bf9e-04e0d6c6b529 tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:56:06.804458 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-d247873e-e9e3-4505-bf9e-04e0d6c6b529 tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] [instance: af80abaa-6f64-4133-b2a0-3007d3f17cc0] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:56:06.807188 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG dbcounter [-] [130262] Writing DB stats nova_api:SELECT=23,nova_api:DELETE=1 {{(pid=130262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:56:06.808024 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG dbcounter [-] [130262] Writing DB stats nova_cell1:SELECT=47,nova_cell1:INSERT=1 {{(pid=130262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:56:06.862012 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-d247873e-e9e3-4505-bf9e-04e0d6c6b529 tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c57945a0bb4fc78a812b7d453fca81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16033dcf8c904cb2af2c8701a4b6a716', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:56:06.868556 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-d247873e-e9e3-4505-bf9e-04e0d6c6b529 tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] 10.222.0.66 "GET /compute/v2.1/servers/af80abaa-6f64-4133-b2a0-3007d3f17cc0" status: 200 len: 1219 microversion: 2.1 time: 0.068764 Aug 04 03:56:06.872462 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 624/1245] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:56:06 2022] GET /compute/v2.1/servers/af80abaa-6f64-4133-b2a0-3007d3f17cc0 => generated 1219 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:56:07.889509 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-4a183ac3-e1d1-482e-96e1-0ee6c2a2bb1a tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:56:07.890112 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-4a183ac3-e1d1-482e-96e1-0ee6c2a2bb1a tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] [instance: af80abaa-6f64-4133-b2a0-3007d3f17cc0] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:56:07.946389 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-4a183ac3-e1d1-482e-96e1-0ee6c2a2bb1a tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c57945a0bb4fc78a812b7d453fca81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16033dcf8c904cb2af2c8701a4b6a716', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:56:07.953162 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-4a183ac3-e1d1-482e-96e1-0ee6c2a2bb1a tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] 10.222.0.66 "GET /compute/v2.1/servers/af80abaa-6f64-4133-b2a0-3007d3f17cc0" status: 200 len: 1219 microversion: 2.1 time: 0.068129 Aug 04 03:56:07.958581 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 622/1246] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:56:07 2022] GET /compute/v2.1/servers/af80abaa-6f64-4133-b2a0-3007d3f17cc0 => generated 1219 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:56:08.975433 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-0f05dbe7-cf78-4a43-8100-b663273e4432 tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:56:08.976081 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-0f05dbe7-cf78-4a43-8100-b663273e4432 tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] [instance: af80abaa-6f64-4133-b2a0-3007d3f17cc0] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:56:08.984463 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-0f05dbe7-cf78-4a43-8100-b663273e4432 tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:56:08.984791 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-0f05dbe7-cf78-4a43-8100-b663273e4432 tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:56:08.985803 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-0f05dbe7-cf78-4a43-8100-b663273e4432 tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:56:08.986075 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-0f05dbe7-cf78-4a43-8100-b663273e4432 tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:56:09.052805 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-0f05dbe7-cf78-4a43-8100-b663273e4432 tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c57945a0bb4fc78a812b7d453fca81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16033dcf8c904cb2af2c8701a4b6a716', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:56:09.061784 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-0f05dbe7-cf78-4a43-8100-b663273e4432 tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] 10.222.0.66 "GET /compute/v2.1/servers/af80abaa-6f64-4133-b2a0-3007d3f17cc0" status: 200 len: 1279 microversion: 2.1 time: 0.090898 Aug 04 03:56:09.062662 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 625/1247] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:56:08 2022] GET /compute/v2.1/servers/af80abaa-6f64-4133-b2a0-3007d3f17cc0 => generated 1279 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:56:10.082902 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-aa0b2496-bb38-4ffb-b707-c4a79b6cdee4 tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:56:10.083627 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-aa0b2496-bb38-4ffb-b707-c4a79b6cdee4 tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] [instance: af80abaa-6f64-4133-b2a0-3007d3f17cc0] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:56:10.090527 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-aa0b2496-bb38-4ffb-b707-c4a79b6cdee4 tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:56:10.091040 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-aa0b2496-bb38-4ffb-b707-c4a79b6cdee4 tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:56:10.091821 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-aa0b2496-bb38-4ffb-b707-c4a79b6cdee4 tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:56:10.092253 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-aa0b2496-bb38-4ffb-b707-c4a79b6cdee4 tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:56:10.222385 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-aa0b2496-bb38-4ffb-b707-c4a79b6cdee4 tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c57945a0bb4fc78a812b7d453fca81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16033dcf8c904cb2af2c8701a4b6a716', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:56:10.230376 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-aa0b2496-bb38-4ffb-b707-c4a79b6cdee4 tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] 10.222.0.66 "GET /compute/v2.1/servers/af80abaa-6f64-4133-b2a0-3007d3f17cc0" status: 200 len: 1319 microversion: 2.1 time: 0.151347 Aug 04 03:56:10.231123 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 623/1248] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:56:10 2022] GET /compute/v2.1/servers/af80abaa-6f64-4133-b2a0-3007d3f17cc0 => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:56:10.578773 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [req-f68b171a-a8b2-4d66-8a1d-e64236ae1e64 req-ac276541-7d6a-4b33-ab56-835b3b939f8b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af80abaa-6f64-4133-b2a0-3007d3f17cc0", "tag": "48446476-c6eb-4813-8e3f-d5dfdac0a767"}]} {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 03:56:10.588768 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [req-f68b171a-a8b2-4d66-8a1d-e64236ae1e64 req-ac276541-7d6a-4b33-ab56-835b3b939f8b service nova] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:56:10.589225 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [req-f68b171a-a8b2-4d66-8a1d-e64236ae1e64 req-ac276541-7d6a-4b33-ab56-835b3b939f8b service nova] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:56:10.600872 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.compute.server_external_events [req-f68b171a-a8b2-4d66-8a1d-e64236ae1e64 req-ac276541-7d6a-4b33-ab56-835b3b939f8b service nova] Creating event network-changed:48446476-c6eb-4813-8e3f-d5dfdac0a767 for instance af80abaa-6f64-4133-b2a0-3007d3f17cc0 on hv-cinder-73306 Aug 04 03:56:10.607213 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [req-f68b171a-a8b2-4d66-8a1d-e64236ae1e64 req-ac276541-7d6a-4b33-ab56-835b3b939f8b service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032381 Aug 04 03:56:10.607970 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 626/1249] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 03:56:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 03:56:11.251624 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-e12f2abd-ac9f-49c3-af18-45f7f008ba3b tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:56:11.252241 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-e12f2abd-ac9f-49c3-af18-45f7f008ba3b tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] [instance: af80abaa-6f64-4133-b2a0-3007d3f17cc0] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:56:11.258691 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-e12f2abd-ac9f-49c3-af18-45f7f008ba3b tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:56:11.259139 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-e12f2abd-ac9f-49c3-af18-45f7f008ba3b tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:56:11.259903 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-e12f2abd-ac9f-49c3-af18-45f7f008ba3b tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:56:11.260343 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-e12f2abd-ac9f-49c3-af18-45f7f008ba3b tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:56:11.396351 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-e12f2abd-ac9f-49c3-af18-45f7f008ba3b tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c57945a0bb4fc78a812b7d453fca81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16033dcf8c904cb2af2c8701a4b6a716', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:56:11.404453 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-e12f2abd-ac9f-49c3-af18-45f7f008ba3b tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] 10.222.0.66 "GET /compute/v2.1/servers/af80abaa-6f64-4133-b2a0-3007d3f17cc0" status: 200 len: 1319 microversion: 2.1 time: 0.156694 Aug 04 03:56:11.405026 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 624/1250] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:56:11 2022] GET /compute/v2.1/servers/af80abaa-6f64-4133-b2a0-3007d3f17cc0 => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:56:12.425660 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-e1d99f84-df41-4842-a755-76d3ff261d6e tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:56:12.426284 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-e1d99f84-df41-4842-a755-76d3ff261d6e tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] [instance: af80abaa-6f64-4133-b2a0-3007d3f17cc0] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:56:12.433073 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-e1d99f84-df41-4842-a755-76d3ff261d6e tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:56:12.433699 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-e1d99f84-df41-4842-a755-76d3ff261d6e tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:56:12.434516 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-e1d99f84-df41-4842-a755-76d3ff261d6e tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:56:12.434954 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-e1d99f84-df41-4842-a755-76d3ff261d6e tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:56:12.562918 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-e1d99f84-df41-4842-a755-76d3ff261d6e tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c57945a0bb4fc78a812b7d453fca81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16033dcf8c904cb2af2c8701a4b6a716', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:56:12.570244 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-e1d99f84-df41-4842-a755-76d3ff261d6e tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] 10.222.0.66 "GET /compute/v2.1/servers/af80abaa-6f64-4133-b2a0-3007d3f17cc0" status: 200 len: 1319 microversion: 2.1 time: 0.148896 Aug 04 03:56:12.570800 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 627/1251] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:56:12 2022] GET /compute/v2.1/servers/af80abaa-6f64-4133-b2a0-3007d3f17cc0 => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:56:13.592363 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-818a8c81-3723-4342-9eab-092471953bed tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:56:13.592979 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-818a8c81-3723-4342-9eab-092471953bed tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] [instance: af80abaa-6f64-4133-b2a0-3007d3f17cc0] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:56:13.599795 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-818a8c81-3723-4342-9eab-092471953bed tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:56:13.600245 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-818a8c81-3723-4342-9eab-092471953bed tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:56:13.601008 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-818a8c81-3723-4342-9eab-092471953bed tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:56:13.601471 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-818a8c81-3723-4342-9eab-092471953bed tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:56:13.729471 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-818a8c81-3723-4342-9eab-092471953bed tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c57945a0bb4fc78a812b7d453fca81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16033dcf8c904cb2af2c8701a4b6a716', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:56:13.736937 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-818a8c81-3723-4342-9eab-092471953bed tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] 10.222.0.66 "GET /compute/v2.1/servers/af80abaa-6f64-4133-b2a0-3007d3f17cc0" status: 200 len: 1319 microversion: 2.1 time: 0.149174 Aug 04 03:56:13.737511 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 625/1252] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:56:13 2022] GET /compute/v2.1/servers/af80abaa-6f64-4133-b2a0-3007d3f17cc0 => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:56:14.758106 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-28c7726f-491f-461c-b899-84367681f219 tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:56:14.758642 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-28c7726f-491f-461c-b899-84367681f219 tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] [instance: af80abaa-6f64-4133-b2a0-3007d3f17cc0] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:56:14.765305 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-28c7726f-491f-461c-b899-84367681f219 tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:56:14.765748 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-28c7726f-491f-461c-b899-84367681f219 tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:56:14.766500 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-28c7726f-491f-461c-b899-84367681f219 tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:56:14.766932 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-28c7726f-491f-461c-b899-84367681f219 tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:56:14.935652 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-28c7726f-491f-461c-b899-84367681f219 tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c57945a0bb4fc78a812b7d453fca81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16033dcf8c904cb2af2c8701a4b6a716', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:56:14.942941 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-28c7726f-491f-461c-b899-84367681f219 tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] 10.222.0.66 "GET /compute/v2.1/servers/af80abaa-6f64-4133-b2a0-3007d3f17cc0" status: 200 len: 1319 microversion: 2.1 time: 0.188753 Aug 04 03:56:14.943504 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 628/1253] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:56:14 2022] GET /compute/v2.1/servers/af80abaa-6f64-4133-b2a0-3007d3f17cc0 => generated 1319 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:56:15.963909 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-8f94d210-cd57-4822-a8f4-07a9828a09bf tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:56:15.964521 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-8f94d210-cd57-4822-a8f4-07a9828a09bf tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] [instance: af80abaa-6f64-4133-b2a0-3007d3f17cc0] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:56:15.971846 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-8f94d210-cd57-4822-a8f4-07a9828a09bf tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:56:15.972295 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-8f94d210-cd57-4822-a8f4-07a9828a09bf tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:56:15.973056 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-8f94d210-cd57-4822-a8f4-07a9828a09bf tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:56:15.973521 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-8f94d210-cd57-4822-a8f4-07a9828a09bf tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:56:16.100768 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-8f94d210-cd57-4822-a8f4-07a9828a09bf tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c57945a0bb4fc78a812b7d453fca81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16033dcf8c904cb2af2c8701a4b6a716', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:56:16.108975 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-8f94d210-cd57-4822-a8f4-07a9828a09bf tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] 10.222.0.66 "GET /compute/v2.1/servers/af80abaa-6f64-4133-b2a0-3007d3f17cc0" status: 200 len: 1319 microversion: 2.1 time: 0.149001 Aug 04 03:56:16.109568 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 626/1254] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:56:15 2022] GET /compute/v2.1/servers/af80abaa-6f64-4133-b2a0-3007d3f17cc0 => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:56:16.630341 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [req-9abeaa7d-1545-4956-bb00-ea0c3156992b req-ab297c12-17aa-4fea-bab6-754f4086a600 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af80abaa-6f64-4133-b2a0-3007d3f17cc0", "name": "network-vif-plugged", "status": "completed", "tag": "48446476-c6eb-4813-8e3f-d5dfdac0a767"}]} {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 03:56:16.641792 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [req-9abeaa7d-1545-4956-bb00-ea0c3156992b req-ab297c12-17aa-4fea-bab6-754f4086a600 service nova] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:56:16.642244 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [req-9abeaa7d-1545-4956-bb00-ea0c3156992b req-ab297c12-17aa-4fea-bab6-754f4086a600 service nova] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:56:16.654328 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.compute.server_external_events [req-9abeaa7d-1545-4956-bb00-ea0c3156992b req-ab297c12-17aa-4fea-bab6-754f4086a600 service nova] Creating event network-vif-plugged:48446476-c6eb-4813-8e3f-d5dfdac0a767 for instance af80abaa-6f64-4133-b2a0-3007d3f17cc0 on hv-cinder-73306 Aug 04 03:56:16.659657 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [req-9abeaa7d-1545-4956-bb00-ea0c3156992b req-ab297c12-17aa-4fea-bab6-754f4086a600 service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.151425 Aug 04 03:56:16.660237 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 629/1255] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 03:56:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 03:56:17.129329 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-d05a70b8-7b18-4155-85bd-a5bc04f89ff4 tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:56:17.129941 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-d05a70b8-7b18-4155-85bd-a5bc04f89ff4 tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] [instance: af80abaa-6f64-4133-b2a0-3007d3f17cc0] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:56:17.131808 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG dbcounter [-] [130263] Writing DB stats nova_cell0:SELECT=2 {{(pid=130263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:56:17.137281 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-d05a70b8-7b18-4155-85bd-a5bc04f89ff4 tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:56:17.137730 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-d05a70b8-7b18-4155-85bd-a5bc04f89ff4 tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:56:17.138484 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-d05a70b8-7b18-4155-85bd-a5bc04f89ff4 tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:56:17.138920 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-d05a70b8-7b18-4155-85bd-a5bc04f89ff4 tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:56:17.275522 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-d05a70b8-7b18-4155-85bd-a5bc04f89ff4 tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c57945a0bb4fc78a812b7d453fca81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16033dcf8c904cb2af2c8701a4b6a716', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:56:17.283952 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-d05a70b8-7b18-4155-85bd-a5bc04f89ff4 tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] 10.222.0.66 "GET /compute/v2.1/servers/af80abaa-6f64-4133-b2a0-3007d3f17cc0" status: 200 len: 1319 microversion: 2.1 time: 0.158462 Aug 04 03:56:17.284535 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 627/1256] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:56:17 2022] GET /compute/v2.1/servers/af80abaa-6f64-4133-b2a0-3007d3f17cc0 => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:56:18.304952 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-17c293ef-bf4c-4214-b616-521123403890 tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:56:18.305756 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-17c293ef-bf4c-4214-b616-521123403890 tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] [instance: af80abaa-6f64-4133-b2a0-3007d3f17cc0] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:56:18.307717 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG dbcounter [-] [130262] Writing DB stats nova_cell0:SELECT=2 {{(pid=130262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:56:18.313618 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-17c293ef-bf4c-4214-b616-521123403890 tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:56:18.314067 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-17c293ef-bf4c-4214-b616-521123403890 tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:56:18.314821 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-17c293ef-bf4c-4214-b616-521123403890 tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:56:18.315255 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-17c293ef-bf4c-4214-b616-521123403890 tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:56:18.445267 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-17c293ef-bf4c-4214-b616-521123403890 tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c57945a0bb4fc78a812b7d453fca81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16033dcf8c904cb2af2c8701a4b6a716', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:56:18.452960 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-17c293ef-bf4c-4214-b616-521123403890 tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] 10.222.0.66 "GET /compute/v2.1/servers/af80abaa-6f64-4133-b2a0-3007d3f17cc0" status: 200 len: 1319 microversion: 2.1 time: 0.152115 Aug 04 03:56:18.453565 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 630/1257] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:56:18 2022] GET /compute/v2.1/servers/af80abaa-6f64-4133-b2a0-3007d3f17cc0 => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:56:19.475063 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-f2020fca-9f4a-48b4-b368-4a784e344958 tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:56:19.475688 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-f2020fca-9f4a-48b4-b368-4a784e344958 tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] [instance: af80abaa-6f64-4133-b2a0-3007d3f17cc0] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:56:19.477549 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG dbcounter [-] [130263] Writing DB stats nova_cell0:SELECT=8 {{(pid=130263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:56:19.483148 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-f2020fca-9f4a-48b4-b368-4a784e344958 tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:56:19.483603 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-f2020fca-9f4a-48b4-b368-4a784e344958 tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:56:19.484366 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-f2020fca-9f4a-48b4-b368-4a784e344958 tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:56:19.484807 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-f2020fca-9f4a-48b4-b368-4a784e344958 tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:56:19.615560 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-f2020fca-9f4a-48b4-b368-4a784e344958 tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c57945a0bb4fc78a812b7d453fca81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16033dcf8c904cb2af2c8701a4b6a716', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:56:19.623897 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-f2020fca-9f4a-48b4-b368-4a784e344958 tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] 10.222.0.66 "GET /compute/v2.1/servers/af80abaa-6f64-4133-b2a0-3007d3f17cc0" status: 200 len: 1508 microversion: 2.1 time: 0.152950 Aug 04 03:56:19.624477 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 628/1258] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:56:19 2022] GET /compute/v2.1/servers/af80abaa-6f64-4133-b2a0-3007d3f17cc0 => generated 1508 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:56:41.315413 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-c1454cbd-b0b8-46ed-82bd-b52903fb7026 tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "282799de-922e-49c5-86b7-a1592d9831fa", "device": "/dev/sdb"}} {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 03:56:41.318428 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-c1454cbd-b0b8-46ed-82bd-b52903fb7026 tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] [instance: af80abaa-6f64-4133-b2a0-3007d3f17cc0] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:56:41.320531 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG dbcounter [-] [130262] Writing DB stats nova_api:SELECT=16 {{(pid=130262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:56:41.321365 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG dbcounter [-] [130262] Writing DB stats nova_cell1:SELECT=28 {{(pid=130262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:56:41.326036 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-c1454cbd-b0b8-46ed-82bd-b52903fb7026 tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:56:41.326486 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-c1454cbd-b0b8-46ed-82bd-b52903fb7026 tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:56:41.327257 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-c1454cbd-b0b8-46ed-82bd-b52903fb7026 tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:56:41.328077 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-c1454cbd-b0b8-46ed-82bd-b52903fb7026 tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:56:42.099871 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-c1454cbd-b0b8-46ed-82bd-b52903fb7026 tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] 10.222.0.66 "POST /compute/v2.1/servers/af80abaa-6f64-4133-b2a0-3007d3f17cc0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.789095 Aug 04 03:56:42.100471 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 631/1259] 10.222.0.66 () {60 vars in 1323 bytes} [Thu Aug 4 03:56:41 2022] POST /compute/v2.1/servers/af80abaa-6f64-4133-b2a0-3007d3f17cc0/os-volume_attachments => generated 194 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 03:57:10.050440 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-eeebc3d9-d4ae-4121-b6c3-d7a5be50d212 tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:57:10.052228 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-eeebc3d9-d4ae-4121-b6c3-d7a5be50d212 tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] [instance: af80abaa-6f64-4133-b2a0-3007d3f17cc0] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:57:10.053279 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG dbcounter [-] [130263] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=130263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:57:10.053985 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG dbcounter [-] [130263] Writing DB stats nova_cell1:SELECT=38 {{(pid=130263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:57:10.058761 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-eeebc3d9-d4ae-4121-b6c3-d7a5be50d212 tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:57:10.059204 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-eeebc3d9-d4ae-4121-b6c3-d7a5be50d212 tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:57:10.059980 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-eeebc3d9-d4ae-4121-b6c3-d7a5be50d212 tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:57:10.060397 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-eeebc3d9-d4ae-4121-b6c3-d7a5be50d212 tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:57:10.140952 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.objects.instance [None req-eeebc3d9-d4ae-4121-b6c3-d7a5be50d212 tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Lazy-loading 'services' on Instance uuid af80abaa-6f64-4133-b2a0-3007d3f17cc0 {{(pid=130263) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 03:57:10.341218 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-eeebc3d9-d4ae-4121-b6c3-d7a5be50d212 tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] 10.222.0.66 "DELETE /compute/v2.1/servers/af80abaa-6f64-4133-b2a0-3007d3f17cc0/os-volume_attachments/282799de-922e-49c5-86b7-a1592d9831fa" status: 202 len: 0 microversion: 2.1 time: 0.294549 Aug 04 03:57:10.341810 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 629/1260] 10.222.0.66 () {58 vars in 1416 bytes} [Thu Aug 4 03:57:10 2022] DELETE /compute/v2.1/servers/af80abaa-6f64-4133-b2a0-3007d3f17cc0/os-volume_attachments/282799de-922e-49c5-86b7-a1592d9831fa => generated 0 bytes in 296 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 03:57:11.455715 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG dbcounter [-] [130262] Writing DB stats nova_api:SELECT=2 {{(pid=130262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:57:11.456477 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG dbcounter [-] [130262] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=130262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:57:11.461149 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-c3895f37-2890-4cc9-9969-6a0874a74b31 tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:57:11.461760 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-c3895f37-2890-4cc9-9969-6a0874a74b31 tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] [instance: af80abaa-6f64-4133-b2a0-3007d3f17cc0] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:57:11.467758 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-c3895f37-2890-4cc9-9969-6a0874a74b31 tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:57:11.468208 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-c3895f37-2890-4cc9-9969-6a0874a74b31 tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:57:11.468971 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-c3895f37-2890-4cc9-9969-6a0874a74b31 tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:57:11.469448 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-c3895f37-2890-4cc9-9969-6a0874a74b31 tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:57:11.494910 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-c3895f37-2890-4cc9-9969-6a0874a74b31 tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] [instance: af80abaa-6f64-4133-b2a0-3007d3f17cc0] Going to try to terminate instance {{(pid=130262) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 03:57:11.776607 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-c3895f37-2890-4cc9-9969-6a0874a74b31 tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] 10.222.0.66 "DELETE /compute/v2.1/servers/af80abaa-6f64-4133-b2a0-3007d3f17cc0" status: 204 len: 0 microversion: 2.1 time: 0.321937 Aug 04 03:57:11.777106 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 632/1261] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 03:57:11 2022] DELETE /compute/v2.1/servers/af80abaa-6f64-4133-b2a0-3007d3f17cc0 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 03:57:11.786547 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-cd03b7db-3411-44ba-847e-04b16571445a tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:57:11.787239 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-cd03b7db-3411-44ba-847e-04b16571445a tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] [instance: af80abaa-6f64-4133-b2a0-3007d3f17cc0] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:57:11.793566 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-cd03b7db-3411-44ba-847e-04b16571445a tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:57:11.794011 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-cd03b7db-3411-44ba-847e-04b16571445a tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:57:11.794761 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-cd03b7db-3411-44ba-847e-04b16571445a tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:57:11.795189 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-cd03b7db-3411-44ba-847e-04b16571445a tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:57:11.927400 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-cd03b7db-3411-44ba-847e-04b16571445a tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c57945a0bb4fc78a812b7d453fca81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16033dcf8c904cb2af2c8701a4b6a716', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:57:11.935942 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-cd03b7db-3411-44ba-847e-04b16571445a tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] 10.222.0.66 "GET /compute/v2.1/servers/af80abaa-6f64-4133-b2a0-3007d3f17cc0" status: 200 len: 1514 microversion: 2.1 time: 0.154380 Aug 04 03:57:11.936548 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 630/1262] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:57:11 2022] GET /compute/v2.1/servers/af80abaa-6f64-4133-b2a0-3007d3f17cc0 => generated 1514 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:57:12.958042 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-86d121d6-7ef5-4ff4-aca7-fc021ac411cf tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:57:12.958770 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-86d121d6-7ef5-4ff4-aca7-fc021ac411cf tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] [instance: af80abaa-6f64-4133-b2a0-3007d3f17cc0] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:57:12.965985 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-86d121d6-7ef5-4ff4-aca7-fc021ac411cf tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:57:12.966427 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-86d121d6-7ef5-4ff4-aca7-fc021ac411cf tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:57:12.967184 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-86d121d6-7ef5-4ff4-aca7-fc021ac411cf tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:57:12.967610 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-86d121d6-7ef5-4ff4-aca7-fc021ac411cf tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:57:13.097131 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-86d121d6-7ef5-4ff4-aca7-fc021ac411cf tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c57945a0bb4fc78a812b7d453fca81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16033dcf8c904cb2af2c8701a4b6a716', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:57:13.104843 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-86d121d6-7ef5-4ff4-aca7-fc021ac411cf tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] 10.222.0.66 "GET /compute/v2.1/servers/af80abaa-6f64-4133-b2a0-3007d3f17cc0" status: 200 len: 1514 microversion: 2.1 time: 0.151056 Aug 04 03:57:13.105427 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 633/1263] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:57:12 2022] GET /compute/v2.1/servers/af80abaa-6f64-4133-b2a0-3007d3f17cc0 => generated 1514 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:57:14.126227 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-db64b763-1c0c-4d6b-8e5e-b01bd9d8c62b tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:57:14.126887 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-db64b763-1c0c-4d6b-8e5e-b01bd9d8c62b tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] [instance: af80abaa-6f64-4133-b2a0-3007d3f17cc0] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:57:14.133336 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-db64b763-1c0c-4d6b-8e5e-b01bd9d8c62b tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:57:14.133792 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-db64b763-1c0c-4d6b-8e5e-b01bd9d8c62b tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:57:14.134559 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-db64b763-1c0c-4d6b-8e5e-b01bd9d8c62b tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:57:14.134994 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-db64b763-1c0c-4d6b-8e5e-b01bd9d8c62b tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:57:14.205529 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-db64b763-1c0c-4d6b-8e5e-b01bd9d8c62b tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c57945a0bb4fc78a812b7d453fca81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16033dcf8c904cb2af2c8701a4b6a716', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:57:14.213430 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-db64b763-1c0c-4d6b-8e5e-b01bd9d8c62b tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] 10.222.0.66 "GET /compute/v2.1/servers/af80abaa-6f64-4133-b2a0-3007d3f17cc0" status: 200 len: 1472 microversion: 2.1 time: 0.090947 Aug 04 03:57:14.213999 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 631/1264] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:57:14 2022] GET /compute/v2.1/servers/af80abaa-6f64-4133-b2a0-3007d3f17cc0 => generated 1472 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:57:14.216465 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [req-d648f804-96af-4efc-8019-88dd6bebeb15 req-0276a0f5-6c44-42d9-893e-8c578aa16a8f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af80abaa-6f64-4133-b2a0-3007d3f17cc0", "name": "network-vif-deleted", "tag": "48446476-c6eb-4813-8e3f-d5dfdac0a767"}]} {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 03:57:14.227119 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [req-d648f804-96af-4efc-8019-88dd6bebeb15 req-0276a0f5-6c44-42d9-893e-8c578aa16a8f service nova] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:57:14.227559 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [req-d648f804-96af-4efc-8019-88dd6bebeb15 req-0276a0f5-6c44-42d9-893e-8c578aa16a8f service nova] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:57:14.238289 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.compute.server_external_events [req-d648f804-96af-4efc-8019-88dd6bebeb15 req-0276a0f5-6c44-42d9-893e-8c578aa16a8f service nova] Creating event network-vif-deleted:48446476-c6eb-4813-8e3f-d5dfdac0a767 for instance af80abaa-6f64-4133-b2a0-3007d3f17cc0 on hv-cinder-73306 Aug 04 03:57:14.244658 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [req-d648f804-96af-4efc-8019-88dd6bebeb15 req-0276a0f5-6c44-42d9-893e-8c578aa16a8f service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091855 Aug 04 03:57:14.245251 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 634/1265] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 03:57:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 03:57:15.235363 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-edca7c33-d8fe-4af5-9a25-14fd4098a4bc tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:57:15.235979 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-edca7c33-d8fe-4af5-9a25-14fd4098a4bc tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] [instance: af80abaa-6f64-4133-b2a0-3007d3f17cc0] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:57:15.242603 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-edca7c33-d8fe-4af5-9a25-14fd4098a4bc tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:57:15.243054 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-edca7c33-d8fe-4af5-9a25-14fd4098a4bc tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:57:15.243812 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-edca7c33-d8fe-4af5-9a25-14fd4098a4bc tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:57:15.244248 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-edca7c33-d8fe-4af5-9a25-14fd4098a4bc tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:57:15.257794 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.wsgi [None req-edca7c33-d8fe-4af5-9a25-14fd4098a4bc tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] HTTP exception thrown: Instance af80abaa-6f64-4133-b2a0-3007d3f17cc0 could not be found. Aug 04 03:57:15.259446 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-edca7c33-d8fe-4af5-9a25-14fd4098a4bc tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Request method failure captured: Aug 04 03:57:15.259446 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: request: GET /compute/v2.1/servers/af80abaa-6f64-4133-b2a0-3007d3f17cc0 HTTP/1.1 Aug 04 03:57:15.259446 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Accept: application/json Aug 04 03:57:15.259446 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Accept-Encoding: identity Aug 04 03:57:15.259446 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Connection: close Aug 04 03:57:15.259446 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Content-Length: 0 Aug 04 03:57:15.259446 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Content-Type: application/json Aug 04 03:57:15.259446 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Host: 10.222.0.66 Aug 04 03:57:15.259446 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Openstack-System-Scope: None Aug 04 03:57:15.259446 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: User-Agent: python-urllib3/1.26.11 Aug 04 03:57:15.259446 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Auth-Token: gAAAAABi60NUes0O4nxl1uU0GxxBpofv2hOdu7BbL-Y5VPGYROYx8PzSjkv3JgOYrItPOizcTrkUsHUCjlz3SXnSF5evw3IYY1n_P1BW2sKg8yUp5Z6qUpbTNgUdnxTFR-JfzukhoLux9pTfrX0njrp4sAtlf3KPMa9ZrNH2echpd2SYemuw-YA Aug 04 03:57:15.259446 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Domain-Id: None Aug 04 03:57:15.259446 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Domain-Name: None Aug 04 03:57:15.259446 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Identity-Status: Confirmed Aug 04 03:57:15.259446 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Is-Admin-Project: True Aug 04 03:57:15.259446 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Project-Domain-Id: default Aug 04 03:57:15.259446 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Project-Domain-Name: Default Aug 04 03:57:15.259446 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Project-Id: 16033dcf8c904cb2af2c8701a4b6a716 Aug 04 03:57:15.259446 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Project-Name: tempest-VolumesSnapshotTestJSON-577088005 Aug 04 03:57:15.259446 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Role: member,reader Aug 04 03:57:15.259446 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Roles: member,reader Aug 04 03:57:15.261264 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/16033dcf8c904cb2af2c8701a4b6a716"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/16033dcf8c904cb2af2c8701a4b6a716"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/16033dcf8c904cb2af2c8701a4b6a716"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_16033dcf8c904cb2af2c8701a4b6a716"}]}] Aug 04 03:57:15.261264 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Tenant: tempest-VolumesSnapshotTestJSON-577088005 Aug 04 03:57:15.261264 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Tenant-Id: 16033dcf8c904cb2af2c8701a4b6a716 Aug 04 03:57:15.261264 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-577088005 Aug 04 03:57:15.261264 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-User: tempest-VolumesSnapshotTestJSON-577088005-project Aug 04 03:57:15.261264 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-User-Domain-Id: default Aug 04 03:57:15.261264 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-User-Domain-Name: Default Aug 04 03:57:15.261264 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-User-Id: 47c57945a0bb4fc78a812b7d453fca81 Aug 04 03:57:15.261264 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-User-Name: tempest-VolumesSnapshotTestJSON-577088005-project Aug 04 03:57:15.261264 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: method: > Aug 04 03:57:15.261264 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: exception: Instance af80abaa-6f64-4133-b2a0-3007d3f17cc0 could not be found. Aug 04 03:57:15.261264 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: action_args: {'id': 'af80abaa-6f64-4133-b2a0-3007d3f17cc0'} Aug 04 03:57:15.262280 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 03:57:15.262280 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 03:57:15.262280 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 03:57:15.262280 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 03:57:15.262280 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 03:57:15.262280 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 03:57:15.262280 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 03:57:15.262280 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 03:57:15.262280 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 03:57:15.262280 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 03:57:15.262280 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af80abaa-6f64-4133-b2a0-3007d3f17cc0 could not be found. Aug 04 03:57:15.262280 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Aug 04 03:57:15.262280 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 03:57:15.262280 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Aug 04 03:57:15.262280 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 03:57:15.262280 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 03:57:15.262280 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 03:57:15.262280 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 03:57:15.262280 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 03:57:15.262280 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 03:57:15.264029 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 03:57:15.264029 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 03:57:15.264029 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 03:57:15.264029 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 03:57:15.264029 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 03:57:15.264029 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 03:57:15.264029 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 03:57:15.264029 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af80abaa-6f64-4133-b2a0-3007d3f17cc0 could not be found. Aug 04 03:57:15.264029 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Aug 04 03:57:15.264029 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 03:57:15.264029 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Aug 04 03:57:15.264029 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 03:57:15.264029 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 03:57:15.264029 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 03:57:15.264029 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 03:57:15.264029 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 03:57:15.264029 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af80abaa-6f64-4133-b2a0-3007d3f17cc0 could not be found. Aug 04 03:57:15.264029 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Aug 04 03:57:15.265741 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-edca7c33-d8fe-4af5-9a25-14fd4098a4bc tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Returning 404 to user: Instance af80abaa-6f64-4133-b2a0-3007d3f17cc0 could not be found. {{(pid=130263) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 03:57:15.265741 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-edca7c33-d8fe-4af5-9a25-14fd4098a4bc tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] 10.222.0.66 "GET /compute/v2.1/servers/af80abaa-6f64-4133-b2a0-3007d3f17cc0" status: 404 len: 111 microversion: 2.1 time: 0.029349 Aug 04 03:57:15.265741 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 632/1266] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:57:15 2022] GET /compute/v2.1/servers/af80abaa-6f64-4133-b2a0-3007d3f17cc0 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 03:57:25.890439 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-3ea6e8fe-7e6e-45c7-9aa7-e8783f929226 tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-868082406", "imageRef": "0208f4b3-1d2f-42e4-a9b4-528bf5066fe1", "flavorRef": "452", "networks": [{"uuid": "03ed1f13-0e98-4f2e-985c-b6028da9a851"}]}} {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 03:57:25.899601 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG dbcounter [-] [130262] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=130262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:57:25.900263 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG dbcounter [-] [130262] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:57:25.944697 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.network.neutron [None req-3ea6e8fe-7e6e-45c7-9aa7-e8783f929226 tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] validate_networks() for [('03ed1f13-0e98-4f2e-985c-b6028da9a851', None, None, None, None, None)] {{(pid=130262) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 04 03:57:26.298059 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.virt.hardware [None req-3ea6e8fe-7e6e-45c7-9aa7-e8783f929226 tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Flavor limits 0:0:0 {{(pid=130262) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 04 03:57:26.298601 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.virt.hardware [None req-3ea6e8fe-7e6e-45c7-9aa7-e8783f929226 tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Image limits 0:0:0 {{(pid=130262) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 04 03:57:26.299075 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.virt.hardware [None req-3ea6e8fe-7e6e-45c7-9aa7-e8783f929226 tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Flavor pref 0:0:0 {{(pid=130262) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 04 03:57:26.299479 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.virt.hardware [None req-3ea6e8fe-7e6e-45c7-9aa7-e8783f929226 tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Image pref 0:0:0 {{(pid=130262) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 04 03:57:26.299926 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.virt.hardware [None req-3ea6e8fe-7e6e-45c7-9aa7-e8783f929226 tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130262) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 04 03:57:26.310229 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-3ea6e8fe-7e6e-45c7-9aa7-e8783f929226 tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:57:26.310607 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-3ea6e8fe-7e6e-45c7-9aa7-e8783f929226 tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:57:26.311434 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-3ea6e8fe-7e6e-45c7-9aa7-e8783f929226 tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:57:26.311867 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-3ea6e8fe-7e6e-45c7-9aa7-e8783f929226 tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:57:26.329156 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.quota [None req-3ea6e8fe-7e6e-45c7-9aa7-e8783f929226 tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Getting quotas for project 16033dcf8c904cb2af2c8701a4b6a716. Resources: {'instances', 'ram', 'cores'} {{(pid=130262) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 04 03:57:26.333015 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.quota [None req-3ea6e8fe-7e6e-45c7-9aa7-e8783f929226 tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Getting quotas for user 47c57945a0bb4fc78a812b7d453fca81 and project 16033dcf8c904cb2af2c8701a4b6a716. Resources: {'instances', 'ram', 'cores'} {{(pid=130262) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 04 03:57:26.344381 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-3ea6e8fe-7e6e-45c7-9aa7-e8783f929226 tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Going to run 1 instances... {{(pid=130262) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 04 03:57:26.346729 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-3ea6e8fe-7e6e-45c7-9aa7-e8783f929226 tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] [instance: 91f25b6f-fbf7-4838-807a-dc44eca85a09] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0208f4b3-1d2f-42e4-a9b4-528bf5066fe1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130262) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 04 03:57:26.441287 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-3ea6e8fe-7e6e-45c7-9aa7-e8783f929226 tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] 10.222.0.66 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.555058 Aug 04 03:57:26.441937 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 635/1267] 10.222.0.66 () {60 vars in 1147 bytes} [Thu Aug 4 03:57:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 557 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 04 03:57:26.453404 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-050bb73b-c01a-4307-8372-cca01ee7708f tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:57:26.454016 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-050bb73b-c01a-4307-8372-cca01ee7708f tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] [instance: 91f25b6f-fbf7-4838-807a-dc44eca85a09] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:57:26.456749 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG dbcounter [-] [130263] Writing DB stats nova_api:SELECT=8 {{(pid=130263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:57:26.457437 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG dbcounter [-] [130263] Writing DB stats nova_cell1:SELECT=23,nova_cell1:INSERT=1 {{(pid=130263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:57:26.510146 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-050bb73b-c01a-4307-8372-cca01ee7708f tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c57945a0bb4fc78a812b7d453fca81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16033dcf8c904cb2af2c8701a4b6a716', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:57:26.517108 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-050bb73b-c01a-4307-8372-cca01ee7708f tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] 10.222.0.66 "GET /compute/v2.1/servers/91f25b6f-fbf7-4838-807a-dc44eca85a09" status: 200 len: 1218 microversion: 2.1 time: 0.067736 Aug 04 03:57:26.523009 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 633/1268] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:57:26 2022] GET /compute/v2.1/servers/91f25b6f-fbf7-4838-807a-dc44eca85a09 => generated 1218 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:57:27.538682 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-ed14a44e-d78c-4f5f-94ff-bd456fe94e25 tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:57:27.540067 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-ed14a44e-d78c-4f5f-94ff-bd456fe94e25 tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] [instance: 91f25b6f-fbf7-4838-807a-dc44eca85a09] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:57:27.547182 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-ed14a44e-d78c-4f5f-94ff-bd456fe94e25 tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:57:27.547629 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-ed14a44e-d78c-4f5f-94ff-bd456fe94e25 tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:57:27.548383 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-ed14a44e-d78c-4f5f-94ff-bd456fe94e25 tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:57:27.548814 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-ed14a44e-d78c-4f5f-94ff-bd456fe94e25 tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:57:27.609801 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-ed14a44e-d78c-4f5f-94ff-bd456fe94e25 tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c57945a0bb4fc78a812b7d453fca81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16033dcf8c904cb2af2c8701a4b6a716', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:57:27.617268 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-ed14a44e-d78c-4f5f-94ff-bd456fe94e25 tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] 10.222.0.66 "GET /compute/v2.1/servers/91f25b6f-fbf7-4838-807a-dc44eca85a09" status: 200 len: 1214 microversion: 2.1 time: 0.083038 Aug 04 03:57:27.618445 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 636/1269] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:57:27 2022] GET /compute/v2.1/servers/91f25b6f-fbf7-4838-807a-dc44eca85a09 => generated 1214 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:57:28.639736 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-f0a244fd-e4c1-4071-8640-8e4281e3dcb6 tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:57:28.650711 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-f0a244fd-e4c1-4071-8640-8e4281e3dcb6 tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] [instance: 91f25b6f-fbf7-4838-807a-dc44eca85a09] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:57:28.650711 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-f0a244fd-e4c1-4071-8640-8e4281e3dcb6 tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:57:28.650711 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-f0a244fd-e4c1-4071-8640-8e4281e3dcb6 tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:57:28.650711 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-f0a244fd-e4c1-4071-8640-8e4281e3dcb6 tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:57:28.651187 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-f0a244fd-e4c1-4071-8640-8e4281e3dcb6 tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:57:28.713577 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-f0a244fd-e4c1-4071-8640-8e4281e3dcb6 tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c57945a0bb4fc78a812b7d453fca81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16033dcf8c904cb2af2c8701a4b6a716', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:57:28.720879 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-f0a244fd-e4c1-4071-8640-8e4281e3dcb6 tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] 10.222.0.66 "GET /compute/v2.1/servers/91f25b6f-fbf7-4838-807a-dc44eca85a09" status: 200 len: 1276 microversion: 2.1 time: 0.085269 Aug 04 03:57:28.721470 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 634/1270] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:57:28 2022] GET /compute/v2.1/servers/91f25b6f-fbf7-4838-807a-dc44eca85a09 => generated 1276 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:57:29.742970 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-44b72e78-2ac7-4d27-b673-f50c3904eca6 tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:57:29.743614 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-44b72e78-2ac7-4d27-b673-f50c3904eca6 tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] [instance: 91f25b6f-fbf7-4838-807a-dc44eca85a09] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:57:29.750290 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-44b72e78-2ac7-4d27-b673-f50c3904eca6 tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:57:29.750743 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-44b72e78-2ac7-4d27-b673-f50c3904eca6 tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:57:29.751523 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-44b72e78-2ac7-4d27-b673-f50c3904eca6 tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:57:29.752002 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-44b72e78-2ac7-4d27-b673-f50c3904eca6 tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:57:29.761805 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [req-947a910e-7e03-492e-9d37-c9875ef0bd7d req-02b8af12-15bf-4b95-aea0-7b8cdbd2c70d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91f25b6f-fbf7-4838-807a-dc44eca85a09", "tag": "8fef8f84-6f36-4d33-a1b4-374fcf347db9"}]} {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 03:57:29.773296 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [req-947a910e-7e03-492e-9d37-c9875ef0bd7d req-02b8af12-15bf-4b95-aea0-7b8cdbd2c70d service nova] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:57:29.774746 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [req-947a910e-7e03-492e-9d37-c9875ef0bd7d req-02b8af12-15bf-4b95-aea0-7b8cdbd2c70d service nova] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:57:29.786898 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.compute.server_external_events [req-947a910e-7e03-492e-9d37-c9875ef0bd7d req-02b8af12-15bf-4b95-aea0-7b8cdbd2c70d service nova] Creating event network-changed:8fef8f84-6f36-4d33-a1b4-374fcf347db9 for instance 91f25b6f-fbf7-4838-807a-dc44eca85a09 on hv-cinder-73306 Aug 04 03:57:29.792404 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [req-947a910e-7e03-492e-9d37-c9875ef0bd7d req-02b8af12-15bf-4b95-aea0-7b8cdbd2c70d service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037992 Aug 04 03:57:29.793095 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 635/1271] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 03:57:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 03:57:29.894142 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-44b72e78-2ac7-4d27-b673-f50c3904eca6 tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c57945a0bb4fc78a812b7d453fca81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16033dcf8c904cb2af2c8701a4b6a716', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:57:29.902275 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-44b72e78-2ac7-4d27-b673-f50c3904eca6 tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] 10.222.0.66 "GET /compute/v2.1/servers/91f25b6f-fbf7-4838-807a-dc44eca85a09" status: 200 len: 1318 microversion: 2.1 time: 0.163457 Aug 04 03:57:29.902840 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 637/1272] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:57:29 2022] GET /compute/v2.1/servers/91f25b6f-fbf7-4838-807a-dc44eca85a09 => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:57:30.923633 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-52e0b9b9-783d-4554-babe-5572a937b2d9 tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:57:30.924377 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-52e0b9b9-783d-4554-babe-5572a937b2d9 tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] [instance: 91f25b6f-fbf7-4838-807a-dc44eca85a09] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:57:30.931817 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-52e0b9b9-783d-4554-babe-5572a937b2d9 tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:57:30.932260 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-52e0b9b9-783d-4554-babe-5572a937b2d9 tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:57:30.933014 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-52e0b9b9-783d-4554-babe-5572a937b2d9 tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:57:30.933472 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-52e0b9b9-783d-4554-babe-5572a937b2d9 tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:57:31.065216 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-52e0b9b9-783d-4554-babe-5572a937b2d9 tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c57945a0bb4fc78a812b7d453fca81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16033dcf8c904cb2af2c8701a4b6a716', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:57:31.073159 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-52e0b9b9-783d-4554-babe-5572a937b2d9 tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] 10.222.0.66 "GET /compute/v2.1/servers/91f25b6f-fbf7-4838-807a-dc44eca85a09" status: 200 len: 1318 microversion: 2.1 time: 0.153712 Aug 04 03:57:31.073746 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 636/1273] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:57:30 2022] GET /compute/v2.1/servers/91f25b6f-fbf7-4838-807a-dc44eca85a09 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:57:32.093764 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-74d837e5-a512-47ce-a7ec-b3e9707f1569 tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:57:32.094374 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-74d837e5-a512-47ce-a7ec-b3e9707f1569 tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] [instance: 91f25b6f-fbf7-4838-807a-dc44eca85a09] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:57:32.101063 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-74d837e5-a512-47ce-a7ec-b3e9707f1569 tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:57:32.101561 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-74d837e5-a512-47ce-a7ec-b3e9707f1569 tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:57:32.102910 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-74d837e5-a512-47ce-a7ec-b3e9707f1569 tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:57:32.103375 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-74d837e5-a512-47ce-a7ec-b3e9707f1569 tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:57:32.238591 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-74d837e5-a512-47ce-a7ec-b3e9707f1569 tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c57945a0bb4fc78a812b7d453fca81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16033dcf8c904cb2af2c8701a4b6a716', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:57:32.246198 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-74d837e5-a512-47ce-a7ec-b3e9707f1569 tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] 10.222.0.66 "GET /compute/v2.1/servers/91f25b6f-fbf7-4838-807a-dc44eca85a09" status: 200 len: 1318 microversion: 2.1 time: 0.156291 Aug 04 03:57:32.246752 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 638/1274] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:57:32 2022] GET /compute/v2.1/servers/91f25b6f-fbf7-4838-807a-dc44eca85a09 => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:57:33.266850 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-aa538f2c-a9aa-4778-9e92-cf6a6050cb6b tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:57:33.267368 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-aa538f2c-a9aa-4778-9e92-cf6a6050cb6b tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] [instance: 91f25b6f-fbf7-4838-807a-dc44eca85a09] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:57:33.273987 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-aa538f2c-a9aa-4778-9e92-cf6a6050cb6b tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:57:33.274444 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-aa538f2c-a9aa-4778-9e92-cf6a6050cb6b tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:57:33.275204 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-aa538f2c-a9aa-4778-9e92-cf6a6050cb6b tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:57:33.275639 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-aa538f2c-a9aa-4778-9e92-cf6a6050cb6b tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:57:33.404807 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-aa538f2c-a9aa-4778-9e92-cf6a6050cb6b tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c57945a0bb4fc78a812b7d453fca81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16033dcf8c904cb2af2c8701a4b6a716', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:57:33.412345 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-aa538f2c-a9aa-4778-9e92-cf6a6050cb6b tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] 10.222.0.66 "GET /compute/v2.1/servers/91f25b6f-fbf7-4838-807a-dc44eca85a09" status: 200 len: 1318 microversion: 2.1 time: 0.149403 Aug 04 03:57:33.412908 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 637/1275] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:57:33 2022] GET /compute/v2.1/servers/91f25b6f-fbf7-4838-807a-dc44eca85a09 => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:57:34.433092 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-b57f5adb-c07e-4c08-a645-bb52b411badb tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:57:34.433649 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-b57f5adb-c07e-4c08-a645-bb52b411badb tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] [instance: 91f25b6f-fbf7-4838-807a-dc44eca85a09] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:57:34.440212 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-b57f5adb-c07e-4c08-a645-bb52b411badb tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:57:34.440663 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-b57f5adb-c07e-4c08-a645-bb52b411badb tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:57:34.441484 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-b57f5adb-c07e-4c08-a645-bb52b411badb tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:57:34.441909 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-b57f5adb-c07e-4c08-a645-bb52b411badb tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:57:34.571375 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-b57f5adb-c07e-4c08-a645-bb52b411badb tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c57945a0bb4fc78a812b7d453fca81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16033dcf8c904cb2af2c8701a4b6a716', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:57:34.578686 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-b57f5adb-c07e-4c08-a645-bb52b411badb tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] 10.222.0.66 "GET /compute/v2.1/servers/91f25b6f-fbf7-4838-807a-dc44eca85a09" status: 200 len: 1318 microversion: 2.1 time: 0.149686 Aug 04 03:57:34.579245 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 639/1276] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:57:34 2022] GET /compute/v2.1/servers/91f25b6f-fbf7-4838-807a-dc44eca85a09 => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:57:34.973703 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [req-a2226893-3c93-4d8a-bbdc-06d6b5c1f55e req-7884aedc-5ce8-497f-9d65-3e7d5e75a5fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91f25b6f-fbf7-4838-807a-dc44eca85a09", "name": "network-vif-plugged", "status": "completed", "tag": "8fef8f84-6f36-4d33-a1b4-374fcf347db9"}]} {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 03:57:34.991072 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [req-a2226893-3c93-4d8a-bbdc-06d6b5c1f55e req-7884aedc-5ce8-497f-9d65-3e7d5e75a5fd service nova] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:57:34.991488 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [req-a2226893-3c93-4d8a-bbdc-06d6b5c1f55e req-7884aedc-5ce8-497f-9d65-3e7d5e75a5fd service nova] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:57:35.002877 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.compute.server_external_events [req-a2226893-3c93-4d8a-bbdc-06d6b5c1f55e req-7884aedc-5ce8-497f-9d65-3e7d5e75a5fd service nova] Creating event network-vif-plugged:8fef8f84-6f36-4d33-a1b4-374fcf347db9 for instance 91f25b6f-fbf7-4838-807a-dc44eca85a09 on hv-cinder-73306 Aug 04 03:57:35.007869 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [req-a2226893-3c93-4d8a-bbdc-06d6b5c1f55e req-7884aedc-5ce8-497f-9d65-3e7d5e75a5fd service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038510 Aug 04 03:57:35.008759 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 638/1277] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 03:57:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 03:57:35.600170 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-803a383c-a6a9-49d6-8a6f-e12c7ac3c829 tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:57:35.600753 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-803a383c-a6a9-49d6-8a6f-e12c7ac3c829 tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] [instance: 91f25b6f-fbf7-4838-807a-dc44eca85a09] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:57:35.607610 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-803a383c-a6a9-49d6-8a6f-e12c7ac3c829 tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:57:35.608048 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-803a383c-a6a9-49d6-8a6f-e12c7ac3c829 tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:57:35.608797 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-803a383c-a6a9-49d6-8a6f-e12c7ac3c829 tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:57:35.609250 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-803a383c-a6a9-49d6-8a6f-e12c7ac3c829 tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:57:35.736278 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-803a383c-a6a9-49d6-8a6f-e12c7ac3c829 tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c57945a0bb4fc78a812b7d453fca81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16033dcf8c904cb2af2c8701a4b6a716', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:57:35.743600 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-803a383c-a6a9-49d6-8a6f-e12c7ac3c829 tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] 10.222.0.66 "GET /compute/v2.1/servers/91f25b6f-fbf7-4838-807a-dc44eca85a09" status: 200 len: 1318 microversion: 2.1 time: 0.147632 Aug 04 03:57:35.744164 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 640/1278] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:57:35 2022] GET /compute/v2.1/servers/91f25b6f-fbf7-4838-807a-dc44eca85a09 => generated 1318 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:57:36.762113 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG dbcounter [-] [130263] Writing DB stats nova_cell0:SELECT=2 {{(pid=130263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:57:36.766209 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-5d5c9f66-8d15-4070-8daa-3f0608d1377a tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:57:36.766941 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-5d5c9f66-8d15-4070-8daa-3f0608d1377a tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] [instance: 91f25b6f-fbf7-4838-807a-dc44eca85a09] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:57:36.773097 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-5d5c9f66-8d15-4070-8daa-3f0608d1377a tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:57:36.773583 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-5d5c9f66-8d15-4070-8daa-3f0608d1377a tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:57:36.775105 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-5d5c9f66-8d15-4070-8daa-3f0608d1377a tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:57:36.775546 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-5d5c9f66-8d15-4070-8daa-3f0608d1377a tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:57:36.908221 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-5d5c9f66-8d15-4070-8daa-3f0608d1377a tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c57945a0bb4fc78a812b7d453fca81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16033dcf8c904cb2af2c8701a4b6a716', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:57:36.915817 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-5d5c9f66-8d15-4070-8daa-3f0608d1377a tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] 10.222.0.66 "GET /compute/v2.1/servers/91f25b6f-fbf7-4838-807a-dc44eca85a09" status: 200 len: 1318 microversion: 2.1 time: 0.155188 Aug 04 03:57:36.916380 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 639/1279] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:57:36 2022] GET /compute/v2.1/servers/91f25b6f-fbf7-4838-807a-dc44eca85a09 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:57:37.936510 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-b4ae0dc0-3a6b-42eb-b325-00c65f3ac5fb tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:57:37.937125 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-b4ae0dc0-3a6b-42eb-b325-00c65f3ac5fb tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] [instance: 91f25b6f-fbf7-4838-807a-dc44eca85a09] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:57:37.938938 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG dbcounter [-] [130262] Writing DB stats nova_cell0:SELECT=2 {{(pid=130262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:57:37.939580 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG dbcounter [-] [130262] Writing DB stats nova_cell0:SELECT=6 {{(pid=130262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:57:37.944859 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-b4ae0dc0-3a6b-42eb-b325-00c65f3ac5fb tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:57:37.945345 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-b4ae0dc0-3a6b-42eb-b325-00c65f3ac5fb tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:57:37.946100 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-b4ae0dc0-3a6b-42eb-b325-00c65f3ac5fb tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:57:37.946534 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-b4ae0dc0-3a6b-42eb-b325-00c65f3ac5fb tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:57:38.078749 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-b4ae0dc0-3a6b-42eb-b325-00c65f3ac5fb tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c57945a0bb4fc78a812b7d453fca81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16033dcf8c904cb2af2c8701a4b6a716', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:57:38.086212 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-b4ae0dc0-3a6b-42eb-b325-00c65f3ac5fb tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] 10.222.0.66 "GET /compute/v2.1/servers/91f25b6f-fbf7-4838-807a-dc44eca85a09" status: 200 len: 1508 microversion: 2.1 time: 0.153537 Aug 04 03:57:38.086950 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 641/1280] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:57:37 2022] GET /compute/v2.1/servers/91f25b6f-fbf7-4838-807a-dc44eca85a09 => generated 1508 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:57:38.107658 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-ca86cd0e-bc93-44bf-8f80-b38e5294f3a2 tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f5a38228-e03a-4a8c-8a43-45a9f0fa5ad8", "device": "/dev/sdb"}} {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 03:57:38.110726 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-ca86cd0e-bc93-44bf-8f80-b38e5294f3a2 tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] [instance: 91f25b6f-fbf7-4838-807a-dc44eca85a09] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:57:38.117161 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-ca86cd0e-bc93-44bf-8f80-b38e5294f3a2 tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:57:38.117651 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-ca86cd0e-bc93-44bf-8f80-b38e5294f3a2 tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:57:38.118421 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-ca86cd0e-bc93-44bf-8f80-b38e5294f3a2 tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:57:38.118864 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-ca86cd0e-bc93-44bf-8f80-b38e5294f3a2 tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:57:38.778723 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-ca86cd0e-bc93-44bf-8f80-b38e5294f3a2 tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] 10.222.0.66 "POST /compute/v2.1/servers/91f25b6f-fbf7-4838-807a-dc44eca85a09/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.675436 Aug 04 03:57:38.779367 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 640/1281] 10.222.0.66 () {60 vars in 1323 bytes} [Thu Aug 4 03:57:38 2022] POST /compute/v2.1/servers/91f25b6f-fbf7-4838-807a-dc44eca85a09/os-volume_attachments => generated 194 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 04 03:58:01.861391 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-1f4bdd6a-e710-4b65-a530-cb8ee6eca138 tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:58:01.861901 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-1f4bdd6a-e710-4b65-a530-cb8ee6eca138 tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] [instance: 91f25b6f-fbf7-4838-807a-dc44eca85a09] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:58:01.863783 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG dbcounter [-] [130262] Writing DB stats nova_api:SELECT=25,nova_api:INSERT=3 {{(pid=130262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:58:01.864534 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG dbcounter [-] [130262] Writing DB stats nova_cell1:SELECT=38 {{(pid=130262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:58:01.869350 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-1f4bdd6a-e710-4b65-a530-cb8ee6eca138 tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:58:01.869884 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-1f4bdd6a-e710-4b65-a530-cb8ee6eca138 tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:58:01.870582 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-1f4bdd6a-e710-4b65-a530-cb8ee6eca138 tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:58:01.871016 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-1f4bdd6a-e710-4b65-a530-cb8ee6eca138 tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:58:01.975012 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.objects.instance [None req-1f4bdd6a-e710-4b65-a530-cb8ee6eca138 tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Lazy-loading 'services' on Instance uuid 91f25b6f-fbf7-4838-807a-dc44eca85a09 {{(pid=130262) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 04 03:58:02.180861 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-1f4bdd6a-e710-4b65-a530-cb8ee6eca138 tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] 10.222.0.66 "DELETE /compute/v2.1/servers/91f25b6f-fbf7-4838-807a-dc44eca85a09/os-volume_attachments/f5a38228-e03a-4a8c-8a43-45a9f0fa5ad8" status: 202 len: 0 microversion: 2.1 time: 0.323318 Aug 04 03:58:02.181519 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 642/1282] 10.222.0.66 () {58 vars in 1416 bytes} [Thu Aug 4 03:58:01 2022] DELETE /compute/v2.1/servers/91f25b6f-fbf7-4838-807a-dc44eca85a09/os-volume_attachments/f5a38228-e03a-4a8c-8a43-45a9f0fa5ad8 => generated 0 bytes in 325 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 04 03:58:03.299761 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG dbcounter [-] [130263] Writing DB stats nova_api:SELECT=18 {{(pid=130263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:58:03.300549 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG dbcounter [-] [130263] Writing DB stats nova_cell1:SELECT=39,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=130263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 04 03:58:03.304690 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-e3a4a053-eedc-4f16-b62c-1faebab46721 tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:58:03.305288 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-e3a4a053-eedc-4f16-b62c-1faebab46721 tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] [instance: 91f25b6f-fbf7-4838-807a-dc44eca85a09] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:58:03.312293 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-e3a4a053-eedc-4f16-b62c-1faebab46721 tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:58:03.312761 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-e3a4a053-eedc-4f16-b62c-1faebab46721 tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:58:03.313551 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-e3a4a053-eedc-4f16-b62c-1faebab46721 tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:58:03.313981 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-e3a4a053-eedc-4f16-b62c-1faebab46721 tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:58:03.341347 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-e3a4a053-eedc-4f16-b62c-1faebab46721 tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] [instance: 91f25b6f-fbf7-4838-807a-dc44eca85a09] Going to try to terminate instance {{(pid=130263) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 04 03:58:03.632864 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-e3a4a053-eedc-4f16-b62c-1faebab46721 tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] 10.222.0.66 "DELETE /compute/v2.1/servers/91f25b6f-fbf7-4838-807a-dc44eca85a09" status: 204 len: 0 microversion: 2.1 time: 0.334393 Aug 04 03:58:03.633534 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 641/1283] 10.222.0.66 () {58 vars in 1239 bytes} [Thu Aug 4 03:58:03 2022] DELETE /compute/v2.1/servers/91f25b6f-fbf7-4838-807a-dc44eca85a09 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 04 03:58:03.643232 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-506f4f30-7dad-440a-973f-138dd07c769b tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:58:03.643927 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-506f4f30-7dad-440a-973f-138dd07c769b tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] [instance: 91f25b6f-fbf7-4838-807a-dc44eca85a09] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:58:03.650278 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-506f4f30-7dad-440a-973f-138dd07c769b tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:58:03.650851 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-506f4f30-7dad-440a-973f-138dd07c769b tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:58:03.652354 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-506f4f30-7dad-440a-973f-138dd07c769b tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:58:03.652811 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-506f4f30-7dad-440a-973f-138dd07c769b tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:58:03.782656 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-506f4f30-7dad-440a-973f-138dd07c769b tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c57945a0bb4fc78a812b7d453fca81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16033dcf8c904cb2af2c8701a4b6a716', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:58:03.790109 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-506f4f30-7dad-440a-973f-138dd07c769b tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] 10.222.0.66 "GET /compute/v2.1/servers/91f25b6f-fbf7-4838-807a-dc44eca85a09" status: 200 len: 1514 microversion: 2.1 time: 0.151599 Aug 04 03:58:03.790668 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 643/1284] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:58:03 2022] GET /compute/v2.1/servers/91f25b6f-fbf7-4838-807a-dc44eca85a09 => generated 1514 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:58:04.811769 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-52224e03-73e2-4742-9acd-dfa2291c3a3f tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:58:04.812469 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-52224e03-73e2-4742-9acd-dfa2291c3a3f tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] [instance: 91f25b6f-fbf7-4838-807a-dc44eca85a09] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:58:04.819236 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-52224e03-73e2-4742-9acd-dfa2291c3a3f tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:58:04.819683 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-52224e03-73e2-4742-9acd-dfa2291c3a3f tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:58:04.820438 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-52224e03-73e2-4742-9acd-dfa2291c3a3f tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:58:04.820871 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-52224e03-73e2-4742-9acd-dfa2291c3a3f tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:58:04.952404 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.policy [None req-52224e03-73e2-4742-9acd-dfa2291c3a3f tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c57945a0bb4fc78a812b7d453fca81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16033dcf8c904cb2af2c8701a4b6a716', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130263) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:58:04.965268 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-52224e03-73e2-4742-9acd-dfa2291c3a3f tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] 10.222.0.66 "GET /compute/v2.1/servers/91f25b6f-fbf7-4838-807a-dc44eca85a09" status: 200 len: 1514 microversion: 2.1 time: 0.156949 Aug 04 03:58:04.966328 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 642/1285] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:58:04 2022] GET /compute/v2.1/servers/91f25b6f-fbf7-4838-807a-dc44eca85a09 => generated 1514 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:58:05.986794 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.api.openstack.wsgi [None req-305dde25-5819-492d-979e-c96251c306dc tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Calling method '>' {{(pid=130262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:58:05.991279 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.compute.api [None req-305dde25-5819-492d-979e-c96251c306dc tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] [instance: 91f25b6f-fbf7-4838-807a-dc44eca85a09] Fetching instance by UUID {{(pid=130262) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:58:05.994917 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [req-41fc02f1-cb64-4d9f-96b5-891e1933fbc9 req-92c49a4d-396e-4bcd-86de-09597d4dcc1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91f25b6f-fbf7-4838-807a-dc44eca85a09", "name": "network-vif-deleted", "tag": "8fef8f84-6f36-4d33-a1b4-374fcf347db9"}]} {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 04 03:58:05.998325 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-305dde25-5819-492d-979e-c96251c306dc tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:58:05.998849 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-305dde25-5819-492d-979e-c96251c306dc tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:58:05.999585 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-305dde25-5819-492d-979e-c96251c306dc tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:58:06.000023 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG oslo_concurrency.lockutils [None req-305dde25-5819-492d-979e-c96251c306dc tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:58:06.004668 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [req-41fc02f1-cb64-4d9f-96b5-891e1933fbc9 req-92c49a4d-396e-4bcd-86de-09597d4dcc1a service nova] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:58:06.005183 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [req-41fc02f1-cb64-4d9f-96b5-891e1933fbc9 req-92c49a4d-396e-4bcd-86de-09597d4dcc1a service nova] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:58:06.017614 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.compute.server_external_events [req-41fc02f1-cb64-4d9f-96b5-891e1933fbc9 req-92c49a4d-396e-4bcd-86de-09597d4dcc1a service nova] Creating event network-vif-deleted:8fef8f84-6f36-4d33-a1b4-374fcf347db9 for instance 91f25b6f-fbf7-4838-807a-dc44eca85a09 on hv-cinder-73306 Aug 04 03:58:06.022796 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [req-41fc02f1-cb64-4d9f-96b5-891e1933fbc9 req-92c49a4d-396e-4bcd-86de-09597d4dcc1a service nova] 10.222.0.66 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032242 Aug 04 03:58:06.023440 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 643/1286] 10.222.0.66 () {64 vars in 1317 bytes} [Thu Aug 4 03:58:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 04 03:58:06.065683 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: DEBUG nova.policy [None req-305dde25-5819-492d-979e-c96251c306dc tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47c57945a0bb4fc78a812b7d453fca81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16033dcf8c904cb2af2c8701a4b6a716', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130262) authorize /opt/stack/nova/nova/policy.py:199}} Aug 04 03:58:06.073271 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO nova.api.openstack.requestlog [None req-305dde25-5819-492d-979e-c96251c306dc tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] 10.222.0.66 "GET /compute/v2.1/servers/91f25b6f-fbf7-4838-807a-dc44eca85a09" status: 200 len: 1472 microversion: 2.1 time: 0.090315 Aug 04 03:58:06.074509 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: [pid: 130262|app: 0|req: 644/1287] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:58:05 2022] GET /compute/v2.1/servers/91f25b6f-fbf7-4838-807a-dc44eca85a09 => generated 1472 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 04 03:58:07.095321 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-a7c2f8f0-8659-4c7f-813a-a50c1e55d576 tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Calling method '>' {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 04 03:58:07.096017 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.compute.api [None req-a7c2f8f0-8659-4c7f-813a-a50c1e55d576 tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] [instance: 91f25b6f-fbf7-4838-807a-dc44eca85a09] Fetching instance by UUID {{(pid=130263) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 04 03:58:07.102989 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-a7c2f8f0-8659-4c7f-813a-a50c1e55d576 tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:58:07.103434 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-a7c2f8f0-8659-4c7f-813a-a50c1e55d576 tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:58:07.104181 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-a7c2f8f0-8659-4c7f-813a-a50c1e55d576 tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 04 03:58:07.104612 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG oslo_concurrency.lockutils [None req-a7c2f8f0-8659-4c7f-813a-a50c1e55d576 tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Lock "832e4e75-7d7f-4738-9a24-2466a2a2c834" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 04 03:58:07.118022 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.wsgi [None req-a7c2f8f0-8659-4c7f-813a-a50c1e55d576 tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] HTTP exception thrown: Instance 91f25b6f-fbf7-4838-807a-dc44eca85a09 could not be found. Aug 04 03:58:07.119665 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-a7c2f8f0-8659-4c7f-813a-a50c1e55d576 tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Request method failure captured: Aug 04 03:58:07.119665 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: request: GET /compute/v2.1/servers/91f25b6f-fbf7-4838-807a-dc44eca85a09 HTTP/1.1 Aug 04 03:58:07.119665 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Accept: application/json Aug 04 03:58:07.119665 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Accept-Encoding: identity Aug 04 03:58:07.119665 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Connection: close Aug 04 03:58:07.119665 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Content-Length: 0 Aug 04 03:58:07.119665 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Content-Type: application/json Aug 04 03:58:07.119665 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Host: 10.222.0.66 Aug 04 03:58:07.119665 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Openstack-System-Scope: None Aug 04 03:58:07.119665 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: User-Agent: python-urllib3/1.26.11 Aug 04 03:58:07.119665 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Auth-Token: gAAAAABi60NUes0O4nxl1uU0GxxBpofv2hOdu7BbL-Y5VPGYROYx8PzSjkv3JgOYrItPOizcTrkUsHUCjlz3SXnSF5evw3IYY1n_P1BW2sKg8yUp5Z6qUpbTNgUdnxTFR-JfzukhoLux9pTfrX0njrp4sAtlf3KPMa9ZrNH2echpd2SYemuw-YA Aug 04 03:58:07.119665 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Domain-Id: None Aug 04 03:58:07.119665 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Domain-Name: None Aug 04 03:58:07.119665 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Identity-Status: Confirmed Aug 04 03:58:07.119665 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Is-Admin-Project: True Aug 04 03:58:07.119665 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Project-Domain-Id: default Aug 04 03:58:07.119665 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Project-Domain-Name: Default Aug 04 03:58:07.119665 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Project-Id: 16033dcf8c904cb2af2c8701a4b6a716 Aug 04 03:58:07.119665 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Project-Name: tempest-VolumesSnapshotTestJSON-577088005 Aug 04 03:58:07.119665 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Role: member,reader Aug 04 03:58:07.119665 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Roles: member,reader Aug 04 03:58:07.121441 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2/16033dcf8c904cb2af2c8701a4b6a716"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/16033dcf8c904cb2af2c8701a4b6a716"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66:9696/networking"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/volume/v3/16033dcf8c904cb2af2c8701a4b6a716"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.66/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.66:8080", "publicURL": "http://10.222.0.66:8080/v1/AUTH_16033dcf8c904cb2af2c8701a4b6a716"}]}] Aug 04 03:58:07.121441 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Tenant: tempest-VolumesSnapshotTestJSON-577088005 Aug 04 03:58:07.121441 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Tenant-Id: 16033dcf8c904cb2af2c8701a4b6a716 Aug 04 03:58:07.121441 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-577088005 Aug 04 03:58:07.121441 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-User: tempest-VolumesSnapshotTestJSON-577088005-project Aug 04 03:58:07.121441 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-User-Domain-Id: default Aug 04 03:58:07.121441 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-User-Domain-Name: Default Aug 04 03:58:07.121441 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-User-Id: 47c57945a0bb4fc78a812b7d453fca81 Aug 04 03:58:07.121441 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: X-User-Name: tempest-VolumesSnapshotTestJSON-577088005-project Aug 04 03:58:07.121441 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: method: > Aug 04 03:58:07.121441 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: exception: Instance 91f25b6f-fbf7-4838-807a-dc44eca85a09 could not be found. Aug 04 03:58:07.121441 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: action_args: {'id': '91f25b6f-fbf7-4838-807a-dc44eca85a09'} Aug 04 03:58:07.122859 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: {{(pid=130263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 04 03:58:07.122859 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 03:58:07.122859 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 04 03:58:07.122859 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 04 03:58:07.122859 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 04 03:58:07.122859 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 04 03:58:07.122859 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 04 03:58:07.122859 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 04 03:58:07.122859 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 04 03:58:07.122859 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 04 03:58:07.122859 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 91f25b6f-fbf7-4838-807a-dc44eca85a09 could not be found. Aug 04 03:58:07.122859 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Aug 04 03:58:07.122859 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 03:58:07.122859 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Aug 04 03:58:07.122859 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 03:58:07.122859 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 03:58:07.122859 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 03:58:07.122859 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 04 03:58:07.122859 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 04 03:58:07.122859 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 04 03:58:07.124552 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 04 03:58:07.124552 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 04 03:58:07.124552 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 04 03:58:07.124552 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 04 03:58:07.124552 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 04 03:58:07.124552 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 04 03:58:07.124552 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 04 03:58:07.124552 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 91f25b6f-fbf7-4838-807a-dc44eca85a09 could not be found. Aug 04 03:58:07.124552 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Aug 04 03:58:07.124552 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 04 03:58:07.124552 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Aug 04 03:58:07.124552 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 04 03:58:07.124552 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 04 03:58:07.124552 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 04 03:58:07.124552 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 04 03:58:07.124552 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 04 03:58:07.124552 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 91f25b6f-fbf7-4838-807a-dc44eca85a09 could not be found. Aug 04 03:58:07.124552 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: ERROR nova.api.openstack.wsgi Aug 04 03:58:07.126119 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: DEBUG nova.api.openstack.wsgi [None req-a7c2f8f0-8659-4c7f-813a-a50c1e55d576 tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] Returning 404 to user: Instance 91f25b6f-fbf7-4838-807a-dc44eca85a09 could not be found. {{(pid=130263) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 04 03:58:07.126119 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO nova.api.openstack.requestlog [None req-a7c2f8f0-8659-4c7f-813a-a50c1e55d576 tempest-VolumesSnapshotTestJSON-577088005 tempest-VolumesSnapshotTestJSON-577088005-project] 10.222.0.66 "GET /compute/v2.1/servers/91f25b6f-fbf7-4838-807a-dc44eca85a09" status: 404 len: 111 microversion: 2.1 time: 0.030043 Aug 04 03:58:07.126119 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: [pid: 130263|app: 0|req: 644/1288] 10.222.0.66 () {58 vars in 1236 bytes} [Thu Aug 4 03:58:07 2022] GET /compute/v2.1/servers/91f25b6f-fbf7-4838-807a-dc44eca85a09 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 04 03:59:16.146049 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 03:59:16.146939 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Thu Aug 4 03:59:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 03:59:16.798703 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 03:59:16.798912 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Thu Aug 4 03:59:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 04:00:17.382931 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 04:00:17.383529 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: Thu Aug 4 04:00:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 04:01:10.906754 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 04:01:10.907393 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Thu Aug 4 04:01:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 04:01:11.420456 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 04:01:11.420994 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: Thu Aug 4 04:01:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 04:02:36.155295 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 04:02:36.155933 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Thu Aug 4 04:02:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 04:02:36.807316 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 04:02:36.807543 dv-cinder-733062-32-iscsi devstack@n-api.service[130263]: Thu Aug 4 04:02:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 04:02:38.291064 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 04:02:38.291627 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: Thu Aug 4 04:02:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 04 04:03:37.390937 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 04 04:03:37.391620 dv-cinder-733062-32-iscsi devstack@n-api.service[130262]: Thu Aug 4 04:03:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!